There is a necessity in traffic control system using camera to have the capability to discriminate between an object and non-object in the image. One of the procedure to discriminate between those two is usually performed by background subtraction. Gaussian Mixture Model (GMM) is popular method that has been employed to tackle the problem of background subtraction. However, the output of GMM is a rather noisy image which comes from false classification. This situation may arise because several conditions in the video input such as, waving trees, rippling water, and illumination changes. In this paper, an enhanced version of GMM technique which is combined with Hole Filling Algorithm (HF) is proposed to alleviate those problems. The experimental result shows that the proposed method improved the accuracy up to 97.9% and Kappa statistic up to 0.74. This result has outperformed many similar methods that is used for evaluation.