Provincial police chief Mustafa Mayar said the attack occurred early in the morning, but governmental forces responded immediately by killing two militants and injuring three others.
Mayar added that the forces are on standby to repulse any movement by the enemies.
Two AK47s and a radio communication was also seized by police during the attack.
According to the officials, two policemen were also slightly injured during the clashes whose health condition is reported as satisfactory.
Immediately there was no comment from the Taliban group about the attack.
Ghazni is among the volatile provinces in central part of Afghanistan where Taliban controls five of its 18 districts and have a presence in more of nine other districts.