Will my 18 month old son's teeth go back to normal if I get rid of his pacifier?

My 18 month old son still loves his pacifier. I don't let him suck on it during the day, he only gets it at night or if he's having a meltdown at church or in a restaurant or something . I noticed that his front teeth are starting to look like they're getting pushed forward and I'm so worried!!! If I get rid of the pacifier completely will his teeth go back to normal, or do I have to wait for the next 7 years for his baby teeth to fall out???