Yeah, it sucks if housing prices are catching up and you don't own a house.
But in a small town there's probably pretty high levels of home ownership so most voters are probably happy their prices have gone up. And it's probably helping the entire local economy.
But small towns also have cheap land pretty close and local builders who don't charge crazy prices. So instead of buying a house in town, you may have to build 5-10 minutes away.
But who knows what OP means by small town. Depending on where you are in the country "small town" can mean drastically different things.
Edit:
OP didn't even say what country they live in...
I have zero idea how they're expecting any rational answer.
Run for mayor (or local equivalent), win, and then push for/implement a bunch of rules that make the town inhospitable to tourists.
I assume the tourism brings in money to the local community, yeah? Cutting off that income will probably mean you won't be able to win the next subsequent election, so act fast.
save