RTO is also a factor for some... when I was working full remote I had the time and energy to attend an HIIT class 4 days a week. I was in the best shape of my life.
Since starting a position that requires me in the office for 3 or more days a week, I no longer have the energy (or schedule) to attend since I spend ~120-160m in traffic. Between that and the lack of proximity to my own kitchen affecting my dietary choices, I've gained almost 40lbs in 2 years.
All of this is of course avoidable with self-discipline, but self-discipline wanes as you get more exhausted from your day.
where you can get a job dictates what city you live near, how much you are paid determines how close you can live to that city, and how much distance you want to keep from your neighbors sets the density you can stand.
Moving to a smaller city changes your job, which changes how much you are paid, which changes how close you can live to the city, and your neighbors may still suck. It's likely that you'll end up in the same soul-sucking commute life that you just left.