My in-laws had a vacation home for a number of years. They lost money on it. In mountain towns summer and winter are the high season. Fall and spring are meh. Unless it's a spectacular rental (lakefront, etc.) then most rentals will be weekend, the week between Christmas and New Year, and the week of Fourth of July. Fall and spring are pretty low demand (including weekends) and even mid week in the high season can be hit or miss. There simply were not enough days rented to make expenses. Now, they owned in a HCOL area (South Lake Tahoe), so they had a big nut to crack to reach profitability. Maybe a LCOL area (lower rents, but also lower costs) might pencil out? I don't know. My take away from being close to the details was that vacation rentals are not a good investment, are essentially an expensive pre-paid vacation...better to rent than own, and then not locked into a single area.
Keep in mind that unless you're retired or have unusual flexibility then you're going to want to use it at the times that renting it is most profitable (weekends, holidays).
Finally, a lot of towns (CO in particular) are cracking down on AirBnB and VRBO rentals...residents don't like their town being hollowed out for tourism. So know that there's a certain amount of regulatory risk.