I thought about getting into hot air ballooning several years ago but decided not to. The problem is you are essentially at the mercy of the wind and where you wind up landing is very random. From my hang gliding days I know that not everyone is especially crazy about you landing some strange looking thing in their pasture or corn field. You're chase team needs to be on the spot quickly also.
If I lived in the southwest - Arizona, New Mexico or West Texas, where you have hundreds of miles of unoccupied essentially desert area I think it's a good sport to get into but in this area I'm just not a fan.
Happy landing