I think that most decision makers in sports (athletic directors, GM's/Presidents/Owners) are probably okay with that. The money is in TV viewership, and, truthfully, smaller attendance probably eases much of the congestion associated with games.
They, the NFL at least, would probably rather have the average fan watch from home, and have the millionaire executives at the game. It's no secret the NFL has grown more and more 'corporate' over the last 10-20 years. Now the average ticket cost is $500, and 25% (just making that up) of all attendees sit behind glass in boxes/club areas.