I can't see us falling too far. UGA is still hanging around after getting manhandled by a lesser team than Bama and squeaking by UK. I know there is a difference in perception between State and UGA, but still. I don't think anyone expects any team not named Florida to give Bama a decent game.
I think you're overestimating the voters.
From looking at the results, you have to assume close to a majority of the voters don't really pay attention beyond the sportscenter recaps, if they even do that. To the extent State is getting any coverage at all, it's generally to say that we haven't beaten anybody, regardless of the fact that our schedule basically looks like UGA's. A lot of the voters likely pay just enough attention to have heard that we haven't played anybody, and if we lose by 3 td's, they'll likely drop us into the high teens if not 20's. If they were paying attention, MSU keeping it within two touchdowns should cause UGA to drop below us, but obviously that's not going to happen.