Best I can figure. Granted, Ole Miss is 4th in the country, and typically such a highly ranked team would get the ratings based on that. However, it's still not Bama, Florida, Georgia, or LSU. The name on the jersey matters to random football fan in California. In fact, Spurrier might carry more weight than Ole Miss's #4 ranking.
Or more succintly; People who make good bets don't listen to ESPN talk shows.