If you are looking at the back of the jumbo tron, it's on the left side. Continue walking on the left side until you see a line of state fans. It's also in the same side as the visitors locker room and entrance. Ole miss puts garbage dumpsters next to the gate. Or they did when I went.
They also had no security there in 2010. I could have taken 30 cowbells in.