The majority of the folks going to the game (and more importantly participating in the two-week hype ramp up) will be staying in Manhattan. Depending on time of day, you're going to be looking at an hour cab ride at least each way. Nobody rents a car in NYC. I'm sure some will have a hired driving service do the work, but it's going to be crazy shuttling folks back and forth. Subway doesn't go out that far (if I remember correctly). You'd have to change trains and get on the NJ Transit train at some point.
Not to mention the craptacular weather.
Oh well. Give it a shot and see what happens.