I don't know how it could have been any sooner. Patrick received the ball took a step back and threw it. There isn't much room for sooner. Granted, it probably could have been further towards the corner, but again... the problem here is that Baker was in extremely poor position to begin with. Baker is physically pushed towards the sideline the entire play. He allows this to happen rather than establishing position. Because he is pushed towards the sideline the ball looks to be underthrown. If Baker maintains 3-5 yards from the sideline then he is the only one that can catch that ball. Instead, he lets himself get pushed right against the sideline, and what would have been a well thrown ball becomes one that a defender can make a play on. Even then, the defender had to make an outstanding play to knock the ball away, and even better for the safety to get the INT.
I'm not saying Towles is without fault. I think if you look at the previous play then you definitely see an example where he threw it too late. However, on this play, I think Towles' throw was fine. I don't like Baker there, I don't like the idea to throw it to the short side, and I don't like Baker's effort on the route, but I don't have a huge problem with the throw of Towles.