Looking at the historical data, we can tell that voters do not seem to punish a party for running a gridlocked Congress in the next presidential election.
The idea of such a small number of people being used to predict how millions will vote sometimes irks observers, but it's actually a very reliable process—most of the time.