Tough week to move up in the polls