Rubbing the same spot will create grooves and could potentially mark the front of the paper, obstructing the pattern and making your walls look a whole lot worse.