Over is the only way to do it! I get soo OCD about it.
Except my husband is too lazy to ever even put it back on, so I am obviously the only one in our household that cares so much. He just leaves the old roll on and sits the new roll on the TP holder. I'm like WTFFFF.