What I would do is take a heat gun to it first, and pull off the larger pieces. A hair dryer may work in lieu of a heat gun, but it will take a lot longer. Then get some
Goof Off and apply it with a paper towel to clean up the remaining residue. Goof Off works very well on adhesives, but you'll want to leave the door open and turn on the exhaust fan... it's got a pretty strong smell to it.