I accidentally proved superiorrain's bottle strategy. We have mice in the house. I happened to leave a full bottle of olive oil on the counter, next to the wall, one weekend. When I came back, the bottle had turned into Mouse Jonestown. Many mice drowned in the bottle. I thought that was spiffy but my wife didn't.
I started looking around the Web for other mouse control solutions and found a good info source:
http://www.ipmofalaska.com/files/housemouse.html
This was a good site because I was about to buy an "ultrasound" mouse deterrent, but the site said it's a waste of money.
A friend sprinkled essential oil of lavender around and that seems to repel them a little bit but not 100%. But if you have only one mouse, this might be a solution for you.