I'd just take it off my desktop and leave it pretty much hidden. You can always fire it back up by opening any file/windows explorer window (My Computer, any directory, Control Panel etc) and typing in a web address in the location bar.
Right Click desktop > Desktop > Customize Desktop
Uncheck Internet Explorer
|