Don't know if you can or want to install anything before doing the joke, but if you install
devcon, you can use devcon remove <device id> command.
EDIT: actually, I think the file just has to be on the jump drive. I was testing it and I didn't have much luck removing anything, but it might work for you.