HAHA!! Man, thats sooo funny because I have a pair of pants that do the same thing. Usually if I just yank the zipper up high enough it will sorta jam in the upright positon.
If that won't work, just wear an extra long shirt... that way when the zipper goes, at least no one will notice.