Found pennies always feel dirty to me, so I stopped picking them up awhile ago. I don't generally like to pocket things I find on the ground, though I make exceptions at the beach.
Now, if it's a nickel or higher, who cares if it's dirty... that's worth something!
