If I've got nothing on me after masturbation I might not. Usually have a trip to the bathroom to dispose of the toilet roll, so I guess I usually do have a quick splash under the tap.
If I have jizz-hands I'd definitely wash my hands before preparing food or meeting friends etc.. I wouldn't want to eat/touch theirs.. it's common courtesy really
With sex.. don't think I have thought about it.
After a pretty "moist" session with my gf, later on I did notice my hands still smelt of her, which was nice, but I washed them anyway since it was making me lose my concentration