My husband isn't bothered by it. In fact, with the amount of toys he's bought me, I'm sure he loves the idea!
I used to have a problem when I knew he was masturbating. I was jealous. I couldn't understand how he could do it so frequently and at the same time not want to have sex with me. (I had a higher sex drive than him at the time, so I was ALL about the sex.) Once I finally realized that the majority of times it didn't have anything to do with sex, or me, I was ok with it.
I'll still tease him about it sometimes, but he does the same to me, so it's all ok.