OOO Martel and I love doing this! So no it's not a wierd thing at all!
Anyway, first of all lemme address the embarassment factor. If you ever wach porn where women masturbate, they're always legs spread, rubbing their fingers over their clit. Well, for me, I don't masturbate that way at all! So for a long time, I was embarassed to do it in front of Martel because it was hard to relax, because I felt like I had a wierd technique. Keep in mind your wife might feel the same way.
I'd suggest starting with some mutual masturbating of each other- finger her, have her give you a hand job, just to get used to the idea of coming together without using a "tab A in slot B" approach. Then, perhaps when she's riled up, you could tell her how much you love it when she comes, how wonderful her body looks, how beautiful it is, how much it turns you on to know that she's feeling that good, how much you love her- all the great stuff that happens to you when she's coming. Then, tell her that you want to make sure you're doing it right- ask if she'd take your fingers and guide them over herself like her own fingers- IE have her show you with your fingers how she masturbates. Perhaps another thing you could do would be to masturbate yourself while sucking on one of her nipples and fingering her- this way she's becoming comfortable with the idea of you masturbating.
Do you know she does masturbate? Some women don't- she might not know how! In that case, do the afforementioned stuff, and get her comfortable with her touching herself. Does she ever rub her clit when you're inside of her? If not, perhaps you could do that, then ask her again to put her fingers on yours and show her where it feels good. Another thing to do, when her fingers are on yours, is after you've got the technique down, perhaps tell her you want to get her off with her fingers, and put your hand over hers, using her fingers to get her off, but moving them with your hand.
Anyway, always reassure her that it's so beautiful to see her masturbate. AND don't foget to communicate very very well about this, in a loving way! If you sex life is as hot as you say it is, I'm sure she'd be up for trying something new! Good luck!