very very carefully
I think it has to do with the way the tongue is situated, more than anything having to do with your fingers. I do the same thing without my fingers, and the placement of my tongue is similar to what it would be if I had my fingers in there. Try both ways and see what works.