To my mind, the deal has to be equitable, and you both have to happy with whatever you agree to.
The only time I was in this sort of deal, she and I would call or text each other but would both feel happy to say "not today, thanks".
Your friends sound confused. If it's OK for you to call him, but not for him to call you, then you are effectively saying that YOUR sex is currency, but HIS sex is a paid service. He's not allowed to offer it to you? Why the fuck not?
If you are adults, if you are happy when you are fucking, if neither coerces the other into anything they later regret, and if both have the right to say no at any time then go for it.
However, if you feel forced, obligated, regretful, or unhappy with any of it, then there's a problem.
Reading your posts, I would suggest that the only aspect of the arrangement that has caused you negative emotions is the reaction of your friends, not the sex or the calls from your fuck-buddy. Maybe you should keep the boy and ditch the friends for a while?