I think it just depends on how you were raised. I say ma'am and sir when addressing people who I think need to be addressed that way. My work is client-service based, so it kinda comes with the territory as well.
Beware, however, of calling a younger woman ma'am. I've had quite a few thought I was implying they were "mature".
