I tend to ask anybody where their ancestry is from. I love all kinds of accents and I like unusual names and it often leads to a conversation about where parents and grandparents are from. Instead of being insulted, I would take it as flattery that somebody has been interested enough in your "look" to want to find out more.
In conversation, I often dare people to guess my ancestry since I look nothing like what I am.