You shouldn't have any problems. Wifi is based on IEEE 802.11 (b or g depending on what hardware you have). Most routers have setup via web browser so you shouldn't worry too much about hooking up a mac and windows box to it.
Here's a link to an faq on wifi. Post any questions that you come across during setup.