I think un-australian is term used by politicians to slag off their opponents more than anything

If you're a citizen here, you're Australian. Everything else is irrelevant.
That said, not supporting our sports teams could be taken as unpatriotic :P Loving the country and loving the sport are two different things, however.