I had the same problem. I solved it with hamatchi.
http://www.hamachi.cc/
I've never had any gameplay issues though, granted I only patch when I confirm that the people I play against have already patched.
AoE3 is not a buggy piece of crap in my experience, nor in that of at least 3 other friends of mine.