If you don't mind a little help, there is a great map floating around that lists all the hidden orbs.
This appears to be the same one, although I found it at xbox360achievements.org.
Courtesy of a bloke named Mandalore.
I haven't used it myself, but it's getting to that point. 482 agility orbs found and 163 hidden orbs, if I recall correctly.