The only reason they say go down to NY and Boston is all of montreals street sign are in french, so if you can't read french you will get lost!...but it will be a nicer drive.
(just stay on the highway

)
P.S. if your going to stay in Kingston on the way back I can give you some good places to stay...