I know of only two elderly drivers who actually stopped driving and got rid of their cars because they knew they couldn't drive any more. One was my grandfather at about 70. The second was our neighbor who was driving while she was going blind(macular degeneration)-she finally figured she'd be better off without her car when she backed into someone...we bought her car from her.
I have actually seen older people too weak and feeble to walk get behind the wheel and drive off; if it takes you more than two minutes to swing your legs into the driver's seat and you need to take a deep breath to pull the door shut, it's time to hand over the keys!