I stayed locked up in my house for a period of time too, in order to 'protect myself' from the shitty feelings of anxiety and such. Not good. It just creates another hurdle for you. Kudos for forcing yourself to get out though. I could barely do that.
Not sure how many doctors you've seen, but maybe you can keep trying until you find one that works for you? Let them know you're tired of medicine supposedly being your cure. He / she will probably refer you to a therapist. Nothing wrong with that. Imo, medicine shouldn't be prescribed without therapy.
Good luck to you.