Just gonna give my personal opinion here but petite women are all I can be psychologically attracted to, I love working out, losing body fat gaining muscle, its what I do. Mentally, people who have more then a small amount of body fat bother me, am I shallow? Maybe, but mentally I can't stand the idea of someone I like alot becoming fat, I work my ass off on my body composition and to some extent I expect the same from my other. If a girl is extremely petite, it may mean she just doesn't eat much or it may mean she works out I don't know, but mentally it's just a gamble I'm really not willing to take.
(Btw, I used to be fat also, and it sucks because when your fat, even if you don't realize it you won't get the most out of your life, you avoid situations you normally would get yourself into and stuff like that, or thats how I see it after having lost weight, I'm a totally different person
)