I have seen only children with Only Child Syndrome and I have seen only children without it. It's your prerogative, given you recognize the pitfalls as well as the benefits of only having one child. Socialization with other children is a must, as is avoidance of spoiling (I had one friend whose parents would give into her anytime she had a tantrum as a child...as an adult, she's still spoiled though what's worse is she doesn't realize it).
Being an only child doesn't have to be a disadvantage.
And I agree with clavus--tell people to mind their own damn business.