Society thinks you're weird, and not in a good way. I get this even at the age of 24 for never having a girlfriend (I have only ever had one lasting a significant amount of time though I have dated around quite a bit). I honestly have no idea what most people think, but I'm sure some of my relatives have wondered if I'm gay, and I have been given sympathy by others and bewilderment that I'm single given I'm a pretty good looking dude with a lot going for him. Unfortunately I'm just very independent and don't enjoy people as much as I enjoy time to myself (and the FREEDOM of being single). Even now I have a girlfriend I've been seeing about a month, and even though she's a good girl, attractive, gives me plenty of sex, etc, I find myself frequently wondering if I should break up with her so I can go flirt with other girls, can go to bed when I want (she keeps me up late), can have my weekends back, etc. I don't know... It actually bothers me that I'm not "normal" in this area as I do feel the judging eyes of my friends and family and society, and I like the idea of family and kids. I'm not sure I will ever have any though.
In the end we're all just trying to live our lives the best we know how (or should be), and each person's life is their own to live how they choose. No harm done if someone doesn't want kids. In fact, they are probably doing a service to the world as we are already horribly overpopulated. Try not to worry what other people think.