I grew up without a television, and it really wasn't that bad. The problem I ran into was a little different- when I was around a television, I couldn't stop paying attention. I've gotten better about that sort of thing as I've gotten older, but the truth is, I still can't tune out noise, or televisions, anywhere near as well as my peers who grew up with televisions.

I don't know if that's a common experience though.