Why surprise at the Olympics?

I've heard a few people--sports fans, mostly--say they are surprised at how much they are watching the Olympics. Really? Doesn't a very large part of the universe get sucked into watching the two week event every time? It's one of the things that is guranteed to generate water cooler talk for the entire two weeks. Great stuff. Why would anyone expect they wouldn't end up watching?