If the weather's good and I've got a chance, yes I'll watch. Not if it's cold and wet. The trouble usually is finding somewhere to park. In an ideal world there would be a proper event stage where there was a long straight and spectacular bend, and a sloping field from where a large crowd could watch.. entertainments laid on, stalls, funfair, beer tent, plenty of parking etc etc.
The other problem (for my short attention span) are the long gaps where nothing happens. I get bored easily!
I think it's great fun for so many people, it's a shame that people get grumpy about something that can only inconvenience them for a short while.. which can be planned around.