Well, no one i know has really commented on the graphics that much. I guess it really depends on your age group. The younger crowd, 15 to 18. Seem to deem graphics as the most important.
95% of people i know, even those without a wii, have not really complained to me about the graphics. They just pick up the controllers and play.
Like i said i think its mainly the type of people you associate with, even people in your age group.
Alot of my friends are 360 fans. Yet they enjoy a good amount of wii, when they use my console. They dont seem fussed about the graphics.
I think you just need to chill out.