Some may also not choose to take the ICS update because they're happy with how their tablet works now and aren't interested in the new features of ICS. "Upgrading" any system that already works increases the chances of things not working anymore. It's like the old saying "If it's not broke, don't fix it".
I think most people will want ICS but for those that don't, I feel it's a perfectly reasonable option.