I agree with your statement and don't blame you one bit. I'm happy to give a nice tip when the waiter/waitress never had us wanting anything. They would always bring something because they noticed we were down on a drink or whatever or ask what we might need.
Unfortunately, some servers expect they're entitled to a fat tip just for going through the motions.