Well, they may mean they don't like the taste of what comes out of the faucet, which will rarely be pure water.
I get you (grew up on well water, so I know from funky water), but I hear people complaining about the taste of bottled water too. My dad does it and it drives me nuts.