I've actually had this problem with a nasty build up in my community tanks...
I have very hard water with lots of nasty little minerals etc that build up. Over time you start to see a little limescale build up (for me on my waterfall filter where the water spills into the tank) and the water can get rather cloudy with high Ph readings.
I use part tap water with conditioners in it and the rest of my tank I fill with spring water. Usually 20% tap to 80% spring water. I've never had a nasty Ph reading or any build up on my filters since!

Hope this helps!