In short, water for coffee/tea comes from the tap, and planes routinely fail water safety tests (hence the no drinking sign in the lav).