I can already impersonate my users.

But yes, client side hashing is just one part of a security story, but it sure does make log leaks less damaging.