diff <(ssh user@host cat remote-filename) local-filename

is a bit more intuitive too. You can put anything that writes to stdout in the <(), too. (Useful for decrypting or decompressing on the fly.)