I think that once the author has passed, there's no harm to the publishing.

In fact, I'd argue that it shows us true human nature, unfiltered and unedited. If we'd only allowed what was meant to be public, we'd be losing perspective as works meant to be public are carefully crafted for that purpose.