As many have noted, this recommendation will usually yield good results when the org responds cooperatively and bad results when the org responds defensively. It is an org’s responsibility to demonstrate that they will respond cooperatively, not a critic’s responsibility to assume. Defensive responses aren’t, like, rare.
To be more concrete, I personally would write to Givewell before posting a critique of their work because they have responded to past critiques with deep technical engagement, blog posts celebrating the critics, large cash prizes, etc. I would not write to CEA before posting a critique of their work because they have responded to exactly this situation by breaking a confidentiality request in order to better prepare an adversarial public response to the critic's upcoming post. People who aren’t familiar with deep EA lore won’t know all this stuff and shouldn’t be expected to take a leap of faith.
This does mean that posts with half-cocked accusations will get more attention than they deserve. This is certainly a problem! My own preferred solution to this would be to stop trusting unverifiable accusations from burner accounts. Any solution will face tradeoffs.
(For someone in OP’s situation, where he has extensive and long-time knowledge of many key EA figures, and further is protected from most retaliation because he’s married to Julia Wise, who is a very influential community leader, I do indeed think that running critical posts by EA orgs will often be the right decision.)
The discrepancy between this post's net karma here (171) and on LessWrong (19) is striking.
The EA Forum has recently had some very painful experiences where members of the community jumped to conclusions and tried to oust people on very flimsy evidence, and now we're seeing people upvote who are sick of the dynamic.
LessWrong commenters did a better job of navigating accusations, waiting for evidence, and downvoting low-quality combativeness. People running off half-cocked hasn't had as disastrous effects, so there aren't as many people there who are currently sick of it.
So is the number of comments here (5 at time of this comment) vs. there (69).