There now is a tooltip that explains that an automated comment is posted on the question when someone votes to close a question with a custom off-topic reason.
The other instance when an automated comment is placed on a question is when someone votes to close a question as a duplicate. Can a similar tooltip be placed there?
There are regularly questions about this behaviour, which I can't find right now ofcourse :).
