Erm, web site admins should probably learn to configure robots.txt so that agents used by search engines know what to pick up, and what not to.
Exactly right. It's not google's responsibility to babysit slack web site administrators. If you're a web admin and you've never heard of robots.txt, now you have so there's no excuse.