
@hankgreen The interesting thing about robots.txt is that it isn’t legally binding in any way, shape, or form. It is merely a suggestion and bots can choose to ignore it entirely. Additionally, you can easily spoof what the bot reports it is when it’s indexing a site.
English


























