GuerillaHQ/now-playing
GuerillaHQ/now-playing
1
0
Fork 0
mirror of https://github.com/GuerillaHQ/now-playing synced 2024-07-03 17:17:58 +00:00
Code Issues Wiki Activity
now-playing/static/robots.txt

21 lines
246 B
Plaintext
Raw Normal View History

add robots.txt
2019-12-03 22:58:28 +00:00
User-Agent: *
Disallow: /admin/
robots.txt: Fuck AI scrapper bots
2023-10-02 00:44:35 +00:00
User-agent: GPTBot
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: FacebookBot
Disallow: /
Reference in a new issue Copy permalink