GuerillaStudio/now-playing
GuerillaStudio/now-playing
1
0
Fork 0
mirror of https://github.com/GuerillaStudio/now-playing synced 2024-11-09 22:11:53 +00:00
Code Issues Activity Actions

robots.txt: Fuck AI scrapper bots

Browse source
This commit is contained in:
Tixie Salander 2023-10-02 02:44:35 +02:00
parent dea96cea28
commit 19b6d0c805
1 changed files with 18 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

18
static/robots.txt
View file

@ -1,2 +1,20 @@
User-Agent: * User-Agent: *
Disallow: /admin/ Disallow: /admin/
User-agent: GPTBot
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: FacebookBot
Disallow: /