GuerillaStudio/now-playing
GuerillaStudio/now-playing
1
0
Fork 0
mirror of https://github.com/GuerillaStudio/now-playing synced 2024-12-21 08:41:55 +00:00
Code Activity Actions
now-playing/static/robots.txt

21 lines
246 B
Text
Raw Normal View History

add robots.txt
2019-12-03 22:58:28 +00:00
User-Agent: *
Disallow: /admin/
robots.txt: Fuck AI scrapper bots
2023-10-02 00:44:35 +00:00
User-agent: GPTBot
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: FacebookBot
Disallow: /
Copy permalink