1
0
Fork 0
mirror of https://github.com/GuerillaStudio/now-playing synced 2024-11-19 19:42:47 +00:00
now-playing/static/robots.txt

29 lines
333 B
Text
Raw Normal View History

2019-12-03 22:58:28 +00:00
User-Agent: *
Disallow: /admin/
2023-10-02 00:44:35 +00:00
2024-02-17 22:44:22 +00:00
# AI Data Scraper
User-agent: anthropic-ai
Disallow: /
User-agent: Bytespider
2023-10-02 00:44:35 +00:00
Disallow: /
User-agent: CCBot
Disallow: /
2024-02-17 22:44:22 +00:00
User-agent: FacebookBot
2023-10-02 00:44:35 +00:00
Disallow: /
User-agent: Google-Extended
Disallow: /
2024-02-17 22:44:22 +00:00
User-agent: GPTBot
2023-10-02 00:44:35 +00:00
Disallow: /
2024-02-17 22:44:22 +00:00
User-agent: omgili
Disallow: /
User-agent: Omgilibot
2023-10-02 00:44:35 +00:00
Disallow: /