Log In Sign Up

static.frameplay.gg
robots.txt

Robots Exclusion Standard data for static.frameplay.gg

Resource Scan

Scan Details

Site Domain static.frameplay.gg
Base Domain frameplay.gg
Scan Status Ok
Last Scan2024-11-01T08:45:55+00:00
Next Scan 2024-12-01T08:45:55+00:00

Last Scan

Scanned2024-11-01T08:45:55+00:00
URL https://static.frameplay.gg/robots.txt
Domain IPs 13.227.254.110, 13.227.254.21, 13.227.254.41, 13.227.254.56
Response IP 13.227.254.41
Found Yes
Hash 71eca9a5a0353652f49069dfd431ded8de07c099ccbf998d48456b01e30ddd74
SimHash 2a5cd80429db

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Comments

  • Disallow all robots from all content
  • Explicitly disallow common bots
  • Block archive.org
  • Block ChatGPT/OpenAI
  • Block Google-Extended
  • Sitemap is not needed since we're blocking all access
  • But if you have one, you can still reference it here:
  • Sitemap: https://example.com/sitemap.xml
Back to top