Log In Sign Up

oaklandside.org
robots.txt

Robots Exclusion Standard data for oaklandside.org

Resource Scan

Scan Details

Site Domain oaklandside.org
Base Domain oaklandside.org
Scan Status Ok
Last Scan2025-05-20T13:37:30+00:00
Next Scan 2025-06-19T13:37:30+00:00

Last Scan

Scanned2025-05-20T13:37:30+00:00
URL https://oaklandside.org/robots.txt
Domain IPs 192.0.78.160, 192.0.78.197
Response IP 192.0.78.160
Found Yes
Hash 9df66494b1c0492ffc00c6b6b6fb9b4946ab2d305e5ae3c1ff6f57b1aa0e3c54
SimHash 5db69864ac72

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • OpenAI crawler
  • ChatGPT service
  • Common Crawl crawler
  • Bard/Gemini service
  • Perplexity crawler
Back to top