Log In Sign Up

openprocessing.org
robots.txt

Robots Exclusion Standard data for openprocessing.org

Resource Scan

Scan Details

Site Domain openprocessing.org
Base Domain openprocessing.org
Scan Status Ok
Last Scan2024-06-21T17:34:27+00:00
Next Scan 2024-07-21T17:34:27+00:00

Last Scan

Scanned2024-06-21T17:34:27+00:00
URL https://openprocessing.org/robots.txt
Domain IPs 104.21.44.152, 172.67.200.231, 2606:4700:3030::ac43:c8e7, 2606:4700:3036::6815:2c98
Response IP 172.67.200.231
Found Yes
Hash 9a5a94d94ff72df5d0ceea6521bfaa47623f99d88e377f3cf46148bd34fc5600
SimHash e718e465d594

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

dataforseobot

Rule Path
Disallow /sketch/*
Back to top

Comments

  • //go away
  • User-agent: *
  • Disallow: /
  • //prod setup
Back to top