colbynewton.org
robots.txt

Robots Exclusion Standard data for colbynewton.org

Resource Scan

Scan Details

Site Domain colbynewton.org
Base Domain colbynewton.org
Scan Status Ok
Last Scan2025-05-13T07:14:57+00:00
Next Scan 2025-06-12T07:14:57+00:00

Last Scan

Scanned2025-05-13T07:14:57+00:00
URL https://colbynewton.org/robots.txt
Redirect https://www.colbynewton.org/robots.txt
Redirect Domain www.colbynewton.org
Redirect Base colbynewton.org
Domain IPs 199.34.228.49
Redirect IPs 199.34.228.49
Response IP 199.34.228.49
Found Yes
Hash 9cb15bfc5323fc2fdd876e72533e928ecc565f8d2308ec636f9f2fd605fcd268
SimHash aa44d8aeef93

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.colbynewton.org/sitemap.xml