newtoki18.org
robots.txt

Robots Exclusion Standard data for newtoki18.org

Resource Scan

Scan Details

Site Domain newtoki18.org
Base Domain newtoki18.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-19T06:07:19+00:00
Next Scan 2025-09-17T06:07:19+00:00

Last Successful Scan

Scanned2024-08-01T05:30:43+00:00
URL https://newtoki18.org/robots.txt
Domain IPs 104.21.12.200, 172.67.153.57, 2606:4700:3034::6815:cc8, 2606:4700:3036::ac43:9939
Response IP 104.21.12.200
Found Yes
Hash 857ff42d7f60f3f4c96a4c26d99abd841ca892743dec525b809d73b79d6cde88
SimHash 4e5cd880a3e0

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /