1000testov.com
robots.txt

Robots Exclusion Standard data for 1000testov.com

Resource Scan

Scan Details

Site Domain 1000testov.com
Base Domain 1000testov.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T14:47:44+00:00
Next Scan 2024-11-27T14:47:44+00:00

Last Successful Scan

Scanned2024-10-06T14:47:15+00:00
URL https://1000testov.com/robots.txt
Domain IPs 104.21.40.182, 172.67.137.87, 2606:4700:3030::6815:28b6, 2606:4700:3031::ac43:8957
Response IP 104.21.40.182
Found Yes
Hash 485ab4b79d45e52dd6ea4de80a593dd4c4a46ba08b55cefb4d6300bd80203b8d
SimHash 63009c43c7b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://1000testov.com/sitemap.xml

Warnings

  • `host` is not a known field.