hiindia.com
robots.txt

Robots Exclusion Standard data for hiindia.com

Resource Scan

Scan Details

Site Domain hiindia.com
Base Domain hiindia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-08T07:25:34+00:00
Next Scan 2024-11-22T07:25:34+00:00

Last Successful Scan

Scanned2024-10-24T07:24:43+00:00
URL https://hiindia.com/robots.txt
Domain IPs 172.66.40.97, 172.66.43.159, 2606:4700:3108::ac42:2861, 2606:4700:3108::ac42:2b9f
Response IP 172.66.43.159
Found Yes
Hash 7cd0bca6b3f06663d894234a8bc6bb6f017e430afebdc318986997bf00f0f6c5
SimHash 6558dcc0c1b5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60