akashrajpurohit.com
robots.txt

Robots Exclusion Standard data for akashrajpurohit.com

Resource Scan

Scan Details

Site Domain akashrajpurohit.com
Base Domain akashrajpurohit.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-17T19:40:57+00:00
Next Scan 2025-11-16T19:40:57+00:00

Last Successful Scan

Scanned2025-06-26T09:20:51+00:00
URL https://akashrajpurohit.com/robots.txt
Domain IPs 104.21.86.241, 172.67.137.241, 2606:4700:3030::6815:56f1, 2606:4700:3031::ac43:89f1
Response IP 104.21.86.241
Found Yes
Hash b9984ca8a60f244f7790b42ffcc51dfe92da8edbe12a4477a6e7aae73cdd2932
SimHash 41059c524571

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://akashrajpurohit.com/sitemap-index.xml

Warnings

  • `host` is not a known field.