pasricha.com
robots.txt

Robots Exclusion Standard data for pasricha.com

Resource Scan

Scan Details

Site Domain pasricha.com
Base Domain pasricha.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-31T03:51:08+00:00
Next Scan 2025-11-29T03:51:08+00:00

Last Successful Scan

Scanned2025-05-03T23:35:52+00:00
URL https://pasricha.com/robots.txt
Redirect https://www.pasricha.com/robots.txt
Redirect Domain www.pasricha.com
Redirect Base pasricha.com
Domain IPs 52.74.116.56
Redirect IPs 13.212.57.143
Response IP 13.212.57.143
Found Yes
Hash ecc3a69e566251c53a271859f8781b8f1d4ea827a83d090dba2df263ccd2c921
SimHash 6f891cd1ef12

Groups

*

Rule Path
Disallow /CFIDE/
Disallow /wwscripts/
Disallow /beacon.cfm

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.pasricha.com/sitemap.xml