shwetamahajan.com
robots.txt

Robots Exclusion Standard data for shwetamahajan.com

Resource Scan

Scan Details

Site Domain shwetamahajan.com
Base Domain shwetamahajan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/5/2025, 1:39:35 PM
Next Scan 6/19/2025, 1:39:35 PM

Last Successful Scan

Scanned4/28/2025, 12:35:51 PM
URL https://shwetamahajan.com/robots.txt
Redirect https://www.honeytyagi.com/robots.txt/
Redirect Domain www.honeytyagi.com
Redirect Base honeytyagi.com
Domain IPs 2a02:4780:84:8bc5:34b7:f398:1c9d:ea9f, 84.32.84.77
Redirect IPs 35.213.152.220
Response IP 35.213.152.220
Found Yes
Hash dc2f08337f914b83104b1cc09a2e273eec7d4003cc6fd7046411db9500c6056f
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10