arnavgarg.me
robots.txt

Robots Exclusion Standard data for arnavgarg.me

Resource Scan

Scan Details

Site Domain arnavgarg.me
Base Domain arnavgarg.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-25T04:33:32+00:00
Next Scan 2025-12-24T04:33:32+00:00

Last Successful Scan

Scanned2022-11-14T07:35:58+00:00
URL http://www.arnavgarg.me/robots.txt
Response IP 209.99.64.53
Found Yes
Hash a8b8c6e2e69586a9c4c800bd145c5e016345f7f9355d06e4f5853e24e6421791
SimHash 8c506f486bd2

Groups

*

Rule Path
Disallow /content/*

Comments

  • robots.txt for all our sites