anandabazar.in
robots.txt

Robots Exclusion Standard data for anandabazar.in

Resource Scan

Scan Details

Site Domain anandabazar.in
Base Domain anandabazar.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-14T02:02:57+00:00
Next Scan 2024-10-12T02:02:57+00:00

Last Successful Scan

Scanned2022-08-23T22:15:36+00:00
URL https://anandabazar.in/robots.txt
Response IP 209.99.40.222
Found Yes
Hash a8b8c6e2e69586a9c4c800bd145c5e016345f7f9355d06e4f5853e24e6421791
SimHash 8c506f486bd2

Groups

*

Rule Path
Disallow /content/*

Comments

  • robots.txt for all our sites