stage.www.astroawani.com
robots.txt

Robots Exclusion Standard data for stage.www.astroawani.com

Resource Scan

Scan Details

Site Domain stage.www.astroawani.com
Base Domain astroawani.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-04T12:14:22+00:00
Next Scan 2025-04-04T12:14:22+00:00

Last Successful Scan

Scanned2024-05-17T11:40:23+00:00
URL https://stage.www.astroawani.com/robots.txt
Domain IPs 52.74.180.121, 52.74.243.244
Response IP 52.74.180.121
Found Yes
Hash cc0ba665d4baf2284369421b5a8b34aedebe00299316517f28843575a44b2a5f
SimHash 800093206773

Groups

*

Rule Path
Allow /
Disallow /news/detail/preview/

grapeshot

Rule Path
Allow /
Disallow