afghanonline.com
robots.txt

Robots Exclusion Standard data for afghanonline.com

Resource Scan

Scan Details

Site Domain afghanonline.com
Base Domain afghanonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/6/2025, 5:15:31 PM
Next Scan 6/4/2025, 5:15:31 PM

Last Successful Scan

Scanned8/9/2024, 5:04:32 PM
URL https://afghanonline.com/robots.txt
Domain IPs 104.21.62.29, 172.67.219.29
Response IP 172.67.219.29
Found Yes
Hash 0be51a39b925ed8c0551ad230415e56492e9f77e2bb3878db4714c863be92582
SimHash ec5158446391

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /forum/
Disallow /junk/