afgcric.com
robots.txt
Robots Exclusion Standard data for afgcric.com
Resource Scan
Scan Details
Site Domain | afgcric.com |
Base Domain | afgcric.com |
Scan Status | Ok |
Last Scan | 4/27/2025, 9:16:50 PM |
Next Scan | 5/27/2025, 9:16:50 PM |
Last Scan
Scanned | 4/27/2025, 9:16:50 PM |
URL | https://afgcric.com/robots.txt |
Domain IPs | 104.21.41.45, 172.67.159.245, 2606:4700:3032::6815:292d, 2606:4700:3034::ac43:9ff5 |
Response IP | 104.21.41.45 |
Found | Yes |
Hash | 2e99ae8999825ae7eed815afa60225ce6c982e4f0ecc7b89c190904258c9d10e |
SimHash | 7414e9628639 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /? |
Disallow | /wp/ |
Disallow | /search/ |
Disallow | /author/ |
Disallow | /users/ |
Disallow | */trackback |
Disallow | /xmlrpc.php |
Disallow | utm%3D |
Disallow | /pinup-tr/ |
Allow | */uploads |