afccnet.org
robots.txt
Robots Exclusion Standard data for afccnet.org
Resource Scan
Scan Details
Site Domain | afccnet.org |
Base Domain | afccnet.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-02-06T21:04:07+00:00 |
Next Scan | 2025-05-07T21:04:07+00:00 |
Last Successful Scan
Scanned | 2024-09-17T21:02:10+00:00 |
URL | https://afccnet.org/robots.txt |
Redirect | https://www.afccnet.org/robots.txt |
Redirect Domain | www.afccnet.org |
Redirect Base | afccnet.org |
Domain IPs | 104.21.22.67, 172.67.203.80, 2606:4700:3030::6815:1643, 2606:4700:3034::ac43:cb50 |
Redirect IPs | 104.21.22.67, 172.67.203.80, 2606:4700:3030::6815:1643, 2606:4700:3034::ac43:cb50 |
Response IP | 104.21.22.67 |
Found | Yes |
Hash | 2826059db5135d16b87e8c8d77022d6780d17075d65649b0dc52bf6d0aa1846f |
SimHash | 390d1943a5c6 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /*/ctl/ | Googlebot permits * |
Disallow | /admin/ | - |
Disallow | /App_Browsers/ | - |
Disallow | /App_Code/ | - |
Disallow | /App_Data/ | - |
Disallow | /App_GlobalResources/ | - |
Disallow | /bin/ | - |
Disallow | /Components/ | - |
Disallow | /Config/ | - |
Disallow | /contest/ | - |
Disallow | /controls/ | - |
Disallow | /Documentation/ | - |
Disallow | /HttpModules/ | - |
Disallow | /Install/ | - |
Disallow | /Providers/ | - |
Disallow | /Activity-Feed/userId/ | Do not index user profiles |
Comments