air-e.com
robots.txt
Robots Exclusion Standard data for air-e.com
Resource Scan
Scan Details
| Site Domain | air-e.com |
| Base Domain | air-e.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-18T08:16:29+00:00 |
| Next Scan | 2024-07-02T08:16:29+00:00 |
Last Successful Scan
| Scanned | 2024-05-11T07:18:22+00:00 |
| URL | https://air-e.com/robots.txt |
| Domain IPs | 104.26.0.37, 104.26.1.37, 172.67.72.56, 2606:4700:20::681a:125, 2606:4700:20::681a:25, 2606:4700:20::ac43:4838 |
| Response IP | 172.67.72.56 |
| Found | Yes |
| Hash | 2826059db5135d16b87e8c8d77022d6780d17075d65649b0dc52bf6d0aa1846f |
| SimHash | 390d1943a5c6 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Googlebot permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
Comments