aqmd.gov
robots.txt
Robots Exclusion Standard data for aqmd.gov
Resource Scan
Scan Details
Site Domain | aqmd.gov |
Base Domain | aqmd.gov |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-04T15:26:52+00:00 |
Next Scan | 2024-12-03T15:26:52+00:00 |
Last Successful Scan
Scanned | 2024-04-15T15:24:53+00:00 |
URL | https://aqmd.gov/robots.txt |
Redirect | https://www.aqmd.gov/robots.txt |
Redirect Domain | www.aqmd.gov |
Redirect Base | aqmd.gov |
Domain IPs | 162.80.26.25 |
Redirect IPs | 162.80.26.25 |
Response IP | 162.80.26.25 |
Found | Yes |
Hash | e2086140062f74db20643f560ce3da6dc56df6f3979a33672c50ce412be7dcd9 |
SimHash | 0308f96cc6d4 |
Groups
*
Rule | Path |
---|---|
Disallow | /App_Data/ |
Disallow | /aspnet_client/ |
Disallow | /bin/ |
Disallow | /ClientBin/ |
Disallow | /Custom/ |
Disallow | /Mobile |
Disallow | /MVC/ |
Disallow | /obj/ |
Disallow | /Properties/ |
Disallow | /Services/ |
Disallow | /Sitefinity/ |
Disallow | /Template/ |
Disallow | /*.config |
Disallow | /*.cs |
Disallow | /*.css |
Disallow | /*.js |
Disallow | /INSTALL.txt |
Disallow | /LICENSE.txt |
Disallow | /UPGRADE.txt |
Disallow | /Module*.zip |
Warnings
- 1 invalid line.
Comments