aqmd.gov
robots.txt

Robots Exclusion Standard data for aqmd.gov

Resource Scan

Scan Details

Site Domain aqmd.gov
Base Domain aqmd.gov
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-04T15:26:52+00:00
Next Scan 2024-12-03T15:26:52+00:00

Last Successful Scan

Scanned2024-04-15T15:24:53+00:00
URL https://aqmd.gov/robots.txt
Redirect https://www.aqmd.gov/robots.txt
Redirect Domain www.aqmd.gov
Redirect Base aqmd.gov
Domain IPs 162.80.26.25
Redirect IPs 162.80.26.25
Response IP 162.80.26.25
Found Yes
Hash e2086140062f74db20643f560ce3da6dc56df6f3979a33672c50ce412be7dcd9
SimHash 0308f96cc6d4

Groups

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

*

Rule Path
Disallow /App_Data/
Disallow /aspnet_client/
Disallow /bin/
Disallow /ClientBin/
Disallow /Custom/
Disallow /Mobile
Disallow /MVC/
Disallow /obj/
Disallow /Properties/
Disallow /Services/
Disallow /Sitefinity/
Disallow /Template/
Disallow /*.config
Disallow /*.cs
Disallow /*.css
Disallow /*.js
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /UPGRADE.txt
Disallow /Module*.zip

Comments

  • Directories
  • Paths (clean URLs)
  • Files

Warnings

  • 1 invalid line.