dpw.lacounty.gov
robots.txt

Robots Exclusion Standard data for dpw.lacounty.gov

Resource Scan

Scan Details

Site Domain dpw.lacounty.gov
Base Domain lacounty.gov
Scan Status Ok
Last Scan2025-03-11T02:34:22+00:00
Next Scan 2025-04-10T02:34:22+00:00

Last Scan

Scanned2025-03-11T02:34:22+00:00
URL https://dpw.lacounty.gov/robots.txt
Domain IPs 45.60.151.78, 45.60.171.78
Response IP 45.60.151.78
Found Yes
Hash ac458b5827f5aeed33dc44b68ce7511d726d35a72815fa34bdcaea8f0acf97aa
SimHash 44dc0895a45a

Groups

*

Rule Path
Disallow /drp
Disallow /itd
Disallow /general/piwe
Disallow /mpm/gisab/calendar
Disallow /pdd/csrts
Disallow /general/search
Disallow /tnl/ramona
Disallow /wmd/npdes/ar
Disallow /apps/contact
Disallow /asd/contracts
Disallow /adm/tools/farm/fc
Disallow /go/dial
Disallow /general/StrategicPlan
Disallow /epd/ust/ustn
Disallow /Lacfcd/sediment/taskforce.aspx
Disallow /Lacfcd/sediment/advisory.aspx
Disallow /Lacfcd/sediment/workshop.aspx
Disallow /general/drivingdirections
Disallow /mobile/theworks/showimage.aspx
Disallow */Telerik.Web.UI.WebResource.axd
Disallow /searchResults.cfm
Disallow /general/faq/searchResults.cfm
Disallow /general/testscript
Disallow /dsg/pwmaa
Disallow /pmd/sb1953

googlebot

Rule Path
Disallow /pmd/sb1953
Disallow /dsg/pwmaa

uptimerobot/2.0

Rule Path
Disallow /epd/swims
Disallow /permits
Disallow /epd/illdump
Disallow /epd/sg
Disallow /wmd/svw
Disallow /wmd/watershed/sg

imagesiftbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yelpbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

Comments

  • Block Googlebot
  • Block Uptime robot
  • Block ImagesiftBot
  • Block Amazon user agent
  • Block bingbot
  • Block YandexBot
  • Block Yelpbot