hcswcd.org
robots.txt

Robots Exclusion Standard data for hcswcd.org

Resource Scan

Scan Details

Site Domain hcswcd.org
Base Domain hcswcd.org
Scan Status Ok
Last Scan2025-11-04T03:28:24+00:00
Next Scan 2025-12-04T03:28:24+00:00

Last Scan

Scanned2025-11-04T03:28:24+00:00
URL https://hcswcd.org/robots.txt
Redirect https://www.hcswcd.org/robots.txt
Redirect Domain www.hcswcd.org
Redirect Base hcswcd.org
Domain IPs 199.34.228.72
Redirect IPs 199.34.228.72
Response IP 199.34.228.72
Found Yes
Hash 7218aa83b2f6efc06a75298c13e1c8eee4d0294879666d1ad62282ccb1d5897d
SimHash 63f5d8122b63

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /tree-species.html
Disallow /http%3A//cagismaps.hamilton-co.org/csr/hcpubworks
Disallow /green-roofs.html
Disallow /upcoming.html
Disallow /board-member-wanted.html
Disallow /archive.html
Disallow /about.html
Disallow /order.html
Disallow /custom-solutions.html
Disallow /sales.html
Disallow /bioswales.html
Disallow /what-we-do.html
Disallow /https%3A//www.cleansweepofthegreatmiamiriver.org/
Disallow /downspout-disconnect.html
Disallow /how-can-we-help.html
Disallow /programs--workshops1.html
Disallow /rain-barrels.html
Disallow /urban-tree-canopy.html
Disallow /publications.html
Disallow /school-stormwater-projects.html
Disallow /permeable-pavers.html
Disallow /2025-tree-sale.html
Disallow /transparency.html
Disallow /curb-cuts.html
Disallow /orbcorps-americorps-program.html
Disallow /rain-gardens.html
Disallow /board-items.html

Other Records

Field Value
sitemap https://www.hcswcd.org/sitemap.xml