bentonswcd.org
robots.txt

Robots Exclusion Standard data for bentonswcd.org

Resource Scan

Scan Details

Site Domain bentonswcd.org
Base Domain bentonswcd.org
Scan Status Ok
Last Scan2026-02-15T17:19:31+00:00
Next Scan 2026-03-17T17:19:31+00:00

Last Scan

Scanned2026-02-15T17:19:31+00:00
URL https://bentonswcd.org/robots.txt
Redirect https://www.bentonswcd.org/robots.txt
Redirect Domain www.bentonswcd.org
Redirect Base bentonswcd.org
Domain IPs 52.32.196.230, 52.70.155.240
Redirect IPs 34.214.250.249, 52.32.196.230
Response IP 52.32.196.230
Found Yes
Hash f17bb97fa2dd84baef0af1f7ab52620d43df4403cf9a8af72306298b07d11a2a
SimHash 691c82104db1

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Disallow /website-accessibility-statement.html$

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bentonswcd.org/sitemap.xml

Comments

  • All other robots allowed
  • Sitemap files