Log In Sign Up

freeportpubliclibrary.org
robots.txt

Robots Exclusion Standard data for freeportpubliclibrary.org

Resource Scan

Scan Details

Site Domain freeportpubliclibrary.org
Base Domain freeportpubliclibrary.org
Scan Status Ok
Last Scan2026-01-31T17:39:07+00:00
Next Scan 2026-03-02T17:39:07+00:00

Last Scan

Scanned2026-01-31T17:39:07+00:00
URL https://freeportpubliclibrary.org/robots.txt
Redirect https://www.freeportpubliclibrary.org/robots.txt
Redirect Domain www.freeportpubliclibrary.org
Redirect Base freeportpubliclibrary.org
Domain IPs 52.32.196.230, 52.70.155.240
Redirect IPs 34.214.250.249, 52.32.196.230
Response IP 52.32.196.230
Found Yes
Hash fb40416f9c5da60024c4ea46377fe5f27d4e91290648df92d9e27a96f941153e
SimHash 791c86104f93

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Disallow /website-accessibility-statement.html$

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.freeportpubliclibrary.org/sitemap.xml
Back to top

Comments

  • All other robots allowed
  • Sitemap files
Back to top