austintexas.org
robots.txt

Robots Exclusion Standard data for austintexas.org

Resource Scan

Scan Details

Site Domain austintexas.org
Base Domain austintexas.org
Scan Status Ok
Last Scan2025-07-17T22:43:12+00:00
Next Scan 2025-08-16T22:43:12+00:00

Last Scan

Scanned2025-07-17T22:43:12+00:00
URL https://austintexas.org/robots.txt
Redirect https://www.austintexas.org/robots.txt
Redirect Domain www.austintexas.org
Redirect Base austintexas.org
Domain IPs 34.74.254.27
Redirect IPs 23.59.168.137, 2600:1413:5000:12::1737:27eb, 2600:1413:5000:12::1737:27f8
Response IP 23.44.4.144
Found Yes
Hash 6aa6325d2515c89a1df74edb22d78fbdbb9a0324f06909fef8a588040b9b08b7
SimHash 4118dc72c635

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.austintexas.org/sitemap.xml