amahouston.org
robots.txt

Robots Exclusion Standard data for amahouston.org

Resource Scan

Scan Details

Site Domain amahouston.org
Base Domain amahouston.org
Scan Status Ok
Last Scan2026-02-07T20:41:50+00:00
Next Scan 2026-03-09T20:41:50+00:00

Last Scan

Scanned2026-02-07T20:41:50+00:00
URL https://amahouston.org/robots.txt
Redirect https://www.amahouston.org/robots.txt
Redirect Domain www.amahouston.org
Redirect Base amahouston.org
Domain IPs 141.193.213.10
Redirect IPs 141.193.213.10
Response IP 141.193.213.10
Found Yes
Hash 1f06e050f752ca0c44d7ad554578a14ee319eb26e3ac11da0efe6f4c4f18e523
SimHash d4048d380feb

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /events/action~posterboard/
Disallow /events/action~agenda/
Disallow /events/action~oneday/
Disallow /events/action~month/
Disallow /events/action~week/
Disallow /events/action~stream/
Disallow /events/action~undefined/
Disallow /events/action~http%3A/
Disallow /events/action~default/
Disallow /events/action~poster/
Disallow /events/action~*/