texaspolitics.utexas.edu
robots.txt

Robots Exclusion Standard data for texaspolitics.utexas.edu

Resource Scan

Scan Details

Site Domain texaspolitics.utexas.edu
Base Domain utexas.edu
Scan Status Ok
Last Scan2025-08-31T13:51:42+00:00
Next Scan 2025-09-30T13:51:42+00:00

Last Scan

Scanned2025-08-31T13:51:42+00:00
URL https://texaspolitics.utexas.edu/robots.txt
Domain IPs 146.6.162.220
Response IP 146.6.162.220
Found Yes
Hash 6426261abd1d4a166d54724c36395ac88aff9b9d62865af53cd6b08510cfb0d5
SimHash 4c5cdc504771

Groups

*

Rule Path
Disallow /polling/
Disallow /research/data-visualization/

Other Records

Field Value
crawl-delay 10

Comments

  • Custom