cpa.state.tx.us
robots.txt
Robots Exclusion Standard data for cpa.state.tx.us
Resource Scan
Scan Details
Site Domain | cpa.state.tx.us |
Base Domain | state.tx.us |
Scan Status | Ok |
Last Scan | 2024-09-26T16:13:15+00:00 |
Next Scan | 2024-10-26T16:13:15+00:00 |
Last Scan
Scanned | 2024-09-26T16:13:15+00:00 |
URL | http://cpa.state.tx.us/robots.txt |
Redirect | https://comptroller.texas.gov/robots.txt |
Redirect Domain | comptroller.texas.gov |
Redirect Base | texas.gov |
Domain IPs | 204.64.105.124 |
Redirect IPs | 18.161.111.21, 18.161.111.7, 18.161.111.8, 18.161.111.93 |
Response IP | 52.85.49.17 |
Found | Yes |
Hash | 0be5f8a3f72dc326a9ae27dc06da9bed09a25b1e09a9e33884bf78da1f9640b2 |
SimHash | b8009d494564 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/ |
Allow | /about/ |
Allow | /auto-data/ |
Allow | /application.php |
Allow | /data/ |
Allow | /disaster-relief/ |
Allow | /dist/ |
Allow | /economy/ |
Allow | /errors/ |
Allow | /fonts/ |
Allow | /forms/ |
Allow | /fraud-alert/ |
Allow | /help/ |
Allow | /home/ |
Allow | /images/ |
Allow | /infocus/ |
Allow | /programs/ |
Allow | /purchasing/ |
Allow | /tax-amnesty/ |
Allow | /taxes/ |
Allow | /transparency/ |
Allow | /web-forms/ |
Other Records
Field | Value |
---|---|
sitemap | https://comptroller.texas.gov/errors/404.php |
Comments