houstondailytribune.com
robots.txt
Robots Exclusion Standard data for houstondailytribune.com
Resource Scan
Scan Details
| Site Domain | houstondailytribune.com |
| Base Domain | houstondailytribune.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T03:57:27+00:00 |
| Next Scan | 2024-11-21T03:57:27+00:00 |
Last Scan
| Scanned | 2024-11-14T03:57:27+00:00 |
| URL | https://houstondailytribune.com/robots.txt |
| Domain IPs | 65.61.154.4 |
| Response IP | 65.61.154.4 |
| Found | Yes |
| Hash | 78795dff5961e3429d390116347f5a1c8dcdb8da2dd6f96f08b6923059abd657 |
| SimHash | c6731986e9d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /css/ |
| Disallow | /css_system/ |
| Disallow | /js/ |
| Disallow | /js_system/ |
| Disallow | /account/ |
| Disallow | /calendar/post/ |
| Disallow | /forms/ |
| Disallow | /login.html |
| Disallow | /poll_process.html |
| Disallow | /post_comments.html |
| Disallow | /my_profile.html |
| Disallow | /my_stuff.html |
| Disallow | /user_profile.html |
| Disallow | /ajax/ |
| Disallow | /register.html |
| Disallow | /report_item.html |
| Disallow | /send_item.html |
| Disallow | /subscribe/ |
| Disallow | /renew/ |
| Disallow | /account/ |
| Disallow | /resetpassword/ |
| Disallow | /reset/ |
| Disallow | /alacarte/ |
| Disallow | /lookup/ |
| Disallow | /register-local/ |
| Disallow | /entercode/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://houstondailytribune.com/sitemaps/sitemaps-r2-default-houston-daily-tribune-1.xml |
| sitemap | https://houstondailytribune.com/sitemaps/sitemaps-r2-googlenews-houston-daily-tribune-1.xml |