houstonian.news
robots.txt

Robots Exclusion Standard data for houstonian.news

Resource Scan

Scan Details

Site Domain houstonian.news
Base Domain houstonian.news
Scan Status Ok
Last Scan2025-04-09T18:18:04+00:00
Next Scan 2025-05-09T18:18:04+00:00

Last Scan

Scanned2025-04-09T18:18:04+00:00
URL https://houstonian.news/robots.txt
Domain IPs 104.21.12.210, 172.67.132.106, 2606:4700:3032::6815:cd2, 2606:4700:3036::ac43:846a
Response IP 172.67.132.106
Found Yes
Hash 3c6659db8f016aef20c3dc4dbeaf95211ac0b4059743405e484a9d8c01948552
SimHash e1089cd1e5a3

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://houstonian.news/?sitemapindex.xml
sitemap https://houstonian.news/?sitemap509.xml
sitemap https://houstonian.news/?sitemap19.xml
sitemap https://houstonian.news/?sitemap510.xml
sitemap https://houstonian.news/?sitemap46.xml
sitemap https://houstonian.news/?sitemap716.xml