hosthai.com
robots.txt

Robots Exclusion Standard data for hosthai.com

Resource Scan

Scan Details

Site Domain hosthai.com
Base Domain hosthai.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-09T17:32:15+00:00
Next Scan 2026-02-07T17:32:15+00:00

Last Successful Scan

Scanned2024-12-22T04:04:08+00:00
URL https://hosthai.com/robots.txt
Redirect https://www.caferaik.com/robots.txt
Redirect Domain www.caferaik.com
Redirect Base caferaik.com
Domain IPs 104.21.28.4, 172.67.170.29, 2606:4700:3031::ac43:aa1d, 2606:4700:3035::6815:1c04
Redirect IPs 104.21.5.137, 172.67.133.128, 2606:4700:3031::ac43:8580, 2606:4700:3033::6815:589
Response IP 104.21.5.137
Found Yes
Hash 8113029c75728382c2340d114b60c5d1805080caf3502acff6208da60679a53e
SimHash 4940dc51c631

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.caferaik.com/sitemap.xml