tharong.com
robots.txt

Robots Exclusion Standard data for tharong.com

Resource Scan

Scan Details

Site Domain tharong.com
Base Domain tharong.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-21T13:52:31+00:00
Next Scan 2026-01-19T13:52:31+00:00

Last Successful Scan

Scanned2022-12-31T20:41:23+00:00
URL https://tharong.com/robots.txt
Domain IPs 104.21.68.94, 172.67.192.190, 2606:4700:3030::ac43:c0be, 2606:4700:3033::6815:445e
Response IP 104.21.68.94
Found Yes
Hash beb1f2b4d900e20ee6ba2e6248e507339e1684bdf8ceecb988e778f068750351
SimHash 6439d94145f4

Groups

*

Rule Path
Disallow /feed/
Disallow /author/

msnbot

Rule Path
Disallow /author/
Disallow /feed/

Other Records

Field Value
crawl-delay 120

bingbot

Rule Path
Disallow /author/
Disallow /feed/

Other Records

Field Value
crawl-delay 120

googlebot

Rule Path
Disallow /author/