hztxt66.com
robots.txt

Robots Exclusion Standard data for hztxt66.com

Resource Scan

Scan Details

Site Domain hztxt66.com
Base Domain hztxt66.com
Scan Status Ok
Last Scan2024-05-14T21:54:20+00:00
Next Scan 2024-06-13T21:54:20+00:00

Last Scan

Scanned2024-05-14T21:54:20+00:00
URL https://www.hztxt66.com/robots.txt
Redirect https://www.hzdzs6.com/robots.txt
Redirect Domain www.hzdzs6.com
Redirect Base hzdzs6.com
Domain IPs 104.21.16.120, 172.67.212.13, 2606:4700:3034::ac43:d40d, 2606:4700:3035::6815:1078
Redirect IPs 104.21.63.151, 172.67.147.33, 2606:4700:3031::6815:3f97, 2606:4700:3035::ac43:9321
Response IP 172.67.147.33
Found Yes
Hash 30ee47e6b7a04fc0e9f617dd89dac0a29d8fbf15b4cc6a3a999763206d5bf5ff
SimHash 1a5d84c05cc1

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap /sitemap.xml
sitemap /site.txt

Warnings

  • 2 invalid lines.