tohatsu.com.tw
robots.txt

Robots Exclusion Standard data for tohatsu.com.tw

Resource Scan

Scan Details

Site Domain tohatsu.com.tw
Base Domain tohatsu.com.tw
Scan Status Ok
Last Scan2024-05-17T21:03:42+00:00
Next Scan 2024-06-16T21:03:42+00:00

Last Scan

Scanned2024-05-17T21:03:42+00:00
URL https://www.tohatsu.com.tw/robots.txt
Domain IPs 108.156.133.100, 108.156.133.26, 108.156.133.64, 108.156.133.96, 2600:9000:2755:2000:c:4c64:d540:93a1, 2600:9000:2755:3400:c:4c64:d540:93a1, 2600:9000:2755:4800:c:4c64:d540:93a1, 2600:9000:2755:7200:c:4c64:d540:93a1, 2600:9000:2755:b600:c:4c64:d540:93a1, 2600:9000:2755:b800:c:4c64:d540:93a1, 2600:9000:2755:d400:c:4c64:d540:93a1, 2600:9000:2755:e800:c:4c64:d540:93a1
Response IP 108.156.133.100
Found Yes
Hash 0adb025a236a6560019daec5d07a02f75aca8821f4a318b82de5303304c49ea2
SimHash 39189d46e883

Groups

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /scripts/
Allow /

Other Records

Field Value
sitemap https://www.tohatsu.com.tw/sitemap.xml

Warnings

  • `crawl-deslay` is not a known field.