can-think.com.tw
robots.txt

Robots Exclusion Standard data for can-think.com.tw

Resource Scan

Scan Details

Site Domain can-think.com.tw
Base Domain can-think.com.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-30T20:22:35+00:00
Next Scan 2025-12-29T20:22:35+00:00

Last Successful Scan

Scanned2024-03-09T18:23:51+00:00
URL https://can-think.com.tw/robots.txt
Domain IPs 104.21.48.10, 172.67.175.179, 2606:4700:3032::ac43:afb3, 2606:4700:3037::6815:300a
Response IP 104.21.48.10
Found Yes
Hash f2b483860d4c85fb9465e6ef05fcc6f0078c9fbe4bd29604b35f7b0e9c315c63
SimHash 181cd946ea10

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

*

Rule Path
Disallow
Disallow /cgi-bin/