taobobo.com
robots.txt

Robots Exclusion Standard data for taobobo.com

Resource Scan

Scan Details

Site Domain taobobo.com
Base Domain taobobo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-31T15:53:21+00:00
Next Scan 2025-10-30T15:53:21+00:00

Last Successful Scan

Scanned2025-06-10T00:58:09+00:00
URL https://taobobo.com/robots.txt
Domain IPs 104.21.52.130, 172.67.199.137, 2606:4700:3035::6815:3482, 2606:4700:3035::ac43:c789
Response IP 104.21.52.130
Found Yes
Hash a3f658c95e0fd6581ec5b85c880899fb37105c331c8ea8bb4dd8910954b8d148
SimHash 785d49f0fb93

Groups

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

tkbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

*

Rule Path
Disallow /include
Disallow /comment
Disallow /templets
Disallow /js
Disallow /search