v.douyu.com
robots.txt

Robots Exclusion Standard data for v.douyu.com

Resource Scan

Scan Details

Site Domain v.douyu.com
Base Domain douyu.com
Scan Status Ok
Last Scan2024-09-26T04:35:43+00:00
Next Scan 2024-10-26T04:35:43+00:00

Last Scan

Scanned2024-09-26T04:35:43+00:00
URL https://v.douyu.com/robots.txt
Domain IPs 101.33.26.139, 101.33.26.185, 101.33.26.188, 101.33.26.246, 101.33.26.9, 101.33.27.8, 43.132.80.158, 43.132.80.175, 43.132.80.77, 43.132.81.100, 43.132.81.194, 43.152.143.134, 43.152.143.159, 43.175.138.218, 43.175.154.12
Response IP 43.132.80.175
Found Yes
Hash 7e45a4d5ca24e844dde95e3c512101450c50070e90fd974b84d7895d5a01ff83
SimHash 6a5678710132

Groups

baiduspider

Rule Path
Disallow /member/*
Disallow /video/search/*

sosospider

Rule Path
Disallow /member/*
Disallow /video/search/*

sogou

Rule Path
Disallow /member/*
Disallow /video/search/*

yodaobot

Rule Path
Disallow /member/*
Disallow /video/search/*

googlebot

Rule Path
Disallow /member/*
Disallow /video/search/*

bingbot

Rule Path
Disallow /member/*
Disallow /video/search/*

slurp

Rule Path
Disallow /member/*
Disallow /video/search/*

msnbot

Rule Path
Disallow /member/*
Disallow /video/search/*

yisouspider

Rule Path
Disallow /member/*
Disallow /video/search/*

chinasospider

Rule Path
Disallow /member/*
Disallow /video/search/*

*

Rule Path
Disallow /

Warnings

  • 3 invalid lines.