Log In Sign Up

douyu.tv
robots.txt

Robots Exclusion Standard data for douyu.tv

Resource Scan

Scan Details

Site Domain douyu.tv
Base Domain douyu.tv
Scan Status Ok
Last Scan2024-09-09T12:16:21+00:00
Next Scan 2024-10-09T12:16:21+00:00

Last Scan

Scanned2024-09-09T12:16:21+00:00
URL https://www.douyu.tv/robots.txt
Redirect https://www.douyu.com/robots.txt
Redirect Domain www.douyu.com
Redirect Base douyu.com
Domain IPs 163.181.199.241, 163.181.199.242, 163.181.199.243, 163.181.199.244, 163.181.199.245, 163.181.199.246, 163.181.199.248, 163.181.199.249
Redirect IPs 132.147.114.72, 163.171.211.114
Response IP 132.147.114.72
Found Yes
Hash b8797c8b5969958bf6290b35a7e5264aa024000331684e7a9180ee9d7e042208
SimHash ca1371556136

Groups

baiduspider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

bytespider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

sosospider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

sogou

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

yodaobot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

googlebot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

bingbot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

slurp

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

msnbot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

yisouspider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

chinasospider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*
Back to top

Warnings

  • 5 invalid lines.
Back to top