Log In Sign Up

douyu.com
robots.txt

Robots Exclusion Standard data for douyu.com

Resource Scan

Scan Details

Site Domain douyu.com
Base Domain douyu.com
Scan Status Ok
Last Scan2024-04-11T14:26:42+00:00
Next Scan 2024-05-11T14:26:42+00:00

Last Scan

Scanned2024-04-11T14:26:42+00:00
URL https://douyu.com/robots.txt
Redirect https://www.douyu.com/robots.txt
Redirect Domain www.douyu.com
Redirect Base douyu.com
Domain IPs 101.33.26.190, 101.33.26.198, 101.33.26.246, 101.33.26.247, 203.205.155.41, 43.132.80.158, 43.132.81.100, 43.132.81.194
Redirect IPs 163.171.208.133, 2a01:53c0:ffed::44
Response IP 163.171.208.133
Found Yes
Hash b8797c8b5969958bf6290b35a7e5264aa024000331684e7a9180ee9d7e042208
SimHash ca1371556136

Groups

baiduspider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

bytespider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

sosospider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

sogou

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

yodaobot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

googlebot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

bingbot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

slurp

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

msnbot

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

yisouspider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*

chinasospider

Rule Path
Disallow /api/*
Disallow /member*
Disallow /admin/*
Disallow /room/*
Back to top

Warnings

  • 5 invalid lines.
Back to top