douyin.com
robots.txt
Robots Exclusion Standard data for douyin.com
Resource Scan
Scan Details
| Site Domain | douyin.com |
| Base Domain | douyin.com |
| Scan Status | Ok |
| Last Scan | 2024-11-07T04:31:41+00:00 |
| Next Scan | 2024-11-21T04:31:41+00:00 |
Last Scan
| Scanned | 2024-11-07T04:31:41+00:00 |
| URL | https://douyin.com/robots.txt |
| Redirect | https://www.douyin.com/robots.txt |
| Redirect Domain | www.douyin.com |
| Redirect Base | douyin.com |
| Domain IPs | 122.14.229.127, 122.14.229.128 |
| Redirect IPs | 163.181.164.204, 163.181.164.205, 163.181.164.239, 163.181.164.240, 163.181.164.241, 163.181.164.242, 163.181.164.243, 163.181.164.244, 2404:2280:1e0:0:3::7f7, 2404:2280:1e0:0:3::7f8 |
| Response IP | 163.181.160.238 |
| Found | Yes |
| Hash | b27ce261f28950c1647355d8113ade7a7979f676c08656234395e22248f24c26 |
| SimHash | c9545d7427db |
Groups
googlebot
bingbot
duckduckbot
baiduspider
sogouspider
yisouspider
bytespider
toutiaospider
sogou web spider
sogou wap spider
sogou inst spider
sogou blog
sogou news spider
sogou orion spider
sosospider
sogou spider2
haosouspider
haosospider
| Rule | Path |
|---|---|
| Disallow | /follow |
| Disallow | /user/?enter_from=video_detail&from_gid=* |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /video/ |
| Disallow | /note/ |
| Disallow | /shipin/ |
| Disallow | /zhuanti/ |
| Disallow | /topic/ |
| Disallow | /search/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.douyin.com/sitemap.xml |
Warnings
- 1 invalid line.