m.xiaohongshu.com
robots.txt
Robots Exclusion Standard data for m.xiaohongshu.com
Resource Scan
Scan Details
| Site Domain | m.xiaohongshu.com |
| Base Domain | xiaohongshu.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-04-16T21:27:52+00:00 |
| Next Scan | 2024-07-15T21:27:52+00:00 |
Last Successful Scan
| Scanned | 2023-03-01T21:24:54+00:00 |
| URL | https://m.xiaohongshu.com/robots.txt |
| Redirect | https://www.xiaohongshu.com/robots.txt |
| Redirect Domain | www.xiaohongshu.com |
| Redirect Base | xiaohongshu.com |
| Domain IPs | 138.113.112.211 |
| Redirect IPs | 150.109.90.80, 150.109.91.35, 203.205.155.99, 240d:c010:20:101::39, 240d:c010:81:1::11, 240d:c010:81:1::3d, 43.132.80.11, 43.132.80.55 |
| Response IP | 43.132.80.55 |
| Found | Yes |
| Hash | 4a5b310a92c59f6131aee3983d0dc9b0eb0ea39bbf102270057c81e45cf1e222 |
| SimHash | ec745b71b743 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /discovery/item/ |
| Allow | /explore/ |
| Allow | /sitemap.xml |
| Disallow | /user/profile/*/ |
baiduspider
| Rule | Path |
|---|---|
| Allow | /discovery/item/ |
| Allow | /explore/ |
| Allow | /sitemap.xml |
| Disallow | /user/profile/*/ |
bingbot
| Rule | Path |
|---|---|
| Allow | /discovery/item/ |
| Allow | /explore/ |
| Allow | /sitemap.xml |
| Disallow | /user/profile/*/ |
sogou web spider
| Rule | Path |
|---|---|
| Allow | /discovery/item/ |
| Allow | /explore/ |
| Allow | /sitemap.xml |
| Disallow | /user/profile/*/ |
sogou wap spider
| Rule | Path |
|---|---|
| Allow | /discovery/item/ |
| Allow | /explore/ |
| Allow | /sitemap.xml |
| Disallow | /user/profile/*/ |
yisouspider
| Rule | Path |
|---|---|
| Allow | /discovery/item/ |
| Allow | /explore/ |
| Allow | /sitemap.xml |
| Disallow | /user/profile/*/ |
*
| Rule | Path |
|---|---|
| Disallow | / |