shidianguji.com
robots.txt
Robots Exclusion Standard data for shidianguji.com
Resource Scan
Scan Details
| Site Domain | shidianguji.com |
| Base Domain | shidianguji.com |
| Scan Status | Ok |
| Last Scan | 2024-09-18T20:32:31+00:00 |
| Next Scan | 2024-10-18T20:32:31+00:00 |
Last Scan
| Scanned | 2024-09-18T20:32:31+00:00 |
| URL | https://shidianguji.com/robots.txt |
| Redirect | https://www.shidianguji.com/robots.txt |
| Redirect Domain | www.shidianguji.com |
| Redirect Base | shidianguji.com |
| Domain IPs | 163.181.160.235, 163.181.160.236, 163.181.160.237, 163.181.160.238, 163.181.160.239, 163.181.160.240, 163.181.160.241, 163.181.160.242 |
| Redirect IPs | 125.56.219.51, 72.247.127.234 |
| Response IP | 72.247.127.226 |
| Found | Yes |
| Hash | b189f5244740eb40ec793a64a4919027fd89b59b318c33fa6c66d1e4d8d4eace |
| SimHash | cb545d362f03 |
Groups
googlebot
bingbot
duckduckbot
sogouspider
yisouspider
yisouspider
sogou web spider
sogou wap spider
sogou inst spider
sogou blog
sogou news spider
sogou orion spider
sosospider
sogou spider2
haosouspider
haosospider
ahrefsbot
ahrefssiteaudit
baiduspider
toutiaospider
toutiaospider
bytespider
bytespider
| Rule | Path |
|---|---|
| Disallow | /profile |
| Disallow | /eden-web-socket-server |
| Disallow | /api/ancientlib/read/count/volume-version |
| Disallow | /passport |
| Disallow | /ttwid |
| Disallow | *.php |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shidianguji.com/sitemap/static/index.xml |
| sitemap | https://www.shidianguji.com/sitemap/book/index.xml |
| sitemap | https://www.shidianguji.com/sitemap/insite/index.xml |
| sitemap | https://www.shidianguji.com/sitemap/outsite/index.xml |
| sitemap | https://www.shidianguji.com/sitemap/midpage/index.xml |
| sitemap | https://www.shidianguji.com/sitemap/chapter/index.xml |
Warnings
- 1 invalid line.