shanghaidaily.com
robots.txt
Robots Exclusion Standard data for shanghaidaily.com
Resource Scan
Scan Details
Site Domain | shanghaidaily.com |
Base Domain | shanghaidaily.com |
Scan Status | Ok |
Last Scan | 2024-10-22T21:52:02+00:00 |
Next Scan | 2024-11-21T21:52:02+00:00 |
Last Scan
Scanned | 2024-10-22T21:52:02+00:00 |
URL | http://www.shanghaidaily.com/robots.txt |
Redirect | https://archive.shine.cn/robots.txt |
Redirect Domain | archive.shine.cn |
Redirect Base | shine.cn |
Domain IPs | 163.171.211.34, 2a01:53c0:ffee::1f |
Redirect IPs | 138.113.115.37, 163.171.211.34, 2a01:53c0:ffee::1f |
Response IP | 138.113.115.37 |
Found | Yes |
Hash | cc6fb104628871ce3ca1a43a8a7c4762adee6edc82525f5a2d533d5d4e015eb5 |
SimHash | 088460448712 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /ucenter/ |
Disallow | /UserCenter/ |
Disallow | /Style/ |
Disallow | /article/sl.aspx* |
Other Records
Field | Value |
---|---|
sitemap | https://archive.shine.cn/sitemapindex.xml |
sitemap | https://archive.shine.cn/sitemap-metro.xml |
sitemap | https://archive.shine.cn/sitemap-biz.xml |
sitemap | https://archive.shine.cn/sitemap-nation.xml |
sitemap | https://archive.shine.cn/sitemap-world.xml |
sitemap | https://archive.shine.cn/sitemap-sports.xml |
sitemap | https://archive.shine.cn/sitemap-others.xml |
sitemap | https://archive.shine.cn/sitemap-shd.xml |