shanghaidaily.com
robots.txt

Robots Exclusion Standard data for shanghaidaily.com

Resource Scan

Scan Details

Site Domain shanghaidaily.com
Base Domain shanghaidaily.com
Scan Status Ok
Last Scan2024-10-22T21:52:02+00:00
Next Scan 2024-11-21T21:52:02+00:00

Last Scan

Scanned2024-10-22T21:52:02+00:00
URL http://www.shanghaidaily.com/robots.txt
Redirect https://archive.shine.cn/robots.txt
Redirect Domain archive.shine.cn
Redirect Base shine.cn
Domain IPs 163.171.211.34, 2a01:53c0:ffee::1f
Redirect IPs 138.113.115.37, 163.171.211.34, 2a01:53c0:ffee::1f
Response IP 138.113.115.37
Found Yes
Hash cc6fb104628871ce3ca1a43a8a7c4762adee6edc82525f5a2d533d5d4e015eb5
SimHash 088460448712

Groups

*

Rule Path
Disallow /bin/
Disallow /ucenter/
Disallow /UserCenter/
Disallow /Style/
Disallow /article/sl.aspx*

Other Records

Field Value
sitemap https://archive.shine.cn/sitemapindex.xml
sitemap https://archive.shine.cn/sitemap-metro.xml
sitemap https://archive.shine.cn/sitemap-biz.xml
sitemap https://archive.shine.cn/sitemap-nation.xml
sitemap https://archive.shine.cn/sitemap-world.xml
sitemap https://archive.shine.cn/sitemap-sports.xml
sitemap https://archive.shine.cn/sitemap-others.xml
sitemap https://archive.shine.cn/sitemap-shd.xml