sedaily.com
robots.txt
Robots Exclusion Standard data for sedaily.com
Resource Scan
Scan Details
Site Domain | sedaily.com |
Base Domain | sedaily.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2024-10-20T07:05:12+00:00 |
Next Scan | 2024-11-19T07:05:12+00:00 |
Last Successful Scan
Scanned | 2024-09-21T07:04:01+00:00 |
URL | https://sedaily.com/robots.txt |
Domain IPs | 121.254.145.102 |
Response IP | 121.254.145.102 |
Found | Yes |
Hash | bc93a531f2d93e4c5583ad0e10f2a3b792f0d49d211d18e162ed8dd8b775ad50 |
SimHash | 40050e61cb43 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /StockIndex/ |
Disallow | /StockInfo/ |
Disallow | /StockNotice/ |
Disallow | /NewsList/GA13/ |
Disallow | /Serach/ |
Disallow | /v/Zipchelin/ |
Disallow | /Info/Board/ |
Disallow | /Inc/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.sedaily.com/sitemap-index |
sitemap | https://www.sedaily.com/section |
sitemap | https://www.sedaily.com/issue-news |
sitemap | https://www.sedaily.com/serial |
sitemap | https://www.sedaily.com/daily-news |
sitemap | https://www.sedaily.com/latestnews |
Comments