reuters.co.jp
robots.txt
Robots Exclusion Standard data for reuters.co.jp
Resource Scan
Scan Details
Site Domain | reuters.co.jp |
Base Domain | reuters.co.jp |
Scan Status | Ok |
Last Scan | 2024-09-04T16:58:52+00:00 |
Next Scan | 2024-10-04T16:58:52+00:00 |
Last Scan
Scanned | 2024-09-04T16:58:52+00:00 |
URL | http://reuters.co.jp/robots.txt |
Redirect | https://jp.reuters.com/robots.txt |
Redirect Domain | jp.reuters.com |
Redirect Base | reuters.com |
Domain IPs | 155.46.172.254 |
Redirect IPs | 23.52.171.122, 23.52.171.144, 2600:1413:b000:13::b857:c184, 2600:1413:b000:13::b857:c18f |
Response IP | 23.52.171.122 |
Found | Yes |
Hash | 55fd7b4723cfaff03e4cbb4eed60172cc6cb4f108b54d647b1e6811a4f3e8cb4 |
SimHash | 115a1940ac96 |
Groups
*
Rule | Path |
---|---|
Disallow | /site-search/ |
Disallow | /test/ |
Other Records
Field | Value |
---|---|
sitemap | https://jp.reuters.com/arc/outboundfeeds/sitemap-index/?outputType=xml |
sitemap | https://jp.reuters.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml |
sitemap | https://jp.reuters.com/static/video-sitemap/jp/sitemap_video_index.xml |
Comments