reuters.tv
robots.txt
Robots Exclusion Standard data for reuters.tv
Resource Scan
Scan Details
Site Domain | reuters.tv |
Base Domain | reuters.tv |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-09T08:34:10+00:00 |
Next Scan | 2024-12-08T08:34:10+00:00 |
Last Successful Scan
Scanned | 2022-11-07T09:21:23+00:00 |
URL | https://reuters.tv/robots.txt |
Redirect | https://www.reuters.tv/robots.txt |
Redirect Domain | www.reuters.tv |
Redirect Base | reuters.tv |
Response IP | 54.192.150.101, 54.192.150.18, 54.192.150.75, 54.192.150.53 |
Found | Yes |
Hash | d73ac97571893b697d4dc79c31d7ad916a8fa6391c06d371c2bc9d1c5772c9f4 |
SimHash | 650c05043f91 |
Groups
*
Rule | Path |
---|---|
Disallow | /studio |
Disallow | /studio/ |
Disallow | /node/ |
Disallow | /nodeappTest/ |
Disallow | /roku/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.reuters.tv/sitemaps/news.xml |
sitemap | http://www.reuters.tv/sitemaps/uk/videoList.xml |
sitemap | http://www.reuters.tv/sitemaps/us/videoList.xml |
Comments