inews.co.uk
robots.txt
Robots Exclusion Standard data for inews.co.uk
Resource Scan
Scan Details
| Site Domain | inews.co.uk |
| Base Domain | inews.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-05-25T13:37:47+00:00 |
| Next Scan | 2024-06-01T13:37:47+00:00 |
Last Scan
| Scanned | 2024-05-25T13:37:47+00:00 |
| URL | https://inews.co.uk/robots.txt |
| Domain IPs | 23.48.107.42, 23.48.107.65, 2600:1417:3f::b81c:eb2b, 2600:1417:3f::b81c:eb48 |
| Response IP | 23.48.107.42 |
| Found | Yes |
| Hash | 92ad30caa7bf45c613878c45ded412e24c31010b68fbbbb4b7a2b02127d6979b |
| SimHash | 806588e0a193 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /?s= |
| Disallow | /?post_type= |
| Disallow | *%26s%3D |
| Disallow | *?attachment_id= |
| Disallow | */feed/ |
| Disallow | */rss |
| Disallow | */embed |
| Disallow | */page/ |
| Disallow | /images-i.jpimedia.uk/* |
| Disallow | /preview/post/* |
| Disallow | /archive/* |
| Disallow | /post-label/* |
| Disallow | /my-account |
| Disallow | /reset-password |
| Allow | /sitemap/*/page/ |
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://inews.co.uk/sitemap-channels.xml |
| sitemap | https://inews.co.uk/sitemap-authors.xml |
| sitemap | https://inews.co.uk/sitemap-topics.xml |
| sitemap | https://inews.co.uk/sitemap-videos.xml |
| sitemap | https://inews.co.uk/sitemap.xml |
Comments