nationalrail.co.uk
robots.txt
Robots Exclusion Standard data for nationalrail.co.uk
Resource Scan
Scan Details
Site Domain | nationalrail.co.uk |
Base Domain | nationalrail.co.uk |
Scan Status | Ok |
Last Scan | 2024-04-30T23:13:40+00:00 |
Next Scan | 2024-05-07T23:13:40+00:00 |
Last Scan
Scanned | 2024-04-30T23:13:40+00:00 |
URL | https://nationalrail.co.uk/robots.txt |
Redirect | https://www.nationalrail.co.uk:443/robots.txt |
Redirect Domain | www.nationalrail.co.uk |
Redirect Base | nationalrail.co.uk |
Domain IPs | 75.2.32.6, 99.83.188.216 |
Redirect IPs | 104.18.32.13, 172.64.155.243, 2606:4700:4400::6812:200d, 2606:4700:4400::ac40:9bf3 |
Response IP | 172.64.155.243 |
Found | Yes |
Hash | 0efbaae7c5d6db184e440eb9c1955b773491024f1f49c4404fd0e51a2862ccf3 |
SimHash | 0c00ee564411 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /site-search/ |
Disallow | /to/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.nationalrail.co.uk/sitemap.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-incidents.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-live-trains.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-promotions.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-stations.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-pages.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-tickets.xml |
sitemap | https://www.nationalrail.co.uk/sitemaps/sitemap-operators.xml |