nationalrail.co.uk
robots.txt

Robots Exclusion Standard data for nationalrail.co.uk

Resource Scan

Scan Details

Site Domain nationalrail.co.uk
Base Domain nationalrail.co.uk
Scan Status Ok
Last Scan2024-04-30T23:13:40+00:00
Next Scan 2024-05-07T23:13:40+00:00

Last Scan

Scanned2024-04-30T23:13:40+00:00
URL https://nationalrail.co.uk/robots.txt
Redirect https://www.nationalrail.co.uk:443/robots.txt
Redirect Domain www.nationalrail.co.uk
Redirect Base nationalrail.co.uk
Domain IPs 75.2.32.6, 99.83.188.216
Redirect IPs 104.18.32.13, 172.64.155.243, 2606:4700:4400::6812:200d, 2606:4700:4400::ac40:9bf3
Response IP 172.64.155.243
Found Yes
Hash 0efbaae7c5d6db184e440eb9c1955b773491024f1f49c4404fd0e51a2862ccf3
SimHash 0c00ee564411

Groups

*

Rule Path
Allow /
Disallow /site-search/
Disallow /to/

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nationalrail.co.uk/sitemap.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-incidents.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-live-trains.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-promotions.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-stations.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-pages.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-tickets.xml
sitemap https://www.nationalrail.co.uk/sitemaps/sitemap-operators.xml