lner.co.uk
robots.txt

Robots Exclusion Standard data for lner.co.uk

Resource Scan

Scan Details

Site Domain lner.co.uk
Base Domain lner.co.uk
Scan Status Ok
Last Scan2024-09-17T09:23:49+00:00
Next Scan 2024-10-01T09:23:49+00:00

Last Scan

Scanned2024-09-17T09:23:49+00:00
URL https://lner.co.uk/robots.txt
Redirect https://www.lner.co.uk:443/robots.txt
Redirect Domain www.lner.co.uk
Redirect Base lner.co.uk
Domain IPs 13.248.215.188, 76.223.91.149
Redirect IPs 108.156.133.11, 108.156.133.121, 108.156.133.27, 108.156.133.99
Response IP 108.156.133.27
Found Yes
Hash c99f26bc03df3910ce46318b2b90e97cc626dd1fbe097c52752a942893e57db8
SimHash fe0c98764d33

Groups

*

Rule Path
Allow /
Disallow *_Incapsula_Resource*
Disallow */search/?q=*
Disallow */quick-registration/?returnPath=*
Disallow *onlc%3D*
Disallow *ocrs%3D*
Disallow *station%3D*
Disallow */my-account/*
Disallow */sign-out/
Disallow */api/*
Disallow */journey-planner/?stationCRS=*

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.lner.co.uk/sitemap.xml

Comments

  • Disallow: */live-train-times/depart/*
  • Disallow: */live-train-times/arrive/*