metrolink.co.uk
robots.txt
Robots Exclusion Standard data for metrolink.co.uk
Resource Scan
Scan Details
| Site Domain | metrolink.co.uk |
| Base Domain | metrolink.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-28T10:22:26+00:00 |
| Next Scan | 2024-09-26T10:22:26+00:00 |
Last Successful Scan
| Scanned | 2024-05-07T10:09:42+00:00 |
| URL | https://metrolink.co.uk/robots.txt |
| Redirect | https://tfgm.com/robots.txt/ |
| Redirect Domain | tfgm.com |
| Redirect Base | tfgm.com |
| Domain IPs | 18.65.3.115, 18.65.3.24, 18.65.3.59, 18.65.3.78 |
| Redirect IPs | 108.157.254.104, 108.157.254.12, 108.157.254.28, 108.157.254.30 |
| Response IP | 108.157.254.104 |
| Found | Yes |
| Hash | 620710393bfb4e55781bbe6e27e86f3cd89fbc0a63d0d5cb261a94ed386b5e8a |
| SimHash | e9045815dfd0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?*tab=* |
| Disallow | /*?*cookies=true |
| Disallow | /*?*line=* |
| Disallow | /*?*_=* |
| Disallow | /*?*q=* |
| Disallow | /public-transport/bus/stops/*/* |
| Disallow | /public-transport/bus/stations/*/* |
| Disallow | /tickets-and-passes/results* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tfgm.com/sitemap.xml |