directline-flights.co.uk
robots.txt
Robots Exclusion Standard data for directline-flights.co.uk
Resource Scan
Scan Details
| Site Domain | directline-flights.co.uk |
| Base Domain | directline-flights.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-27T06:32:43+00:00 |
| Next Scan | 2024-12-26T06:32:43+00:00 |
Last Successful Scan
| Scanned | 2024-05-31T06:25:30+00:00 |
| URL | https://directline-flights.co.uk/robots.txt |
| Redirect | https://www.directline-flights.co.uk/robots.txt |
| Redirect Domain | www.directline-flights.co.uk |
| Redirect Base | directline-flights.co.uk |
| Domain IPs | 54.77.240.220 |
| Redirect IPs | 18.155.68.19, 18.155.68.42, 18.155.68.44, 18.155.68.9, 2600:9000:23d2:1400:14:1daa:1800:93a1, 2600:9000:23d2:2400:14:1daa:1800:93a1, 2600:9000:23d2:2c00:14:1daa:1800:93a1, 2600:9000:23d2:a400:14:1daa:1800:93a1, 2600:9000:23d2:b000:14:1daa:1800:93a1, 2600:9000:23d2:b400:14:1daa:1800:93a1, 2600:9000:23d2:e400:14:1daa:1800:93a1, 2600:9000:23d2:fc00:14:1daa:1800:93a1 |
| Response IP | 18.155.68.9 |
| Found | Yes |
| Hash | f9066dab4175edd892e0f632155ed2ec9da9909ce04731870795fd9ad8f652ea |
| SimHash | 421cca90ec91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*printer%3Dyes |
| Disallow | /*source%3DRSS |
| Disallow | /videoplayer/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.directline-flights.co.uk/googleSitemap.cfm |