visitlondon.com
robots.txt
Robots Exclusion Standard data for visitlondon.com
Resource Scan
Scan Details
| Site Domain | visitlondon.com |
| Base Domain | visitlondon.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-19T18:14:56+00:00 |
| Next Scan | 2024-11-17T18:14:56+00:00 |
Last Successful Scan
| Scanned | 2023-01-02T04:33:34+00:00 |
| URL | https://visitlondon.com/robots.txt |
| Redirect | https://www.visitlondon.com/robots.txt |
| Redirect Domain | www.visitlondon.com |
| Redirect Base | visitlondon.com |
| Domain IPs | 13.107.237.59, 13.107.238.59 |
| Redirect IPs | 104.18.2.150, 104.18.3.150, 2606:4700::6812:296, 2606:4700::6812:396 |
| Response IP | 104.18.3.150 |
| Found | Yes |
| Hash | 4a83d48bea9017a025dfe09ac61dfde55bf6cb474666d83f919b7e5ab86c8ec1 |
| SimHash | a6091c651edb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /london/api |
| Disallow | /request-info |
| Disallow | /sign-in |
| Disallow | /register |
| Disallow | /login |
| Disallow | /social-login |
| Disallow | /social-unsubscribe |
| Disallow | /my-london |
| Disallow | /upgrade |
| Disallow | /forgot-password |
| Disallow | /de/sign-in |
| Disallow | /es/sign-in |
| Disallow | /fr/sign-in |
| Disallow | /it/sign-in |
| Disallow | /app/search |
| Disallow | /search |
| Disallow | /de/search |
| Disallow | /es/search |
| Disallow | /fr/search |
| Disallow | /it/search |
| Disallow | /offers-and-competitions/advert-test |
| Disallow | /sitecore |
| Disallow | /Sitecore |
| Disallow | /sitecore_files/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /xsl/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.visitlondon.com/sitemap_index.xml |
Warnings
- 1 invalid line.