maybelline.co.uk
robots.txt
Robots Exclusion Standard data for maybelline.co.uk
Resource Scan
Scan Details
| Site Domain | maybelline.co.uk |
| Base Domain | maybelline.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-04T12:37:39+00:00 |
| Next Scan | 2024-10-18T12:37:39+00:00 |
Last Scan
| Scanned | 2024-10-04T12:37:39+00:00 |
| URL | https://maybelline.co.uk/robots.txt |
| Redirect | https://www.maybelline.co.uk/robots.txt |
| Redirect Domain | www.maybelline.co.uk |
| Redirect Base | maybelline.co.uk |
| Domain IPs | 104.18.34.13, 172.64.153.243, 2606:4700:4400::6812:220d, 2606:4700:4400::ac40:99f3 |
| Redirect IPs | 104.18.34.13, 172.64.153.243, 2606:4700:4400::6812:220d, 2606:4700:4400::ac40:99f3 |
| Response IP | 104.18.34.13 |
| Found | Yes |
| Hash | 333d60dbe887b8ded3caf48f9bd5d47ee09b97a4aeeb2b3ba46847b0e328400b |
| SimHash | 47101ec0ade6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?q=* |
| Disallow | */en/ |
| Disallow | */en$ |
| Disallow | */En/ |
| Disallow | */En$ |
| Disallow | *utm_* |
| Disallow | *?gclid= |
| Disallow | */de-de/ |
| Disallow | */de-de$ |
| Disallow | */de-DE/ |
| Disallow | */de-DE$ |
| Disallow | */fr-fr/ |
| Disallow | */fr-fr$ |
| Disallow | */fr-FR/ |
| Disallow | */fr-FR$ |
| Disallow | */pt-pt/ |
| Disallow | */pt-pt$ |
| Disallow | */pt-PT/ |
| Disallow | */pt-PT$ |
| Disallow | */en-gb/ |
| Disallow | */en-gb$ |
| Disallow | */en-GB/ |
| Disallow | */en-GB$ |
| Disallow | */it-it/ |
| Disallow | */it-it$ |
| Disallow | */it-IT/ |
| Disallow | */it-IT$ |
| Disallow | /cdn-cgi/ |
| Disallow | *bvstate%3D* |
| Disallow | *bvroute%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.maybelline.co.uk/sitemap.xml |