maybelline.pt
robots.txt
Robots Exclusion Standard data for maybelline.pt
Resource Scan
Scan Details
| Site Domain | maybelline.pt |
| Base Domain | maybelline.pt |
| Scan Status | Ok |
| Last Scan | 2024-10-02T22:13:09+00:00 |
| Next Scan | 2024-10-16T22:13:09+00:00 |
Last Scan
| Scanned | 2024-10-02T22:13:09+00:00 |
| URL | https://maybelline.pt/robots.txt |
| Redirect | https://www.maybelline.pt/robots.txt |
| Redirect Domain | www.maybelline.pt |
| Redirect Base | maybelline.pt |
| Domain IPs | 104.18.41.174, 172.64.146.82, 2606:4700:4400::6812:29ae, 2606:4700:4400::ac40:9252 |
| Redirect IPs | 104.18.41.174, 172.64.146.82, 2606:4700:4400::6812:29ae, 2606:4700:4400::ac40:9252 |
| Response IP | 104.18.41.174 |
| Found | Yes |
| Hash | 7984c97ad3bf2333e08f448b80a15294d20b7d2c5568e15b72d511dffe7f8017 |
| SimHash | 05141a41ad4f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?q=* |
| Disallow | */en/ |
| Disallow | */en$ |
| Disallow | */En/ |
| Disallow | */En$ |
| Disallow | *?utm_* |
| Disallow | *?gclid= |
| Disallow | *gclid%3D* |
| Disallow | */de-de/ |
| Disallow | */de-de$ |
| Disallow | */de-DE/ |
| Disallow | */de-DE$ |
| Disallow | */fr-fr/ |
| Disallow | */fr-fr$ |
| Disallow | */fr-FR/ |
| Disallow | */fr-FR$ |
| Disallow | */ro-ro/ |
| Disallow | */ro-ro$ |
| Disallow | */ro-RO/ |
| Disallow | */ro-RO$ |
| Disallow | /cdn-cgi/ |
| Disallow | *fbclid%3D* |
| Disallow | *bvstate%3D* |
| Disallow | *bvroute%3D* |
| Disallow | *msclkid%3D* |
| Disallow | *?ttclid=* |
| Disallow | *?thankyou=* |
| Disallow | *?location=* |
| Disallow | *searchterm%3D* |
| Disallow | *searchTerm%3D* |
| Disallow | */error-pages* |
| Disallow | *?pagestatic=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.maybelline.pt/sitemap.xml |
Warnings
- 1 invalid line.