lidl-canarias.es
robots.txt
Robots Exclusion Standard data for lidl-canarias.es
Resource Scan
Scan Details
| Site Domain | lidl-canarias.es |
| Base Domain | lidl-canarias.es |
| Scan Status | Ok |
| Last Scan | 2024-05-28T09:58:13+00:00 |
| Next Scan | 2024-06-27T09:58:13+00:00 |
Last Scan
| Scanned | 2024-05-28T09:58:13+00:00 |
| URL | http://www.lidl-canarias.es/robots.txt |
| Redirect | https://www.lidl.es/robots.txt |
| Redirect Domain | www.lidl.es |
| Redirect Base | lidl.es |
| Domain IPs | 23.33.126.140, 23.33.126.159 |
| Redirect IPs | 2a02:cb40:200::10, 80.90.16.1 |
| Response IP | 80.90.16.1 |
| Found | Yes |
| Hash | c8215e4ef02e311ad90eb459cc5f166ee2e198e41804494c2692352395507a86 |
| SimHash | 605558f4e693 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.xsl$ |
| Disallow | /*.pdf$ |
| Disallow | /*.xml$ |
| Disallow | *?*filter |
| Disallow | *?*sort |
| Disallow | *search |
| Disallow | /1* |
| Disallow | /2* |
| Disallow | /3* |
| Disallow | /4* |
| Disallow | /5* |
| Disallow | /6* |
| Disallow | /7* |
| Disallow | /8* |
| Disallow | /9* |
| Disallow | *?*scenario |
| Disallow | *?*fromRecommendation |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lidl.es/sitemap_index.xml.gz |
Comments