lidl.pt
robots.txt
Robots Exclusion Standard data for lidl.pt
Resource Scan
Scan Details
Site Domain | lidl.pt |
Base Domain | lidl.pt |
Scan Status | Ok |
Last Scan | 2025-06-03T15:29:40+00:00 |
Next Scan | 2025-06-17T15:29:40+00:00 |
Last Scan
Scanned | 2025-06-03T15:29:40+00:00 |
URL | https://lidl.pt/robots.txt |
Redirect | https://www.lidl.pt/robots.txt |
Redirect Domain | www.lidl.pt |
Redirect Base | lidl.pt |
Domain IPs | 104.69.159.68 |
Redirect IPs | 2a02:cb40:300::a0, 80.90.16.196 |
Response IP | 80.90.16.196 |
Found | Yes |
Hash | 2825cef3bc15a546828bfe50d8b7e8cb9f4d77eb0c6e04a88c61c755bccd21d8 |
SimHash | 60058ce0a693 |
Groups
*
Rule | Path |
---|---|
Disallow | /q/search?id=* |
Disallow | /cc.js* |
Disallow | /1* |
Disallow | /2* |
Disallow | /3* |
Disallow | /4* |
Disallow | /5* |
Disallow | /6* |
Disallow | /7* |
Disallow | /8* |
Disallow | /9* |
Disallow | /cdn/assets/cwv/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.lidl.pt/static/sitemap.xml |