l1.nl
robots.txt
Robots Exclusion Standard data for l1.nl
Resource Scan
Scan Details
Site Domain | l1.nl |
Base Domain | l1.nl |
Scan Status | Ok |
Last Scan | 2024-09-22T14:59:20+00:00 |
Next Scan | 2024-09-29T14:59:20+00:00 |
Last Scan
Scanned | 2024-09-22T14:59:20+00:00 |
URL | https://l1.nl/robots.txt |
Redirect | https://www.l1.nl/robots.txt |
Redirect Domain | www.l1.nl |
Redirect Base | l1.nl |
Domain IPs | 93.119.12.159 |
Redirect IPs | 2600:9000:2022:2800:1a:f2b5:cb00:93a1, 2600:9000:2022:2c00:1a:f2b5:cb00:93a1, 2600:9000:2022:2e00:1a:f2b5:cb00:93a1, 2600:9000:2022:3800:1a:f2b5:cb00:93a1, 2600:9000:2022:4e00:1a:f2b5:cb00:93a1, 2600:9000:2022:5200:1a:f2b5:cb00:93a1, 2600:9000:2022:5c00:1a:f2b5:cb00:93a1, 2600:9000:2022:b400:1a:f2b5:cb00:93a1, 65.9.189.106, 65.9.189.29, 65.9.189.37, 65.9.189.52 |
Response IP | 108.156.22.30 |
Found | Yes |
Hash | 35530522fc98489e3968a2dd777f60e03d4d1257e2a756aa9989fdf73cf983a7 |
SimHash | 701319d18603 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /content/ |
Disallow | /embedded/ |
Disallow | /data/ |
Disallow | /inc/ |
Disallow | /*/- |
Disallow | /nos/ |
Disallow | /zoeken?q=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.l1.nl/sitemap/sitemap.xml.gz |