Log In Sign Up

bever.nl
robots.txt

Robots Exclusion Standard data for bever.nl

Resource Scan

Scan Details

Site Domain bever.nl
Base Domain bever.nl
Scan Status Ok
Last Scan2024-09-19T12:57:26+00:00
Next Scan 2024-10-19T12:57:26+00:00

Last Scan

Scanned2024-09-19T12:57:26+00:00
URL https://bever.nl/robots.txt
Redirect https://www.bever.nl/robots.txt
Redirect Domain www.bever.nl
Redirect Base bever.nl
Domain IPs 2600:9000:2024:2400:6:e810:2b00:93a1, 2600:9000:2024:8400:6:e810:2b00:93a1, 2600:9000:2024:9a00:6:e810:2b00:93a1, 2600:9000:2024:a200:6:e810:2b00:93a1, 2600:9000:2024:b200:6:e810:2b00:93a1, 2600:9000:2024:c600:6:e810:2b00:93a1, 2600:9000:2024:ce00:6:e810:2b00:93a1, 2600:9000:2024:ee00:6:e810:2b00:93a1, 3.160.196.125, 3.160.196.14, 3.160.196.73, 3.160.196.93
Redirect IPs 2600:9000:2792:3000:7:8aa0:fc0:93a1, 2600:9000:2792:600:7:8aa0:fc0:93a1, 2600:9000:2792:7800:7:8aa0:fc0:93a1, 2600:9000:2792:7e00:7:8aa0:fc0:93a1, 2600:9000:2792:8a00:7:8aa0:fc0:93a1, 2600:9000:2792:c000:7:8aa0:fc0:93a1, 2600:9000:2792:dc00:7:8aa0:fc0:93a1, 2600:9000:2792:f200:7:8aa0:fc0:93a1, 3.164.182.100, 3.164.182.117, 3.164.182.118, 3.164.182.87
Response IP 18.165.140.111
Found Yes
Hash cdb7e1088bf4be5b626663fafbefc4350bef8b3b09ff679352c28319c1755961
SimHash 501c9696e3b1

Groups

*

Rule Path
Disallow /api*
Allow /api/aem/search*
Disallow /checkout*
Disallow /account*
Disallow /lister.html*
Disallow /nl.html/*
Disallow /cache/productmanual*
Disallow /content/platform-blueprints/*
Disallow /content/experience-fragments/*
Disallow /content/dam/content-fragments/*
Disallow /nieuwe-collectie/
Disallow /seizoensaanbieding/

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bever.nl/sitemap/index.xml
Back to top