euromaster.nl
robots.txt
Robots Exclusion Standard data for euromaster.nl
Resource Scan
Scan Details
Site Domain | euromaster.nl |
Base Domain | euromaster.nl |
Scan Status | Ok |
Last Scan | 2024-06-16T17:05:38+00:00 |
Next Scan | 2024-06-30T17:05:38+00:00 |
Last Scan
Scanned | 2024-06-16T17:05:38+00:00 |
URL | https://euromaster.nl/robots.txt |
Redirect | https://www.euromaster.nl/robots.txt |
Redirect Domain | www.euromaster.nl |
Redirect Base | euromaster.nl |
Domain IPs | 13.226.228.102, 13.226.228.123, 13.226.228.75, 13.226.228.83, 2600:9000:2201:1e00:12:7deb:8f00:93a1, 2600:9000:2201:4e00:12:7deb:8f00:93a1, 2600:9000:2201:6000:12:7deb:8f00:93a1, 2600:9000:2201:6c00:12:7deb:8f00:93a1, 2600:9000:2201:8000:12:7deb:8f00:93a1, 2600:9000:2201:a00:12:7deb:8f00:93a1, 2600:9000:2201:d600:12:7deb:8f00:93a1, 2600:9000:2201:e00:12:7deb:8f00:93a1 |
Redirect IPs | 13.226.228.102, 13.226.228.123, 13.226.228.75, 13.226.228.83, 2600:9000:263a:1c00:12:7deb:8f00:93a1, 2600:9000:263a:3000:12:7deb:8f00:93a1, 2600:9000:263a:3200:12:7deb:8f00:93a1, 2600:9000:263a:4000:12:7deb:8f00:93a1, 2600:9000:263a:6800:12:7deb:8f00:93a1, 2600:9000:263a:dc00:12:7deb:8f00:93a1, 2600:9000:263a:ee00:12:7deb:8f00:93a1, 2600:9000:263a:fe00:12:7deb:8f00:93a1 |
Response IP | 18.165.171.119 |
Found | Yes |
Hash | 2047186077e52a3d5076e102649aa85135ba8f2b01bde4a138de0bef0734bc38 |
SimHash | 2b3a501085f2 |
Groups
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twiceler
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yeti
yodaobot
zyborg
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /addToBasket |
Disallow | /basket |
Disallow | /paymentRedirect |
Disallow | /searchPriceAjax |
Disallow | /refCarSearchAjax?type=* |
Disallow | /json?* |
Disallow | /order |
Disallow | /authentify/ |
Disallow | /payment/ |
Disallow | /wheelDelivery |
Disallow | /productSheetAjax |
Disallow | /deliveryChoice |
Disallow | /search |
Disallow | /find?&mode=* |
Disallow | /compare |
Disallow | /myaccount/* |
Disallow | /myaccount |
Disallow | /basket/* |
Disallow | /basket |
Disallow | /payment/* |
Disallow | /payment |
Disallow | /agb |
Disallow | /cookies |
Disallow | /paymentRedirect |
Disallow | *bvstate%3Dpg%3A* |
Other Records
Field | Value |
---|---|
sitemap | https://www.euromaster.nl/sitemap.xml |