euromaster.nl
robots.txt
Robots Exclusion Standard data for euromaster.nl
Resource Scan
Scan Details
| Site Domain | euromaster.nl |
| Base Domain | euromaster.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-04T03:57:19+00:00 |
| Next Scan | 2024-11-18T03:57:19+00:00 |
Last Scan
| Scanned | 2024-11-04T03:57:19+00:00 |
| URL | https://euromaster.nl/robots.txt |
| Redirect | https://www.euromaster.nl/robots.txt |
| Redirect Domain | www.euromaster.nl |
| Redirect Base | euromaster.nl |
| Domain IPs | 18.245.31.111, 18.245.31.125, 18.245.31.13, 18.245.31.59, 2600:9000:266e:2a00:12:7deb:8f00:93a1, 2600:9000:266e:3000:12:7deb:8f00:93a1, 2600:9000:266e:4600:12:7deb:8f00:93a1, 2600:9000:266e:5600:12:7deb:8f00:93a1, 2600:9000:266e:5c00:12:7deb:8f00:93a1, 2600:9000:266e:6800:12:7deb:8f00:93a1, 2600:9000:266e:7600:12:7deb:8f00:93a1, 2600:9000:266e:a400:12:7deb:8f00:93a1 |
| Redirect IPs | 2600:9000:23d0:4c00:12:7deb:8f00:93a1, 2600:9000:23d0:9a00:12:7deb:8f00:93a1, 2600:9000:23d0:a200:12:7deb:8f00:93a1, 2600:9000:23d0:b200:12:7deb:8f00:93a1, 2600:9000:23d0:c00:12:7deb:8f00:93a1, 2600:9000:23d0:ce00:12:7deb:8f00:93a1, 2600:9000:23d0:dc00:12:7deb:8f00:93a1, 2600:9000:23d0:e600:12:7deb:8f00:93a1, 65.9.112.118, 65.9.112.128, 65.9.112.38, 65.9.112.54 |
| Response IP | 18.165.122.106 |
| Found | Yes |
| Hash | 026123794ab2062a457402c21f6ee2ee589b6aaeb0df9e146bfe5696406a6377 |
| SimHash | 2b3a704285f2 |
Groups
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
etaospider
exabot
exabot-thumbnails
ezooms
fasterfox
gaisbot
gigabot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
kalooga
ladenzeile
ladenzeile.de
lexxebot
mlbot
msiecrawler
naverbot
nutch
ocelli
pagesinventory
penthesilea
phpdig
scoutjet
searchdaimon.com-dc
seokicks-robot
shopwiki
snapbot
spbot
speobot
teoma
turnitinbot
twiceler
wikiwix-bot
woozweb-monitoring
woriobot
wotbox
yacybit
yacybot
yeti
yodaobot
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /addToBasket |
| Disallow | /basket |
| Disallow | /paymentRedirect |
| Disallow | /searchPriceAjax |
| Disallow | /refCarSearchAjax?type=* |
| Disallow | /json?* |
| Disallow | /order |
| Disallow | /authentify/ |
| Disallow | /payment/ |
| Disallow | /wheelDelivery |
| Disallow | /productSheetAjax |
| Disallow | /deliveryChoice |
| Disallow | /search |
| Disallow | /find?&mode=* |
| Disallow | /compare |
| Disallow | /myaccount/* |
| Disallow | /myaccount |
| Disallow | /basket/* |
| Disallow | /basket |
| Disallow | /payment/* |
| Disallow | /payment |
| Disallow | /agb |
| Disallow | /cookies |
| Disallow | /paymentRedirect |
| Disallow | *bvstate%3Dpg%3A* |
| Disallow | /*?meta-data-filter= |
| Disallow | /*?pageNumber= |
| Disallow | /*?addressSearchField= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.euromaster.nl/zakelijk/sitemap.xml |
| sitemap | https://www.euromaster.nl/sitemap.xml |