georgekniest.nl
robots.txt

Robots Exclusion Standard data for georgekniest.nl

Resource Scan

Scan Details

Site Domain georgekniest.nl
Base Domain georgekniest.nl
Scan Status Ok
Last Scan2024-09-21T03:24:53+00:00
Next Scan 2024-10-21T03:24:53+00:00

Last Scan

Scanned2024-09-21T03:24:53+00:00
URL https://georgekniest.nl/robots.txt
Redirect https://www.georgekniest.nl/robots.txt
Redirect Domain www.georgekniest.nl
Redirect Base georgekniest.nl
Domain IPs 5.172.42.223
Redirect IPs 5.172.42.223
Response IP 5.172.42.223
Found Yes
Hash f3398eb62d5ad367a2c67843f3ca41155741668956955aae492bfe6f6da912fa
SimHash a480fb718612

Groups

*

Rule Path
Disallow /orders.html
Disallow /nl/orders.html
Disallow /inloggen.html
Disallow /nl/inloggen.html
Disallow /bestellen/inloggen.html
Disallow /nl/bestellen/inloggen.html
Disallow /bestellen/gegevens.html
Disallow /nl/bestellen/gegevens.html
Disallow /winkelmandje.html
Disallow /nl/winkelmandje.html
Disallow /verlanglijstje.html
Disallow /nl/verlanglijstje.html
Disallow /registreren.html
Disallow /nl/registreren.html
Disallow /profiel.html
Disallow /nl/profiel.html
Disallow /wachtwoord-vergeten.html
Disallow /nl/wachtwoord-vergeten.html
Disallow /wachtwoord-resetten.html
Disallow /nl/wachtwoord-resetten.html
Disallow /wachtwoord-wijzigen.html
Disallow /nl/wachtwoord-wijzigen.html
Disallow /betalen/$
Disallow /nl/betalen/$
Disallow /zoeken.html?*
Disallow /nl/zoeken.html?*
Disallow /offerte-aanvraag.html
Disallow /nl/offerte-aanvraag.html
Disallow /beheer-gebruikers.html
Disallow /nl/beheer-gebruikers.html
Disallow /beheer-afleveradressen.html
Disallow /nl/beheer-afleveradressen.html
Disallow /beheer-factuuradressen.html
Disallow /nl/beheer-factuuradressen.html
Disallow /uitschrijven-review-verzoek.html
Disallow /nl/uitschrijven-review-verzoek.html
Disallow /retouren.html
Disallow /nl/retouren.html
Disallow /retouren-selecteer-order.html
Disallow /nl/retouren-selecteer-order.html
Disallow /selecteer-externe-koper.html
Disallow /nl/selecteer-externe-koper.html
Disallow /retour-aanvraag.html
Disallow /nl/retour-aanvraag.html
Disallow /mijn-digitale-artikelen.html
Disallow /nl/mijn-digitale-artikelen.html
Disallow /x19y46/dashboard.html
Disallow /nl/x19y46/dashboard.html
Disallow /x19y46/dashboard/inloggen.html
Disallow /nl/x19y46/dashboard/inloggen.html
Disallow /benodigde-producten/$
Disallow /nl/benodigde-producten/$
Disallow /offerte-overzicht.html
Disallow /nl/offerte-overzicht.html
Disallow /offerte-detail.html
Disallow /nl/offerte-detail.html
Disallow /offerte-detail/$
Disallow /nl/offerte-detail/$
Disallow /e-mailadres-verifieren.html
Disallow /nl/e-mailadres-verifieren.html
Disallow /emballage-overzicht.html
Disallow /nl/emballage-overzicht.html
Disallow /Offertelijst.html
Disallow /nl/Offertelijst.html
Disallow /webfunctions/utypia$
Disallow /zoek/$
Disallow /setcrossdomaintoken/$
Disallow /m/93/OfferteAanvraag.aspx$
Disallow /m/93/MonsterAanvraag.aspx$
Disallow /afterpay/$
Disallow /riverty/$
Disallow /cardgate/$
Disallow /pin/$
Disallow /multisafe-pay/$
Disallow /cfg/$
Disallow /debtorlogo/$
Disallow /orderdetail/$
Disallow /orderdetail/$
Disallow /bestelldetails/$
Disallow /details-de-la-commande/$
Disallow /detalle-del-pedido/$
Disallow /dettaglio-dell-ordine/$
Disallow /bedankt/$
Disallow /thanks/$
Disallow /danke/$
Disallow /merci/$
Disallow /gracias/$
Disallow /grazie/$
Disallow /hulu-egg-zip-jack-bestbuy-l4.html
Disallow /TradeTracker/$
Disallow /tradetracker/$
Disallow /rp/$
Disallow *.axd$
Disallow *.axd
Disallow *.ashx$
Disallow *.ashx

Other Records

Field Value
crawl-delay 3

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ucrawler/1.0

Rule Path
Disallow /

ucrawler

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

vagabondo

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

screaming frog seo spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.georgekniest.nl/sitemap_index.xml

Comments

  • https://megaindex.com/crawler
  • BEGIN CUSTOM TEKST
  • EIND CUSTOM TEKST
  • Version:
  • IIS16\192.2.0.19532
  • Directory:
  • Next-2024-05-06-S192.2.0
  • Style:
  • s190