supspace.nl
robots.txt

Robots Exclusion Standard data for supspace.nl

Resource Scan

Scan Details

Site Domain supspace.nl
Base Domain supspace.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T00:36:55+00:00
Next Scan 2024-11-29T00:36:55+00:00

Last Successful Scan

Scanned2024-04-11T00:19:32+00:00
URL https://supspace.nl/robots.txt
Redirect https://www.supspace.nl/robots.txt
Redirect Domain www.supspace.nl
Redirect Base supspace.nl
Domain IPs 5.172.42.202
Redirect IPs 5.172.42.202
Response IP 5.172.42.202
Found Yes
Hash ec3fe55fbb7d6ddf8fbd5b0503aca383e8ee68f4d0da1d044d3cad9244539d72
SimHash 8f82f9708612

Groups

*

Rule Path
Disallow /orders.html
Disallow /nl/orders.html
Disallow /inloggen.html
Disallow /nl/inloggen.html
Disallow /bestellen/inloggen.html
Disallow /nl/bestellen/inloggen.html
Disallow /bestellen/gegevens.html
Disallow /nl/bestellen/gegevens.html
Disallow /winkelmandje.html
Disallow /nl/winkelmandje.html
Disallow /verlanglijstje.html
Disallow /nl/verlanglijstje.html
Disallow /registreren.html
Disallow /nl/registreren.html
Disallow /profiel.html
Disallow /nl/profiel.html
Disallow /wachtwoord-vergeten.html
Disallow /nl/wachtwoord-vergeten.html
Disallow /wachtwoord-resetten.html
Disallow /nl/wachtwoord-resetten.html
Disallow /wachtwoord-wijzigen.html
Disallow /nl/wachtwoord-wijzigen.html
Disallow /betalen/$
Disallow /nl/betalen/$
Disallow /zoeken.html?*
Disallow /nl/zoeken.html?*
Disallow /offerte-aanvraag.html
Disallow /nl/offerte-aanvraag.html
Disallow /beheer-gebruikers.html
Disallow /nl/beheer-gebruikers.html
Disallow /beheer-afleveradressen.html
Disallow /nl/beheer-afleveradressen.html
Disallow /beheer-factuuradressen.html
Disallow /nl/beheer-factuuradressen.html
Disallow /uitschrijven-review-verzoek.html
Disallow /nl/uitschrijven-review-verzoek.html
Disallow /retouren.html
Disallow /nl/retouren.html
Disallow /retouren-selecteer-order.html
Disallow /nl/retouren-selecteer-order.html
Disallow /selecteer-externe-koper.html
Disallow /nl/selecteer-externe-koper.html
Disallow /retour-aanvraag.html
Disallow /nl/retour-aanvraag.html
Disallow /mijn-digitale-artikelen.html
Disallow /nl/mijn-digitale-artikelen.html
Disallow /x19y46/dashboard.html
Disallow /nl/x19y46/dashboard.html
Disallow /x19y46/dashboard/inloggen.html
Disallow /nl/x19y46/dashboard/inloggen.html
Disallow /benodigde-producten/$
Disallow /nl/benodigde-producten/$
Disallow /offerte-overzicht.html
Disallow /nl/offerte-overzicht.html
Disallow /offerte-detail.html
Disallow /nl/offerte-detail.html
Disallow /offerte-detail/$
Disallow /nl/offerte-detail/$
Disallow /e-mailadres-verifieren.html
Disallow /nl/e-mailadres-verifieren.html
Disallow /emballage-overzicht.html
Disallow /nl/emballage-overzicht.html
Disallow /Offertelijst.html
Disallow /nl/Offertelijst.html
Disallow /webfunctions/utypia$
Disallow /zoek/$
Disallow /setcrossdomaintoken/$
Disallow /m/93/OfferteAanvraag.aspx$
Disallow /m/93/MonsterAanvraag.aspx$
Disallow /afterpay/$
Disallow /riverty/$
Disallow /cardgate/$
Disallow /pin/$
Disallow /multisafe-pay/$
Disallow /cfg/$
Disallow /debtorlogo/$
Disallow /orderdetail/$
Disallow /orderdetail/$
Disallow /bestelldetails/$
Disallow /details-de-la-commande/$
Disallow /detalle-del-pedido/$
Disallow /dettaglio-dell-ordine/$
Disallow /bedankt/$
Disallow /thanks/$
Disallow /danke/$
Disallow /merci/$
Disallow /gracias/$
Disallow /grazie/$
Disallow /hulu-egg-zip-jack-bestbuy-l4.html
Disallow /TradeTracker/$
Disallow /tradetracker/$
Disallow /rp/$
Disallow *.axd$
Disallow *.axd
Disallow *.ashx$
Disallow *.ashx

Other Records

Field Value
crawl-delay 3

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ucrawler/1.0

Rule Path
Disallow /

ucrawler

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

vagabondo

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

screaming frog seo spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.supspace.nl/sitemap_index.xml

Comments

  • https://megaindex.com/crawler
  • Version:
  • IIS22\182.2.7.3208
  • Directory:
  • Next-2024-01-10-S182.2.7
  • Style:
  • s185