geld.nl
robots.txt

Robots Exclusion Standard data for geld.nl

Resource Scan

Scan Details

Site Domain geld.nl
Base Domain geld.nl
Scan Status Ok
Last Scan2024-09-23T17:04:29+00:00
Next Scan 2024-09-30T17:04:29+00:00

Last Scan

Scanned2024-09-23T17:04:29+00:00
URL https://geld.nl/robots.txt
Redirect https://www.geld.nl/robots.txt
Redirect Domain www.geld.nl
Redirect Base geld.nl
Domain IPs 2001:16e8:0:211::100, 62.148.167.226
Redirect IPs 2001:16e8:0:211::100, 62.148.167.226
Response IP 62.148.167.226
Found Yes
Hash 6759b9d0b1f37bf9f4724f8d64f76fa4425967a8e430ed8423afb6eb487aac0b
SimHash f21fe4868833

Groups

*

Rule Path
Disallow /autoverzekering/ClickTaleCache.ashx
Disallow /autoverzekering/module/
Disallow /autoverzekering/vergelijken/module
Disallow /autoverzekering/vergelijken/naar-verzekeraar
Disallow /autoverzekering/vergelijken/aanvraag
Disallow /autoverzekering/vergelijken/aanvraag-bedankt
Disallow /lenen/vergelijken/naar-kredietverstrekker
Disallow /lenen/vergelijken/mail-kredietverstrekker
Disallow /lenen/vergelijken/aanvraag
Disallow /lenen/vergelijken/aanvraag-bedankt
Disallow /zorgverzekering/module
Disallow /zorgverzekering/naar-verzekeraar
Disallow /zorgverzekering/aanvraag
Disallow /zorgverzekering/aanvraag-bedankt
Disallow /hypotheekrente/uitgebreid_vergelijken
Disallow /hypotheek/hypotheekrente/aanvragen
Disallow /hypotheek/hypotheekrente/aanvraag-bedankt
Disallow /spaarrente/uitgebreid_vergelijken
Disallow /sparen/naar-spaarbank
Disallow /root/static/
Disallow /static/www/
Disallow /autoverzekering/static/
Disallow /hypotheken/static/
Disallow /lenen/static/
Disallow /zorgverzekering/static/
Disallow /assets/js/
Disallow /assets/fonts/
Disallow /*utm_source%3Dviabovag*

rogerbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

proximic

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

bilbo

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

melodibot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

buddhabot

Rule Path
Disallow /

imrbot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

gufybot

Rule Path
Disallow /

nesotebot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

noyabot

Rule Path
Disallow /

flappybot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

nutch

Rule Path
Disallow /

berlin-fu-cow

Rule Path
Disallow /

riddler

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-requests/2.8.1

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.geld.nl/sitemap.xml
sitemap https://www.geld.nl/sitemap_images.xml
sitemap https://www.geld.nl/sitemap-videos.xml

Warnings

  • 4 invalid lines.