Log In Sign Up

folderz.nl
robots.txt

Robots Exclusion Standard data for folderz.nl

Resource Scan

Scan Details

Site Domain folderz.nl
Base Domain folderz.nl
Scan Status Ok
Last Scan2024-09-22T16:07:11+00:00
Next Scan 2024-09-29T16:07:11+00:00

Last Scan

Scanned2024-09-22T16:07:11+00:00
URL https://folderz.nl/robots.txt
Redirect https://www.folderz.nl/robots.txt
Redirect Domain www.folderz.nl
Redirect Base folderz.nl
Domain IPs 104.21.14.51, 172.67.157.217, 2606:4700:3031::ac43:9dd9, 2606:4700:3035::6815:e33
Redirect IPs 13.35.210.100, 13.35.210.109, 13.35.210.111, 13.35.210.122, 2600:9000:2078:5c00:9:551:c380:93a1, 2600:9000:2078:6200:9:551:c380:93a1, 2600:9000:2078:b600:9:551:c380:93a1, 2600:9000:2078:c600:9:551:c380:93a1, 2600:9000:2078:dc00:9:551:c380:93a1, 2600:9000:2078:f400:9:551:c380:93a1, 2600:9000:2078:f600:9:551:c380:93a1, 2600:9000:2078:fe00:9:551:c380:93a1
Response IP 13.35.210.109
Found Yes
Hash c06397a5234861dfb1219cf5c241e2d69579d2f955992ab5df5eac7dbd581684
SimHash a8340c62f519

Groups

*

Rule Path
Allow /
Disallow /zoeken/*
Disallow /shopping-list/
Disallow /click-out/
Disallow /index.php/click-out/
Disallow /admin/
Disallow /cdn-cgi/
Disallow /aanbiedingen/*?sort=relevance&page=*&*
Allow /aanbiedingen/*?sort=relevance&page=*
Disallow /aanbiedingen/*?page=*&*
Allow /aanbiedingen/*?page=*
Disallow /aanbiedingen/*?*
Disallow /merken/*?page=*&*
Allow /merken/*?page=*
Disallow /merken/*?*
Disallow /winkels/*?page=*&*
Allow /winkels/*?page=*
Disallow /winkels/*?*
Disallow /steden/*?page=*&*
Allow /steden/*?page=*
Disallow /steden/*?*
Disallow /nieuwste-folders?page=*&*
Allow /nieuwste-folders?page=*
Disallow /nieuwste-folders?*
Disallow /bijna-verlopen-folders?page=*&*
Allow /bijna-verlopen-folders?page=*
Disallow /bijna-verlopen-folders?*
Disallow /populaire-folders?page=*&*
Allow /populaire-folders?page=*
Disallow /populaire-folders?*
Disallow /aanbevolen-folders?page=*&*
Allow /aanbevolen-folders?page=*
Disallow /aanbevolen-folders?*
Disallow /nieuwste-aanbiedingen?page=*&*
Allow /nieuwste-aanbiedingen?page=*
Disallow /nieuwste-aanbiedingen?*
Disallow /bijna-verlopen-aanbiedingen?page=*&*
Allow /bijna-verlopen-aanbiedingen?page=*
Disallow /bijna-verlopen-aanbiedingen?*
Disallow /populaire-aanbiedingen?page=*&*
Allow /populaire-aanbiedingen?page=*
Disallow /populaire-aanbiedingen?*
Disallow /aanbevolen-aanbiedingen?page=*&*
Allow /aanbevolen-aanbiedingen?page=*
Disallow /aanbevolen-aanbiedingen?*
Disallow /hot-or-not/populair?page=*&*
Allow /hot-or-not/populair?page=*
Disallow /hot-or-not/populair?*
Disallow /hot-or-not/trending?page=*&*
Allow /hot-or-not/trending?page=*
Disallow /hot-or-not/trending?*
Disallow /hot-or-not/nieuw?page=*&*
Allow /hot-or-not/nieuw?page=*
Disallow /hot-or-not/nieuw?*

adsbot-google

Rule Path
Disallow /click-out/
Disallow /admin/

*
adsbot-google

Rule Path
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /cdn-cgi/images/trace/
Disallow /cdn-cgi/rum
Disallow /cdn-cgi/scripts/
Disallow /cdn-cgi/styles/
Disallow /cdn-cgi/zaraz/

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
mj12bot
ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.folderz.nl/sitemap.xml
Back to top