debijlesstudent.nl
robots.txt
Robots Exclusion Standard data for debijlesstudent.nl
Resource Scan
Scan Details
| Site Domain | debijlesstudent.nl |
| Base Domain | debijlesstudent.nl |
| Scan Status | Ok |
| Last Scan | 2025-04-02T19:21:08+00:00 |
| Next Scan | 2025-04-09T19:21:08+00:00 |
Last Scan
| Scanned | 2025-04-02T19:21:08+00:00 |
| URL | https://debijlesstudent.nl/robots.txt |
| Domain IPs | 2a02:2968::1c00:edff:fe00:db1, 62.84.245.21 |
| Response IP | 62.84.245.21 |
| Found | Yes |
| Hash | b1588a4d7b24e4309815fe877c717b90d3791d27c9cf403118f395d98663d964 |
| SimHash | 56067d5386f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
adsbot-google
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
googlebot-image
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
googlebot-video
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
mediapartners-google
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
bingbot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
duckduckbot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
pinterestbot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
ia_archiver
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
archive.org_bot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
facebookexternalhit
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
linkedinbot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
whatsapp
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
twitterbot
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /wp-json/ | - |
| Disallow | /?rest_route= | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/cache/ | - |
| Disallow | /wp-content/plugins/ | - |
| Disallow | /xmlrpc.php | - |
| Disallow | /wp-includes/ | - |
| Disallow | /*add-to-cart%3D* | - |
| Disallow | /feed/ | - |
| Disallow | */feed | - |
| Disallow | */feed$ | - |
| Disallow | /feed/$ | - |
| Disallow | /comments/feed | - |
| Disallow | /?feed= | - |
| Disallow | /wp-feed | - |
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/* | block access to internal search result pages |
| Disallow | /*?s=* | block access to internal search result pages |
| Disallow | /?p=* | block access to pages for which permalinks fails |
| Disallow | /%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /?lang=* | block access to language translations |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
| Disallow | /cart/ | - |
| Disallow | /winkelmand/ | - |
| Disallow | /checkout/ | - |
| Disallow | /afrekenen/ | - |
| Disallow | /my-account/ | - |
| Disallow | /mijn-account/ | - |
| Allow | /wp-includes/css/ | - |
| Allow | /wp-includes/js/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
agent gpt
agentgpt
agentic
ahrefsbot
ai article writer
ai content detector
ai dungeon
ai search engine
ai seo crawler
ai training
ai writer
ai21 labs
ai2bot
aibot
aimatrix
aisearchbot
aitraining
alexa
alexatm
alpha ai
alphaai
amazon bedrock
amazon comprehend
amazon lex
amazon sagemaker
amazon silk
amazon textract
amazonbot
amazon-kendra
amelia
anderspinkbot
anthropic
anthropicai
anthropic-ai
anypicker
anyword
applebot
aria browse
arquivo-web-crawler
articoolo
autogpt
automated writer
awariorssbot
awariosmartbot
babya discoverer
baiduspider
bardbot
barkrowler
bingai
bingbot-chat
blekkobot
blexbot
bluechipbacklinks
brave leo
brave leo ai
brightedge crawler/1.0
builtwith
bytedance
bytespider
catboost
cazoodlebot
ccbot
cc-crawler
chatglm
chatgpt
chatgpt-user
chinchilla
claude
claudebot
claude-web
clearscope
cohere
cohere-ai
cohere-training-data-crawler
common crawl
commoncrawl
content harmony
content king
content optimizer
content samurai
contentatscale
contentbot
contentedge
conversion ai
copilot
copyai
copymatic
copyscape
cotoyogi
crawler_eb_germany_2.0
crawlq ai
crawlspace
crew ai
crewai
criteobot
dall-e
datadog/synthetics
dataforseobot
dataprovider
deepai
deepl
deepmind
deepseek
depolarizinggpt
dialogpt
diffbot
discobot
dnbcrawler-analytics
dotbot
dotbot/1.0
doubao ai
duckassistbot
exabot
ezooms robot
facebookbot
facebookexternalhit
firecrawl
flyriver
frase ai
freshbot
friendlycrawler
fuzebot
gabanzabot
geedoproductsearch
gemini
gemma
genai
gigabot
go-http-client
google bard ai
google-cloudvertexbot
google-extended
googleother
goose
gpt
gpt-2
gpt-3
gpt-4
gptbot
gptzero
grammarly
grendizer
grok
gt bot
gtbot
hemingway editor
hugging face
hypotenuse ai
iaskspider
icc-crawler
imagesiftbot
img2dataset
inferkit
ink editor
inkforall
intelliseek
intelliseek.ai
isscyberriskcrawler
jasperai
kafkai
kangaroo
keyword density ai
komobot
lamarkbot
leftwinggpt
llama
magpie-crawler
marketmuse
mediatoolkitbot
meltwater
meta ai
meta llama
meta.ai
metaai
meta-ai
meta-external
meta-externalagent
meta-externalfetcher
metatagbot
mistral
mj12bot
mojeekbot
monsidobot
msnbot
narrative
narrative device
neevabot
netestate ne crawler
neural text
neuralseo
node/simplecrawler
nuclei
oai searchbot
oai-searchbot
omgili
open ai
openai
openbot
openindexspider
opentext ai
outwrite
page analyzer ai
pangubot
panscient
paperlibot
paqlebot
paraphraser.io
peer39_crawler
perl lwp
perplexitybot
perplexitybot/1.0
petalbot
phindbot
phxbot
piplbot
prowritingaid
quillbot
qwantbot
riddler
rightwinggpt
robotspider
rogerbot
rytr
saplingai
sasbot
scalenut
scalenutbot
scoopit-crawler
scraper
scrapy
scriptbook
searchgpt
sebot-wa
seekportbot
semanticbot
semanticscholarbot
semrushbot
semrushbot-ba
semrushbot-coub
semrushbot-ct
semrushbot-si
semrushbot-swa
sentibot
senutobot
seo content machine
seo robot
seokicks
seokicks-robot
seranking seochecker
serendeputybot
serpstatbot
seznambot
sidetrade
simplified ai
sirdatabot
sistrix crawler
siteauditbot
sitecheckerbotcrawler
skydancer
slickwrite
slurp
sogou inst spider
sogou web spider
spin rewriter
spinbot
splitsignalbot
stability
stablediffusionbot
stractbot
sudowrite
surfer ai
taboolabot
targetspotcrawler
text blaze
textcortex
the knowledge ai
timpibot
trendictionbot
ttd-content
turnitin robot
twingly recon
uptimerobot
uptimerobot/2.0
velenpublicwebcrawler
vidnami ai
webchatgpt
webzio
whisper
wikido
wiseguys robot
wordai
wordtune
wormsgtp
wpbot
writecream
writerzen
writescope
writesonic
x.ai
xai
xbot
xovionpagecrawler
yandex
yeti
yioopbot
yisouspider
youbot
zero gtp
zerochat
zimm
zimmwriter
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://debijlesstudent.nl/sitemaps.xml |
Warnings
- 3 invalid lines.
Comments