drimble.nl
robots.txt

Robots Exclusion Standard data for drimble.nl

Resource Scan

Scan Details

Site Domain drimble.nl
Base Domain drimble.nl
Scan Status Ok
Last Scan2024-11-14T10:57:48+00:00
Next Scan 2024-11-21T10:57:48+00:00

Last Scan

Scanned2024-11-14T10:57:48+00:00
URL https://drimble.nl/robots.txt
Domain IPs 104.22.74.147, 104.22.75.147, 172.67.40.89, 2606:4700:10::6816:4a93, 2606:4700:10::6816:4b93, 2606:4700:10::ac43:2859
Response IP 172.67.40.89
Found Yes
Hash 09ba43e05f78d6455e21afe46efc18231c432036853ecd0bc93ef14931bbf0a1
SimHash 4a054040adb3

Groups

mediapartners-google

Rule Path
Disallow
Allow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

urlmetrics

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

*

Rule Path
Disallow /l/
Disallow /bericht/
Disallow /t/
Disallow /top/
Disallow /aanpassen/
Disallow /registreer/
Disallow /advertentie/
Disallow /overzicht/
Disallow /autovliegtuig.php
Disallow /lazypostcode.php
Disallow /*.uitleg.html$

Other Records

Field Value
sitemap https://drimble.nl/sitemap/sitemap.xml
sitemap https://drimble.nl/sitemap/vacature.xml