dierenbos.nl
robots.txt

Robots Exclusion Standard data for dierenbos.nl

Resource Scan

Scan Details

Site Domain dierenbos.nl
Base Domain dierenbos.nl
Scan Status Ok
Last Scan2024-11-02T21:03:46+00:00
Next Scan 2024-12-02T21:03:46+00:00

Last Scan

Scanned2024-11-02T21:03:46+00:00
URL https://dierenbos.nl/robots.txt
Redirect https://www.dierenbos.nl/robots.txt
Redirect Domain www.dierenbos.nl
Redirect Base dierenbos.nl
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.164, 76.76.21.61
Response IP 76.76.21.93
Found Yes
Hash f3ff4e647802e7f599d47c04580b4332975fde951b4a2e267571c0780568dbe1
SimHash 6c155844e592

Groups

*

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

googlebot

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

bingbot

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

slurp

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

duckduckbot

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

baiduspider

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

yandex

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

mail.ru

Rule Path
Disallow /*?gclid=
Disallow /*?utm_source=

Other Records

Field Value
sitemap https://www.dierenbos.nl/sitemap.xml