dovykeukens.be
robots.txt

Robots Exclusion Standard data for dovykeukens.be

Resource Scan

Scan Details

Site Domain dovykeukens.be
Base Domain dovykeukens.be
Scan Status Ok
Last Scan2024-04-28T17:32:02+00:00
Next Scan 2024-05-28T17:32:02+00:00

Last Scan

Scanned2024-04-28T17:32:02+00:00
URL https://www.dovykeukens.be/robots.txt
Domain IPs 104.26.8.61, 104.26.9.61, 172.67.72.247, 2606:4700:20::681a:83d, 2606:4700:20::681a:93d, 2606:4700:20::ac43:48f7
Response IP 104.26.8.61
Found Yes
Hash a59f49c7daf6bf7385a6065beb72d569d7c6383f343293019c24500ca3ad498d
SimHash 437808658bbc

Groups

amazonbot

Rule Path
Disallow /shop/

Other Records

Field Value
crawl-delay 99

screaming frog seo spider/18.4

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 99

*

Rule Path
Disallow /*.html/
Disallow /interesse-deze-keuken/*
Disallow /static/CACHE/css/bootstrap.29460cc7df9a.css
Disallow /static/CACHE/css/bootstrap.0d348b93e778.css
Disallow /static/CACHE/css/bootstrap.068878702674.css
Disallow /static/CACHE/css/bootstrap.8a0a4f7a9019.css
Disallow /service*
Disallow /static/CACHE/css/bootstrap.068878702674.css
Disallow /static/CACHE/css/bootstrap.eaea78583105.css
Disallow /static/CACHE/css/bootstrap.11445204caac.css
Disallow /static/js/local-mc-validate.js
Disallow /static/CACHE/css/bootstrap.513dfc8321b7.css
Disallow /in-de-buurt-van-fr/*.be

googlebot

Rule Path
Allow /
Disallow /service*

bingbot

Rule Path
Allow /
Disallow /service*

*

Rule Path
Allow /
Disallow /service*

Warnings

  • `host` is not a known field.