guide-renovation.be
robots.txt

Robots Exclusion Standard data for guide-renovation.be

Resource Scan

Scan Details

Site Domain guide-renovation.be
Base Domain guide-renovation.be
Scan Status Ok
Last Scan2025-11-19T00:24:58+00:00
Next Scan 2025-12-19T00:24:58+00:00

Last Scan

Scanned2025-11-19T00:24:58+00:00
URL https://guide-renovation.be/robots.txt
Redirect https://www.guide-renovation.be/robots.txt
Redirect Domain www.guide-renovation.be
Redirect Base guide-renovation.be
Domain IPs 185.162.30.232
Redirect IPs 185.162.30.232
Response IP 185.162.30.232
Found Yes
Hash d7a446f800cf4f8c85de1117ed6465ea8b7852779df38e313a1f0fd40da0e2cf
SimHash 233effd5c6c9

Groups

voilabot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /files/
Disallow /control/rfp_create
Disallow /control/rfp_create_local
Disallow /control/partner_withheld
Disallow /control/partner_concours_withheld
Disallow /control/tell_a_friend
Disallow /control/template_help
Disallow /control/business_type_tags
Disallow /*PartnerBusinessTypeModel%40
Disallow /*jsessionid*
Disallow /wp-login.php
Disallow */trackback
Disallow /*/feed
Disallow /*/comments
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz
Disallow /*.cgi
Disallow /lastform/
Disallow /lastform
Disallow /bobex-form
Disallow /bobex-form/*
Disallow /bedankt-voor-uw-offerte-aanvraag/
Disallow /merci-pour-votre-demande-de-devis/
Disallow /bedankt-voor-uw-offerte-aanvraag
Disallow /merci-pour-votre-demande-de-devis

Other Records

Field Value
sitemap https://www.guide-renovation.be/wp-sitemap.xml

Comments

  • Block Alexa crawler
  • User-agent: ia_archiver
  • Disallow: /
  • slow down Yahoo
  • Block access to files directory
  • custom robots.txt