Log In Sign Up

cdubelge.be
robots.txt

Robots Exclusion Standard data for cdubelge.be

Resource Scan

Scan Details

Site Domain cdubelge.be
Base Domain cdubelge.be
Scan Status Ok
Last Scan2025-08-30T07:34:08+00:00
Next Scan 2025-09-29T07:34:08+00:00

Last Scan

Scanned2025-08-30T07:34:08+00:00
URL https://cdubelge.be/robots.txt
Domain IPs 162.19.67.41
Response IP 162.19.67.41
Found Yes
Hash 2e2ddda6babcfacc8d9afa3d6d7be08a62654fb1b4d120fa4da4f943b2538aa7
SimHash 670018e08690

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.cdubelge.be/sitemap_index.xml
Back to top

Comments

  • PRODUWEB-START
  • On indique au spider le lien vers notre sitemap
  • On indique le host aux spiders :
  • PRODUWEB-END
Back to top

Warnings

  • `host` is not a known field.
Back to top