vangaever.be
robots.txt

Robots Exclusion Standard data for vangaever.be

Resource Scan

Scan Details

Site Domain vangaever.be
Base Domain vangaever.be
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-03-03T17:04:36+00:00
Next Scan 2026-05-02T17:04:36+00:00

Last Successful Scan

Scanned2026-01-03T17:03:45+00:00
URL https://vangaever.be/robots.txt
Redirect https://www.vangaever.be/robots.txt
Redirect Domain www.vangaever.be
Redirect Base vangaever.be
Domain IPs 5.22.210.115
Redirect IPs 5.22.210.115
Response IP 5.22.210.115
Found Yes
Hash d9f8fc153928bf5186eb682ecdcd50be168bb33d8882fe3848b440a8c0c0ac03
SimHash 407819527793

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.vangaever.be/sitemaps-1-sitemap.xml
sitemap https://www.vangaever.be/fr-be/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.vangaever.be/
  • live - don't allow web crawlers to index cpresources/ or vendor/