Log In Sign Up

vanmoer.com
robots.txt

Robots Exclusion Standard data for vanmoer.com

Resource Scan

Scan Details

Site Domain vanmoer.com
Base Domain vanmoer.com
Scan Status Ok
Last Scan2025-11-23T09:53:10+00:00
Next Scan 2025-11-30T09:53:10+00:00

Last Scan

Scanned2025-11-23T09:53:10+00:00
URL https://vanmoer.com/robots.txt
Domain IPs 188.208.37.13, 2a00:1c98:1000:12a4:0:3:b958:2e2e
Response IP 188.208.37.13
Found Yes
Hash 2dbfeda327164a0e629d4c0582e52c66c5006a46b61c688b0ac8f79d41bc9eef
SimHash 213819224736

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://vanmoer.com/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://vanmoer.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow ChatGPT bot, as there's no benefit to allowing it to index your site
  • Disallow Google Bard and Vertex AI bots, as there's no benefit to allowing it to index your site
Back to top