gsr.io
robots.txt

Robots Exclusion Standard data for gsr.io

Resource Scan

Scan Details

Site Domain gsr.io
Base Domain gsr.io
Scan Status Ok
Last Scan2026-02-07T21:23:01+00:00
Next Scan 2026-02-08T21:23:01+00:00

Last Scan

Scanned2026-02-07T21:23:01+00:00
URL https://gsr.io/robots.txt
Domain IPs 104.17.124.41
Response IP 104.17.124.41
Found Yes
Hash a699006d18ea6de8fa04dba8522bb5de5eb12a66312a856c6037975906f31df1
SimHash 23381d021f34

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.gsr.io/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.gsr.io/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow Google Bard and Vertex AI bots, as there's no benefit to allowing it to index your site
  • User-agent: Google-Extended
  • Disallow: /