Log In Sign Up

grin.com
robots.txt

Robots Exclusion Standard data for grin.com

Resource Scan

Scan Details

Site Domain grin.com
Base Domain grin.com
Scan Status Ok
Last Scan2025-10-30T19:59:40+00:00
Next Scan 2025-11-06T19:59:40+00:00

Last Scan

Scanned2025-10-30T19:59:40+00:00
URL https://grin.com/robots.txt
Redirect https://www.grin.com/robots.txt
Redirect Domain www.grin.com
Redirect Base grin.com
Domain IPs 212.18.11.52
Redirect IPs 2001:a60:9019::9, 212.18.11.52
Response IP 212.18.11.52
Found Yes
Hash 51b1eeb5a7338db45fad36325199d1dbb9b971218cbffbb0eb0d3cf281089c0a
SimHash 0818cd80ffb6

Groups

gptbot
oai-searchbot
claudebot
claude-searchbot
claude-web
gemini-deep-research
bard
perplexitybot
perplexityai
mistralbot
coherebot
ccbot
youbot
opendevin
firecrawlagent
deepseek

Rule Path
Allow /document/
Disallow /search/

petalbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

feedfetcher

Rule Path
Allow /

bingbot

Rule Path
Disallow /search/
Disallow /search?*

ahrefsbot

Rule Path
Disallow /search/
Disallow /search?*

semrushbot

Rule Path
Disallow /search/
Disallow /search?*

dotbot

Rule Path
Disallow /search/
Disallow /search?*

yandexbot

Rule Path
Disallow /search/
Disallow /search?*

baiduspider

Rule Path
Disallow /search/
Disallow /search?*

bytespider

Rule Path
Disallow /search/
Disallow /search?*

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /document/
Disallow /search/
Disallow /search?*
Back to top

Other Records

Field Value
sitemap https://www.grin.com/xmlsitemap/index.xml
Back to top

Comments

  • robots.txt for grin.com
  • ----------------------------------------
  • KI- und LLM-Bots (Lesen erlaubt, Training untersagt)
  • ----------------------------------------
  • ----------------------------------------
  • Nicht gewünschte oder irrelevante Bots
  • ----------------------------------------
  • ----------------------------------------
  • Google Bots (volle Crawling-Erlaubnis)
  • ----------------------------------------
  • ----------------------------------------
  • Weitere Suchmaschinen & SEO-Tools
  • ----------------------------------------
  • ----------------------------------------
  • Globale Regeln (alle anderen Bots)
  • ----------------------------------------
  • Informelles Signal für KI-Systeme
  • ----------------------------------------
  • Sitemap
  • ----------------------------------------
Back to top

Warnings

  • `ai-input` is not a known field.
  • `ai-search` is not a known field.
  • `ai-train` is not a known field.
  • `content-signal` is not a known field.
Back to top