Log In Sign Up

neurotrainer.it
robots.txt

Robots Exclusion Standard data for neurotrainer.it

Resource Scan

Scan Details

Site Domain neurotrainer.it
Base Domain neurotrainer.it
Scan Status Ok
Last Scan2025-04-13T00:58:49+00:00
Next Scan 2025-04-20T00:58:49+00:00

Last Scan

Scanned2025-04-13T00:58:49+00:00
URL https://neurotrainer.it/robots.txt
Domain IPs 2a02:4780:39:6629:49cc:441f:92f8:f69b, 77.37.75.69
Response IP 93.127.187.12
Found Yes
Hash d37cf245ae9015859a1fc67cbe01473824c2bfb28453779cffc52d881c7e35e4
SimHash 0134c8809436

Groups

*

Rule Path
Disallow

google-extended

Rule Path
Allow /

gptbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

youbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://neurotrainer.it/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Explicitly allow Google AI-related bots
  • OpenAI (ChatGPT)
  • Anthropic (Claude)
  • Common Crawl (used by many LLMs)
  • Perplexity AI
  • Amazon's Bot (used for training Titan)
  • Facebook/Meta AI
  • You.com AI search
  • ---------------------------
  • END YOAST BLOCK
Back to top