Log In Sign Up

simptrack.com
robots.txt

Robots Exclusion Standard data for simptrack.com

Resource Scan

Scan Details

Site Domain simptrack.com
Base Domain simptrack.com
Scan Status Ok
Last Scan2025-09-26T18:16:50+00:00
Next Scan 2025-10-26T18:16:50+00:00

Last Scan

Scanned2025-09-26T18:16:50+00:00
URL https://simptrack.com/robots.txt
Domain IPs 85.13.161.240
Response IP 85.13.161.240
Found Yes
Hash e153fbab7c7c94051e21eb46de1b73b4f37f1d07239c959b6722587a51ffe9f4
SimHash 7936da62871a

Groups

*

Rule Path
Disallow

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

googlegemini

Rule Path
Allow /

claudebot

Rule Path
Allow /

llamabot

Rule Path
Allow /

erniebot

Rule Path
Allow /

neevabot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /private/
Disallow /tmp/

*

Rule Path
Allow /wp-content/uploads/
Allow /public/

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

llamabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://attrixus.de/sitemap_index.xml
Back to top

Comments

  • Allgemeiner Zugriff fuer alle Bots (einschließlich Google und Bing)
  • Erlaubnis fuer GPTBot (OpenAI)
  • Erlaubnis fuer PerplexityBot
  • Erlaubnis fuer Google Gemini
  • Erlaubnis fuer Anthropic Claude-Bot (Anthropic AI)
  • Erlaubnis fuer Meta's LLaMA Crawler (Meta AI)
  • Erlaubnis fuer Baidu ERNIE Bot (China)
  • Erlaubnis fuer Neeva AI (Ehemals ein dedizierter KI-Crawler)
  • Optional: Einschränkung fuer sensible Bereiche (gilt fuer alle Bots)
  • Erlaubnis fuer öffentliche und wichtige Verzeichnisse
  • Optional: Crawl-Delay fuer KI-Bots (Serverressourcen schonen)
Back to top