community.focus-entmt.com
robots.txt

Robots Exclusion Standard data for community.focus-entmt.com

Resource Scan

Scan Details

Site Domain community.focus-entmt.com
Base Domain focus-entmt.com
Scan Status Ok
Last Scan2025-12-29T18:12:41+00:00
Next Scan 2026-01-28T18:12:41+00:00

Last Scan

Scanned2025-12-29T18:12:41+00:00
URL https://community.focus-entmt.com/robots.txt
Domain IPs 2600:9000:28c2:1600:5:27f4:9b00:93a1, 2600:9000:28c2:1800:5:27f4:9b00:93a1, 2600:9000:28c2:2e00:5:27f4:9b00:93a1, 2600:9000:28c2:4600:5:27f4:9b00:93a1, 2600:9000:28c2:5600:5:27f4:9b00:93a1, 2600:9000:28c2:ae00:5:27f4:9b00:93a1, 2600:9000:28c2:d000:5:27f4:9b00:93a1, 2600:9000:28c2:f400:5:27f4:9b00:93a1, 3.171.198.11, 3.171.198.113, 3.171.198.84, 3.171.198.88
Response IP 3.171.198.88
Found Yes
Hash 82a7ea4c66490ce963f69f16ff96492892ee9b70b25a33a9a0aaf734daca43a2
SimHash 203cd920cc44

Groups

*

Rule Path
Allow /
Disallow /profile/
Disallow /leaderboard/
Disallow /moderation-dashboard/
Disallow /account/
Disallow /404/
Disallow /*?page=*
Disallow /*?term=*
Disallow /*?descriptor=*
Disallow /*?status=*
Disallow /*?tag=*
Disallow /*?sort=*
Disallow /*?redirect=*
Disallow /*?send=*
Disallow /*?category=*
Disallow /*?type=*
Disallow /*?universe=*

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • OpenAi
  • Anthropic Ai
  • Google Bard/Gemini and Vertex AI
  • Common crawl

Warnings

  • `‍user-agent` is not a known field.