Log In Sign Up

metomic.io
robots.txt

Robots Exclusion Standard data for metomic.io

Resource Scan

Scan Details

Site Domain metomic.io
Base Domain metomic.io
Scan Status Ok
Last Scan2025-10-22T20:18:36+00:00
Next Scan 2025-11-21T20:18:36+00:00

Last Scan

Scanned2025-10-22T20:18:36+00:00
URL https://metomic.io/robots.txt
Redirect https://www.metomic.io/robots.txt
Redirect Domain www.metomic.io
Redirect Base metomic.io
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 18.211.166.153
Found Yes
Hash 0b626704b695264cd8037f5cb29d19d01ba5aa64d7239c6e29a954c30d1fda0b
SimHash 531643026262

Groups

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

applebot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

ccbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

duckassistbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.metomic.io/sitemap.xml
sitemap https://www.metomic.io/sitemap.xml
Back to top

Comments

  • Google (Google-Extended)
  • Perplexity (PerplexityBot)
  • Anthropic (Anthropic AI Bot)
  • Anthropic (ClaudeBot)
  • Anthropic (Claude Web)
  • Apple (Applebot)
  • Apple (Applebot-Extended)
  • Microsoft (BingBot)
  • ByteDance (Bytespider)
  • Common Crawl (CCBot)
  • OpenAI (ChatGPT-User)
  • OpenAI (GPTBot)
  • OpenAI (OAI-SearchBot)
  • Cohere (cohere-ai)
  • DuckDuckGo (DuckAssistBot)
  • Meta (FacebookBot)
  • Meta (Meta External Fetcher)
Back to top