Log In Sign Up

mellow.tel
robots.txt

Robots Exclusion Standard data for mellow.tel

Resource Scan

Scan Details

Site Domain mellow.tel
Base Domain mellow.tel
Scan Status Ok
Last Scan2025-11-29T09:02:02+00:00
Next Scan 2025-12-29T09:02:02+00:00

Last Scan

Scanned2025-11-29T09:02:02+00:00
URL https://mellow.tel/robots.txt
Redirect https://www.mellow.tel/robots.txt
Redirect Domain www.mellow.tel
Redirect Base mellow.tel
Domain IPs 2600:9000:210b:2400:11:4da9:8000:93a1, 2600:9000:210b:6c00:11:4da9:8000:93a1, 2600:9000:210b:7800:11:4da9:8000:93a1, 2600:9000:210b:9200:11:4da9:8000:93a1, 2600:9000:210b:9a00:11:4da9:8000:93a1, 2600:9000:210b:a00:11:4da9:8000:93a1, 2600:9000:210b:bc00:11:4da9:8000:93a1, 2600:9000:210b:ce00:11:4da9:8000:93a1, 54.192.100.128, 54.192.100.21, 54.192.100.83, 54.192.100.89
Redirect IPs 2600:9000:28c2:1a00:11:4da9:8000:93a1, 2600:9000:28c2:2800:11:4da9:8000:93a1, 2600:9000:28c2:3600:11:4da9:8000:93a1, 2600:9000:28c2:9200:11:4da9:8000:93a1, 2600:9000:28c2:9400:11:4da9:8000:93a1, 2600:9000:28c2:c200:11:4da9:8000:93a1, 2600:9000:28c2:da00:11:4da9:8000:93a1, 2600:9000:28c2:f200:11:4da9:8000:93a1, 3.171.198.10, 3.171.198.112, 3.171.198.53, 3.171.198.56
Response IP 3.171.198.53
Found Yes
Hash 1eb43988dcf46461153b467a5206e4ab40edff64c2fb55bbd45b164bb15c69aa
SimHash 69149211e7e4

Groups

*

Rule Path
Allow /
Allow /blog/
Allow /blog/monetize-your-chrome-extension-a-practical-guide

Other Records

Field Value
crawl-delay 1

athenahq-bot

Rule Path
Allow /

gptbot

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

chatgpt-user

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

oai-searchbot

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

perplexitybot

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

perplexity-user

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

claudebot

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

bingbot

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

google-extended

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/

*

Rule Path
Allow /
Allow /blog/
Allow /about/
Allow /docs/
Allow /auth/
Allow /dashboard/
Allow /user-control/
Disallow /settings/
Disallow /opt-in/
Back to top

Other Records

Field Value
sitemap https://www.mellowtel.com/sitemap.xml
Back to top

Comments

  • https://www.mellowtel.com/robots.txt
  • Allow all crawlers
  • Sitemaps
  • Optimize crawl rate
  • AthenaHQ Bot Configuration
  • AI Bot Configurations
  • OpenAI GPTBot configuration (for AI model training)
  • ChatGPT user browsing configuration
  • OpenAI search configuration
  • Perplexity search configuration
  • Perplexity user browsing configuration
  • Anthropic Claude configuration
  • Microsoft Bing/Copilot configuration
  • Google-Extended configuration (for Google AI models and services)
  • Standard search bots
  • LLM policy
Back to top

Warnings

  • `llm-policy` is not a known field.
Back to top