Log In Sign Up

simpletiger.com
robots.txt

Robots Exclusion Standard data for simpletiger.com

Resource Scan

Scan Details

Site Domain simpletiger.com
Base Domain simpletiger.com
Scan Status Ok
Last Scan2025-06-25T09:56:01+00:00
Next Scan 2025-07-25T09:56:01+00:00

Last Scan

Scanned2025-06-25T09:56:01+00:00
URL https://simpletiger.com/robots.txt
Redirect https://www.simpletiger.com/robots.txt
Redirect Domain www.simpletiger.com
Redirect Base simpletiger.com
Domain IPs 104.26.10.134, 104.26.11.134, 172.67.70.32, 2606:4700:20::681a:a86, 2606:4700:20::681a:b86, 2606:4700:20::ac43:4620
Redirect IPs 104.26.10.134, 104.26.11.134, 172.67.70.32, 2606:4700:20::681a:a86, 2606:4700:20::681a:b86, 2606:4700:20::ac43:4620
Response IP 172.67.70.32
Found Yes
Hash 5fd74b61e8631057006c76666fe7c24bf5006f8e39a47a9849c3fe4daa1f4dc4
SimHash 735492154665

Groups

athenahq-bot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

google-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.simpletiger.com/sitemap.xml
Back to top

Comments

  • AthenaHQ Bot Configuration
  • AI Bot Configurations
  • OpenAI GPTBot configuration (for AI model training)
  • ChatGPT user browsing configuration
  • OpenAI search configuration
  • Perplexity search configuration
  • Perplexity user browsing configuration
  • Anthropic Claude configuration
  • Microsoft Bing/Copilot configuration
  • Google-Extended configuration (for Google AI models and services)
Back to top