Log In Sign Up

synout.co.za
robots.txt

Robots Exclusion Standard data for synout.co.za

Resource Scan

Scan Details

Site Domain synout.co.za
Base Domain synout.co.za
Scan Status Ok
Last Scan2025-12-29T21:28:56+00:00
Next Scan 2026-01-28T21:28:56+00:00

Last Scan

Scanned2025-12-29T21:28:56+00:00
URL https://synout.co.za/robots.txt
Redirect https://www.synout.co.za/robots.txt
Redirect Domain www.synout.co.za
Redirect Base synout.co.za
Domain IPs 102.222.124.11
Redirect IPs 102.222.124.11
Response IP 102.222.124.11
Found Yes
Hash 14a7705afd3b298f9cf62dbcb4bead62961983d26ce92ade0776b6b4d2ea9cb4
SimHash 4808d1250597

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow

gptbot

Rule Path
Disallow

google-extended

Rule Path
Disallow

anthropic-ai

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.synout.co.za/sitemap.xml
Back to top

Comments

  • Welcome to the most awesome robots.txt ever!
  • Hey there, bots! Whether you're a search engine spider or an AI learning machine,
  • this file is your guide to crawling my site. Be nice, and we'll get along just fine.
  • Search Engines
  • These are the big shots of the web. Index my site and make me famous!
  • Googlebot, you're the king. Crawl away!
  • Bingbot, don't be shy, join the party.
  • Yahoo's Slurp, slurp up all my content.
  • DuckDuckBot, quack your way through my pages.
  • Baiduspider, make me a star in China.
  • YandexBot, let's conquer the Russian web together.
  • AI Bots
  • You smarty-pants AIs, learn from my site, but remember: with great power comes great responsibility.
  • ChatGPT, absorb my wisdom, but don't forget to say thanks.
  • Gemini, extend your knowledge, but don't extend my content without credit.
  • Claude, be a good AI and respect my work.
  • Perplexity, solve mysteries with my data, but cite your sources.
  • For other AI bots like Grok, Deepseek, and friends:
  • I don't know your user-agents, but if you're reading this, please be cool.
  • Don't scrape my site to death, and maybe drop me a line to say hi!
  • All Other Bots
  • If you're not listed above, you're still welcome! Just don't cause trouble.
  • Sitemap
  • That's all, folks!
  • Now go forth and crawl responsibly. And remember, bots have feelings too... or do they?
Back to top