Log In Sign Up

w9.com.tr
robots.txt

Robots Exclusion Standard data for w9.com.tr

Resource Scan

Scan Details

Site Domain w9.com.tr
Base Domain w9.com.tr
Scan Status Ok
Last Scan2026-01-20T19:13:41+00:00
Next Scan 2026-02-03T19:13:41+00:00

Last Scan

Scanned2026-01-20T19:13:41+00:00
URL https://w9.com.tr/robots.txt
Domain IPs 104.21.50.17, 172.67.199.61, 2606:4700:3034::6815:3211, 2606:4700:3036::ac43:c73d
Response IP 104.21.50.17
Found Yes
Hash 9153a08a9f05a71d7ac5b4bc0292cda08d961894bc4e44bf5c0159b122664d80
SimHash 49145220874f

Groups

*

Rule Path
Disallow /yonetim
Disallow /hesabim
Disallow /en/myaccount
Disallow /cdn-cgi/
Disallow /trackback/
Disallow /cgi-bin/
Disallow /?s=
Disallow /?NA
Disallow /genel-servis-sartlari
Disallow /en/general-terms-of-service
Disallow /alan-adi-kayit-sozlesmesi
Disallow /en/domain-name-registration-agreement
Disallow /bayi-hosting-hizmet-sozlesmesi
Disallow /en/reseller-hosting-service-agreement
Disallow /e-posta-barindirma-sozlesmesi
Disallow /en/email-hosting-agreement
Disallow /wordpress-sozlesmesi
Disallow /en/wordpress-agreement
Disallow /sunucu-kiralama-sozlesmesi
Disallow /en/server-rental-agreement
Disallow /web-hosting-hizmet-sozlesmesi
Disallow /en/web-hosting-service-agreement
Disallow /kvkk-aydinlatma-metni
Disallow /en/kvkk-information-text
Disallow /iptal-iade-politikasi
Disallow /en/cancellation-refund-policy
Disallow /cerez-aydinlatma-metni
Disallow /en/cookie-policy
Disallow /hizmet-ve-kullanim-sozlesmesi
Disallow /en/service-and-use-agreement
Disallow /kisisel-veriler-ve-genel-gizlilik-sozlesmesi
Disallow /en/personal-data-and-general-privacy-agreement
Disallow /e-ticaret-barindirma
Disallow /en/e-commerce-hosting-agreement

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

youbot

Rule Path
Allow /

neevabot

Rule Path
Allow /

andi

Rule Path
Allow /

coherebot

Rule Path
Allow /

alephalphabot

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

watson-discovery

Rule Path
Allow /

mojeekbot

Rule Path
Allow /

kagi-bot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

facebookbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://w9.com.tr/sitemap.xml
Back to top

Comments

  • GENEL BOT AYARI
  • AI BOT's
  • OpenAI ChatGPT
  • OpenAI ChatGPT
  • Anthropic Claude
  • Google Gemini
  • Perplexity AI
  • Amazon AI
  • Common Crawl (LLM's Using)
  • You.com AI
  • NeevaAI
  • Andi AI
  • cohere.ai (LLM API)
  • Aleph Alpha
  • Sogou AI
  • Yandex AI
  • Baidu AI
  • DuckDuckGo AI
  • IBM Watson Discovery Bot
  • Mojeek AI
  • Kagi Search Bot (Kagi AI)
  • Archive.org
  • Meta AI
  • SITE MAP
Back to top