Log In Sign Up

autobetyes.site
robots.txt

Robots Exclusion Standard data for autobetyes.site

Resource Scan

Scan Details

Site Domain autobetyes.site
Base Domain autobetyes.site
Scan Status Ok
Last Scan2025-11-17T05:13:04+00:00
Next Scan 2025-12-17T05:13:04+00:00

Last Scan

Scanned2025-11-17T05:13:04+00:00
URL https://autobetyes.site/robots.txt
Redirect https://autocuanpasti.site/robots.txt
Redirect Domain autocuanpasti.site
Redirect Base autocuanpasti.site
Domain IPs 104.21.6.49, 172.67.154.237, 2606:4700:3030::6815:631, 2606:4700:3034::ac43:9aed
Redirect IPs 104.21.37.128, 172.67.208.58, 2606:4700:3034::6815:2580, 2606:4700:3037::ac43:d03a
Response IP 104.21.37.128
Found Yes
Hash 47528a174b613f6770b432b9875cedc867abfca0ea0077200ea84da8cba3d365
SimHash 3da76652e401

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

google-extended

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

storebot-google

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /user/
Disallow /account/
Disallow /profile/
Disallow /panel/
Disallow /cpanel/
Disallow /dashboard/
Disallow /transaction/
Disallow /transaksi/
Disallow /deposit/
Disallow /withdraw/
Disallow /tarik/
Disallow /chat/
Disallow /livechat/
Disallow /support/
Disallow /api/
Disallow /webhook/
Disallow /cron/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /backup/
Disallow /config/
Disallow /env/
Disallow /.git/
Disallow /.env
Disallow /vendor/
Disallow /*.php$
Disallow /*.env
Disallow /*.log
Disallow /*.sql
Disallow /*.bak
Disallow /*.config
Disallow /*?*session=
Disallow /*?*token=
Disallow /*?*auth=
Disallow /*?*ref=
Disallow /*?*debug=
Disallow /*?*password=
Disallow /*?*login=
Allow /
Allow /event/
Allow /togel/
Allow /result/
Allow /hasil/
Allow /promo/
Allow /bonus/
Allow /panduan/
Allow /bantuan/
Allow /peraturan/
Allow /informasi-bank/
Allow /hubungi-kami/
Allow /kebijakan-privasi/
Allow /persetujuan-cookies/
Allow /faq/
Allow /blog/
Allow /artikel/
Allow /assets/
Allow /css/
Allow /js/
Allow /images/
Allow /img/
Allow /fonts/
Allow /uploads/
Allow /sitemap.xml
Allow /robots.txt
Allow /favicon.ico
Allow /.well-known/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://autoyus.site/sitemap.xml
Back to top

Comments

  • robots.txt - https://autoyus.site/
  • AUTOBET4D - Diizinkan: Google + AEO | Diblokir: Area Sensitif & Bot AI Lain
  • Optimasi: SEO + AEO (Google AI Answers, Gemini, Featured Snippets)
  • === GOOGLE CRAWLERS - FULL ACCESS (SEO + AEO) ===
  • DI-IZINKAN: AI Google (Gemini, Vertex AI) → untuk AEO (jawaban AI)
  • === SEMUA BOT LAIN - DIBATASI (termasuk AI non-Google) ===
  • === BLOKIR FILE & PARAMETER SENSITIF ===
  • === IZINKAN KONTEN PUBLIK (SEO + AEO) ===
  • === (OPSIONAL) BLOKIR BOT AI NON-GOOGLE ===
  • === OPTIMASI AEO & SEO ===
  • Cepat update konten → bagus untuk AEO (Google AI suka freshness)
  • SITEMAP (WAJIB untuk AEO & SEO)
  • CANONICAL HOST
Back to top

Warnings

  • `host` is not a known field.
Back to top