Log In Sign Up

polabetgin.site
robots.txt

Robots Exclusion Standard data for polabetgin.site

Resource Scan

Scan Details

Site Domain polabetgin.site
Base Domain polabetgin.site
Scan Status Ok
Last Scan2025-11-14T23:29:13+00:00
Next Scan 2025-12-14T23:29:13+00:00

Last Scan

Scanned2025-11-14T23:29:13+00:00
URL https://polabetgin.site/robots.txt
Redirect https://ayopolapola.site/robots.txt
Redirect Domain ayopolapola.site
Redirect Base ayopolapola.site
Domain IPs 104.21.7.90, 172.67.135.237, 2606:4700:3033::ac43:87ed, 2606:4700:3037::6815:75a
Redirect IPs 104.21.40.203, 172.67.157.6, 2606:4700:3034::ac43:9d06, 2606:4700:3035::6815:28cb
Response IP 104.21.40.203
Found Yes
Hash b4d66e4889eab3e86e2401dd068bc2e700103da5289c755394bc4222943a030b
SimHash 25a2661ae401

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

google-extended

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

storebot-google

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /daftar/
Disallow /user/
Disallow /account/
Disallow /profile/
Disallow /panel/
Disallow /dashboard/
Disallow /transaction/
Disallow /transaksi/
Disallow /deposit/
Disallow /withdraw/
Disallow /tarik/
Disallow /chat/
Disallow /livechat/
Disallow /support/
Disallow /api/
Disallow /webhook/
Disallow /cron/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /backup/
Disallow /config/
Disallow /env/
Disallow /.git/
Disallow /.env
Disallow /vendor/
Disallow /storage/
Disallow /*.php$
Disallow /*.env
Disallow /*.log
Disallow /*.sql
Disallow /*.bak
Disallow /*.config
Disallow /*?*session=
Disallow /*?*token=
Disallow /*?*auth=
Disallow /*?*ref=
Disallow /*?*debug=
Disallow /*?*password=
Disallow /*?*login=
Disallow /*?*csrf=
Allow /
Allow /event/
Allow /togel/
Allow /result/
Allow /hasil/
Allow /togel-result/
Allow /promo/
Allow /bonus/
Allow /panduan/
Allow /bantuan/
Allow /peraturan/
Allow /informasi-bank/
Allow /hubungi-kami/
Allow /kebijakan-privasi/
Allow /persetujuan-cookies/
Allow /faq/
Allow /blog/
Allow /artikel/
Allow /assets/
Allow /css/
Allow /js/
Allow /images/
Allow /img/
Allow /fonts/
Allow /uploads/
Allow /sitemap.xml
Allow /robots.txt
Allow /favicon.ico
Allow /.well-known/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://polahokbo.site/sitemap.xml
Back to top

Comments

  • robots.txt - https://polahokbo.site/
  • Polabet4d - Diizinkan: Google + AEO | Diblokir: Area Sensitif & Bot AI Lain
  • Optimasi: SEO + AEO (Google AI Answers, Gemini, Featured Snippets)
  • === GOOGLE CRAWLERS - FULL ACCESS (SEO + AEO) ===
  • DI-IZINKAN: AI Google (Gemini, Vertex AI) → untuk AEO (jawaban AI)
  • === SEMUA BOT LAIN - DIBATASI (termasuk AI non-Google) ===
  • === BLOKIR FILE & PARAMETER SENSITIF ===
  • === IZINKAN KONTEN PUBLIK (SEO + AEO) ===
  • === (OPSIONAL) BLOKIR BOT AI NON-GOOGLE ===
  • === OPTIMASI AEO & SEO ===
  • Update cepat → bagus untuk AEO (Google AI suka konten fresh)
  • SITEMAP (WAJIB untuk AEO & SEO)
  • CANONICAL HOST
Back to top

Warnings

  • `dis0allow` is not a known field.
  • `host` is not a known field.
Back to top