Log In Sign Up

diksiber.id
robots.txt

Robots Exclusion Standard data for diksiber.id

Resource Scan

Scan Details

Site Domain diksiber.id
Base Domain diksiber.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-30T21:19:40+00:00
Next Scan 2026-01-06T21:19:40+00:00

Last Successful Scan

Scanned2025-12-22T19:40:31+00:00
URL https://diksiber.id/robots.txt
Domain IPs 109.106.252.102
Response IP 109.106.252.102
Found Yes
Hash c26145b304ad88081ae63171148cd241e7f66003f20daf2a2ffad1780e4fe768
SimHash a2805dc02722

Groups

*

Rule Path
Disallow /tag/
Disallow /*/tag/
Disallow /feed/
Disallow /*/feed/
Disallow /comments/
Disallow /comments/feed/
Disallow /*/comments/feed/
Disallow /page/
Disallow /search/
Disallow /*?s=
Disallow /*/amp/
Disallow /*?noamp=
Disallow /*?amp=1
Disallow /trackback/
Disallow /wp-json/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://diksiber.id/sitemap_index.xml
Back to top

Comments

  • ==========================
  • DIKSIBER.ID — OPTIMIZED ROBOTS.TXT
  • ==========================
  • Izinkan Google mengindeks semua halaman utama
  • Allow: /
  • ===== TAG PAGES =====
  • ===== FEEDS =====
  • ===== COMMENTS =====
  • ===== PAGINATION =====
  • (Boleh disallow, tidak penting untuk index)
  • ===== SEARCH & QUERY PAGES =====
  • ===== AMP (Jika tidak digunakan) =====
  • ===== TECHNICAL =====
  • ===== ADMIN =====
  • ===== SITEMAP =====
  • ==========================
  • END
  • ==========================
Back to top