dedoho.pw
robots.txt

Robots Exclusion Standard data for dedoho.pw

Resource Scan

Scan Details

Site Domain dedoho.pw
Base Domain dedoho.pw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-03T19:08:05+00:00
Next Scan 2025-10-04T19:08:05+00:00

Last Successful Scan

Scanned2025-09-19T05:54:35+00:00
URL https://dedoho.pw/robots.txt
Domain IPs 104.21.14.128, 172.67.159.40, 2606:4700:3035::6815:e80, 2606:4700:3037::ac43:9f28
Response IP 104.21.14.128
Found Yes
Hash f9d25e2cc6410ecfbf5fc95cb0f391b3d31eac3a39d42b950781bce731643b6c
SimHash 6028ca40edf6

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /wp-json/rankmath/v1/updateCheck
Disallow /search/*
Disallow /*?s=
Disallow /*reviews-page%3D*

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dedoho.pw/sitemap_index.xml

Comments

  • Global rules
  • -----------------
  • Prevent search result spam
  • -----------------
  • Blok semua URL "search pretty"
  • Blok semua URL dengan parameter ?s=
  • Prevent review pagination spam
  • -----------------
  • Blok semua URL dengan parameter reviews-page= di mana saja
  • Cloudflare Managed Robots.txt to block AI related bots - START
  • -----------------
  • Cloudflare Managed Robots.txt to block AI related bots - END
  • Sitemap
  • -----------------