klobility.id
robots.txt

Robots Exclusion Standard data for klobility.id

Resource Scan

Scan Details

Site Domain klobility.id
Base Domain klobility.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-31T16:22:57+00:00
Next Scan 2025-06-29T16:22:57+00:00

Last Successful Scan

Scanned2024-12-02T11:22:32+00:00
URL https://klobility.id/robots.txt
Domain IPs 104.21.34.163, 172.67.163.18, 2606:4700:3030::ac43:a312, 2606:4700:3033::6815:22a3
Response IP 104.21.34.163
Found Yes
Hash f651214a16fc44f9ae7d594675c4f14a33a67eb3fec8333944474f355218b6ae
SimHash 6a7d5840e233

Groups

*

Rule Path
Disallow
Disallow /page/
Disallow /tag/
Disallow /wp-admin/
Disallow /?s=*
Disallow /search*
Disallow /*preview%3Dtrue
Disallow /*theme_preview%3Dtrue

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

Other Records

Field Value
sitemap https://klobility.id/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK