kata.web.id
robots.txt

Robots Exclusion Standard data for kata.web.id

Resource Scan

Scan Details

Site Domain kata.web.id
Base Domain kata.web.id
Scan Status Ok
Last Scan2025-08-30T16:58:26+00:00
Next Scan 2025-09-06T16:58:26+00:00

Last Scan

Scanned2025-08-30T16:58:26+00:00
URL https://kata.web.id/robots.txt
Domain IPs 104.21.62.225, 172.67.139.215, 2606:4700:3034::6815:3ee1, 2606:4700:3037::ac43:8bd7
Response IP 172.67.139.215
Found Yes
Hash caf7caf7985d57e5f56a3d31ea6da95c80c433c4328c3f1e697e01c90920f550
SimHash 58145940a153

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow