caritahu.kontan.co.id
robots.txt

Robots Exclusion Standard data for caritahu.kontan.co.id

Resource Scan

Scan Details

Site Domain caritahu.kontan.co.id
Base Domain kontan.co.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-02T09:53:15+00:00
Next Scan 2024-08-31T09:53:15+00:00

Last Successful Scan

Scanned2023-07-16T07:21:37+00:00
URL https://caritahu.kontan.co.id/robots.txt
Domain IPs 18.155.68.113, 18.155.68.17, 18.155.68.26, 18.155.68.4
Response IP 108.139.29.19
Found Yes
Hash 743b5dd224450cd9ac1ac4b7a1776ab378f5ed2c3e1bcb0c5cb2fab47eff2eaa
SimHash 8848db42cb13

Groups

*

Rule Path
Allow /
Disallow /ajax/more_rubrik
Disallow /dable/recommendations