english.kontan.co.id
robots.txt

Robots Exclusion Standard data for english.kontan.co.id

Resource Scan

Scan Details

Site Domain english.kontan.co.id
Base Domain kontan.co.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-23T12:49:17+00:00
Next Scan 2024-06-21T12:49:17+00:00

Last Successful Scan

Scanned2023-08-04T08:48:22+00:00
URL https://english.kontan.co.id/robots.txt
Domain IPs 18.155.68.125, 18.155.68.49, 18.155.68.79, 18.155.68.87
Response IP 18.155.68.79
Found Yes
Hash 9a2b8f21f14bc3ce0bbff2a7dbd0b26136264a7e229e0c68c981b1112ebc0af6
SimHash 0144d742c711

Groups

*

Rule Path
Allow /
Disallow /ajax/more_rubrik
Disallow /dable/recommendations

ia_archiver

Rule Path
Disallow /ajax/more_rubrik
Disallow /dable/recommendations