english.kontan.co.id
robots.txt
Robots Exclusion Standard data for english.kontan.co.id
Resource Scan
Scan Details
Site Domain | english.kontan.co.id |
Base Domain | kontan.co.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-03-23T12:49:17+00:00 |
Next Scan | 2024-06-21T12:49:17+00:00 |
Last Successful Scan
Scanned | 2023-08-04T08:48:22+00:00 |
URL | https://english.kontan.co.id/robots.txt |
Domain IPs | 18.155.68.125, 18.155.68.49, 18.155.68.79, 18.155.68.87 |
Response IP | 18.155.68.79 |
Found | Yes |
Hash | 9a2b8f21f14bc3ce0bbff2a7dbd0b26136264a7e229e0c68c981b1112ebc0af6 |
SimHash | 0144d742c711 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ajax/more_rubrik |
Disallow | /dable/recommendations |