internasional.kontan.co.id
robots.txt
Robots Exclusion Standard data for internasional.kontan.co.id
Resource Scan
Scan Details
Site Domain | internasional.kontan.co.id |
Base Domain | kontan.co.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-22T17:18:01+00:00 |
Next Scan | 2024-09-20T17:18:01+00:00 |
Last Successful Scan
Scanned | 2023-08-05T13:59:23+00:00 |
URL | https://internasional.kontan.co.id/robots.txt |
Domain IPs | 18.155.68.125, 18.155.68.49, 18.155.68.79, 18.155.68.87 |
Response IP | 18.155.68.87 |
Found | Yes |
Hash | 19ee41cbe7133c304d97de4e950c614383e30baac00f706af58dae993184dd55 |
SimHash | e04dd872ab37 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ajax/more_rubrik |
Disallow | /ajax/terbaru_kanal |
Disallow | /ajax/terpopuler |
Disallow | /dable/recommendations |
Other Records
Field | Value |
---|---|
sitemap | https://internasional.kontan.co.id/sitemap.xml |