biz.kompas.com
robots.txt

Robots Exclusion Standard data for biz.kompas.com

Resource Scan

Scan Details

Site Domain biz.kompas.com
Base Domain kompas.com
Scan Status Ok
Last Scan2026-02-06T23:53:21+00:00
Next Scan 2026-03-08T23:53:21+00:00

Last Scan

Scanned2026-02-06T23:53:21+00:00
URL https://biz.kompas.com/robots.txt
Domain IPs 2600:9000:2153:2200:11:7a9f:90c0:93a1, 2600:9000:2153:2800:11:7a9f:90c0:93a1, 2600:9000:2153:4a00:11:7a9f:90c0:93a1, 2600:9000:2153:5a00:11:7a9f:90c0:93a1, 2600:9000:2153:8e00:11:7a9f:90c0:93a1, 2600:9000:2153:b400:11:7a9f:90c0:93a1, 2600:9000:2153:c600:11:7a9f:90c0:93a1, 2600:9000:2153:f200:11:7a9f:90c0:93a1, 65.8.76.117, 65.8.76.35, 65.8.76.49, 65.8.76.61
Response IP 65.8.76.49
Found Yes
Hash bb51f0abe041bc0b0b210e146725970b6d2594233520c7ede8030f7e6edc576f
SimHash 7c08113e2ff3

Groups

googlebot-news

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://biz.kompas.com/sitemap.xml

Comments

  • Kompas.com content is made available for your personal, non-commercial
  • use subject to our Terms of Service here:
  • https://inside.kompas.com/term-of-use.
  • Use of any device, tool, or process designed to data mine or scrape the content
  • using automated means is prohibited without prior written permission from
  • PT. Kompas Cyber Media. Prohibited uses include but are not limited to:
  • (1) text and data mining activities;
  • (2) the development of any software, machine learning, artificial intelligence (AI),
  • and/or large language models (LLMs);
  • (3) creating or providing archived or cached data sets containing our content to others; and/or
  • (4) any commercial purposes.
  • Contact https://inside.kompas.com/about-us#meet for assistance.

Warnings

  • 7 invalid lines.