Log In Sign Up

manado.kompas.com
robots.txt

Robots Exclusion Standard data for manado.kompas.com

Resource Scan

Scan Details

Site Domain manado.kompas.com
Base Domain kompas.com
Scan Status Ok
Last Scan2024-10-20T10:28:15+00:00
Next Scan 2024-11-03T10:28:15+00:00

Last Scan

Scanned2024-10-20T10:28:15+00:00
URL https://manado.kompas.com/robots.txt
Domain IPs 13.33.88.101, 13.33.88.104, 13.33.88.46, 13.33.88.51, 2600:9000:223b:3a00:c:97e9:7080:93a1, 2600:9000:223b:4800:c:97e9:7080:93a1, 2600:9000:223b:7e00:c:97e9:7080:93a1, 2600:9000:223b:8000:c:97e9:7080:93a1, 2600:9000:223b:8c00:c:97e9:7080:93a1, 2600:9000:223b:a400:c:97e9:7080:93a1, 2600:9000:223b:ee00:c:97e9:7080:93a1, 2600:9000:223b:f200:c:97e9:7080:93a1
Response IP 13.33.88.46
Found Yes
Hash 06cb98d0b5c63b0c84b9da0c86d0440d46bc6a39aff66ee64f52a9cf375d670f
SimHash 7115fcd0ef33

Groups

gptbot

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

*

Rule Path
Disallow /search/?q=
Disallow /komentar/*
Disallow /copy/*
Disallow *?jxrecoid=*
Disallow *?utm_source=*
Disallow *?source=*
Back to top

Other Records

Field Value
sitemap https://nasional.kompas.com/sitemap.xml
sitemap https://regional.kompas.com/sitemap.xml
sitemap https://megapolitan.kompas.com/sitemap.xml
Back to top