m.kompas.com
robots.txt

Robots Exclusion Standard data for m.kompas.com

Resource Scan

Scan Details

Site Domain m.kompas.com
Base Domain kompas.com
Scan Status Ok
Last Scan2024-04-22T16:17:54+00:00
Next Scan 2024-05-22T16:17:54+00:00

Last Scan

Scanned2024-04-22T16:17:54+00:00
URL https://m.kompas.com/robots.txt
Redirect https://www.kompas.com:443/robots.txt
Redirect Domain www.kompas.com
Redirect Base kompas.com
Domain IPs 13.33.33.10, 13.33.33.13, 13.33.33.65, 13.33.33.68
Redirect IPs 13.33.33.10, 13.33.33.13, 13.33.33.65, 13.33.33.68
Response IP 13.33.33.68
Found Yes
Hash f4e16a4ed9254e70a819d1c9f3ccc07184ca6930c471a069d2e9f01e357bac47
SimHash 216dfc80e3b3

Groups

*

Rule Path
Disallow /search/?q=
Disallow /komentar/*
Disallow /copy/*
Disallow *?jxrecoid=*
Disallow *?utm_source=*
Disallow *?source=*

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kompas.com/sitemap.xml