m.okezone.com
robots.txt

Robots Exclusion Standard data for m.okezone.com

Resource Scan

Scan Details

Site Domain m.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-05-01T23:42:51+00:00
Next Scan 2024-05-31T23:42:51+00:00

Last Scan

Scanned2024-05-01T23:42:51+00:00
URL https://m.okezone.com/robots.txt
Redirect https://news.okezone.com:443/robots.txt
Redirect Domain news.okezone.com
Redirect Base okezone.com
Domain IPs 104.18.30.212, 104.18.31.212, 2606:4700::6812:1ed4, 2606:4700::6812:1fd4
Redirect IPs 13.35.18.112, 13.35.18.113, 13.35.18.49, 13.35.18.5, 2600:9000:20c7:2400:1b:a15e:7f40:93a1, 2600:9000:20c7:2a00:1b:a15e:7f40:93a1, 2600:9000:20c7:3c00:1b:a15e:7f40:93a1, 2600:9000:20c7:6600:1b:a15e:7f40:93a1, 2600:9000:20c7:7a00:1b:a15e:7f40:93a1, 2600:9000:20c7:8800:1b:a15e:7f40:93a1, 2600:9000:20c7:a000:1b:a15e:7f40:93a1, 2600:9000:20c7:f600:1b:a15e:7f40:93a1
Response IP 13.35.18.49
Found Yes
Hash c6c377dc9805f8d33a0353f80fb0b6c2a92c179647eb8aa2822016aaeae48d2f
SimHash 482dc8818fb2

Groups

*

Rule Path
Disallow /okezoneid
Disallow /rc.php?*
Disallow /beritaanda/*
Disallow /more/*
Disallow /mmore/*
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie

Other Records

Field Value
sitemap https://news.okezone.com/sitemap.xml
sitemap https://news.okezone.com/sitemap-mobile.xml