Log In Sign Up

okezone.com
robots.txt

Robots Exclusion Standard data for okezone.com

Resource Scan

Scan Details

Site Domain okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-05-04T18:05:39+00:00
Next Scan 2024-05-11T18:05:39+00:00

Last Scan

Scanned2024-05-04T18:05:39+00:00
URL https://okezone.com/robots.txt
Domain IPs 18.64.18.18, 18.64.18.23, 18.64.18.97, 18.64.18.99, 2600:9000:229f:2600:11:8483:ce40:93a1, 2600:9000:229f:3a00:11:8483:ce40:93a1, 2600:9000:229f:400:11:8483:ce40:93a1, 2600:9000:229f:5600:11:8483:ce40:93a1, 2600:9000:229f:8400:11:8483:ce40:93a1, 2600:9000:229f:a00:11:8483:ce40:93a1, 2600:9000:229f:c800:11:8483:ce40:93a1, 2600:9000:229f:ee00:11:8483:ce40:93a1
Response IP 99.84.133.23
Found Yes
Hash e32fa2722a6719d6db21f17eab88a07f7faf00b3d2354d2dcb08cc3ff63f0829
SimHash 4a0959579db5

Groups

googlebot
*

Rule Path
Disallow /okezoneid
Disallow /jadwalsholat/*
Disallow /php/
Disallow /rc.php?*
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Allow /
Back to top

Other Records

Field Value
sitemap https://www.okezone.com/sitemap.xml
sitemap https://www.okezone.com/news/sitemap.xml
Back to top