celebrity.okezone.com
robots.txt

Robots Exclusion Standard data for celebrity.okezone.com

Resource Scan

Scan Details

Site Domain celebrity.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-04-21T21:21:44+00:00
Next Scan 2024-05-21T21:21:44+00:00

Last Scan

Scanned2024-04-21T21:21:44+00:00
URL https://celebrity.okezone.com/robots.txt
Domain IPs 13.35.18.102, 13.35.18.14, 13.35.18.75, 13.35.18.83, 2600:9000:20c7:3000:6:b5d4:33c0:93a1, 2600:9000:20c7:3200:6:b5d4:33c0:93a1, 2600:9000:20c7:4a00:6:b5d4:33c0:93a1, 2600:9000:20c7:6800:6:b5d4:33c0:93a1, 2600:9000:20c7:6e00:6:b5d4:33c0:93a1, 2600:9000:20c7:8a00:6:b5d4:33c0:93a1, 2600:9000:20c7:aa00:6:b5d4:33c0:93a1, 2600:9000:20c7:f400:6:b5d4:33c0:93a1
Response IP 13.35.18.83
Found Yes
Hash db1ada0cacbd9e84fef1c532a5f4d3666a34cfb6509241c39df63cd43d745995
SimHash 4829d9958fb3

Groups

*

Rule Path
Disallow /rc.php?*
Disallow /more/*
Disallow /mmore/*
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie

Other Records

Field Value
sitemap https://celebrity.okezone.com/sitemap.xml