Log In Sign Up

sports.okezone.com
robots.txt

Robots Exclusion Standard data for sports.okezone.com

Resource Scan

Scan Details

Site Domain sports.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-05-28T21:18:07+00:00
Next Scan 2024-06-27T21:18:07+00:00

Last Scan

Scanned2024-05-28T21:18:07+00:00
URL https://sports.okezone.com/robots.txt
Domain IPs 108.157.254.106, 108.157.254.110, 108.157.254.112, 108.157.254.92, 2600:9000:2753:4000:b:c41b:49c0:93a1, 2600:9000:2753:4600:b:c41b:49c0:93a1, 2600:9000:2753:4800:b:c41b:49c0:93a1, 2600:9000:2753:8200:b:c41b:49c0:93a1, 2600:9000:2753:ae00:b:c41b:49c0:93a1, 2600:9000:2753:b000:b:c41b:49c0:93a1, 2600:9000:2753:c400:b:c41b:49c0:93a1, 2600:9000:2753:d800:b:c41b:49c0:93a1
Response IP 108.157.254.112
Found Yes
Hash 37192c889f0acfed6aa44428649e0f36b5318de0094c49397260a381e58732de
SimHash 482d59959fb3

Groups

*

Rule Path
Disallow /rc.php?*
Disallow /more/*
Disallow /mmore/*
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie
Back to top

Other Records

Field Value
sitemap https://sports.okezone.com/sitemap.xml
Back to top