Log In Sign Up

travel.okezone.com
robots.txt

Robots Exclusion Standard data for travel.okezone.com

Resource Scan

Scan Details

Site Domain travel.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-04-24T14:36:16+00:00
Next Scan 2024-05-24T14:36:16+00:00

Last Scan

Scanned2024-04-24T14:36:16+00:00
URL https://travel.okezone.com/robots.txt
Domain IPs 108.156.133.115, 108.156.133.43, 108.156.133.45, 108.156.133.52, 2600:9000:2755:2c00:1:f7c0:d180:93a1, 2600:9000:2755:3000:1:f7c0:d180:93a1, 2600:9000:2755:4e00:1:f7c0:d180:93a1, 2600:9000:2755:6000:1:f7c0:d180:93a1, 2600:9000:2755:8800:1:f7c0:d180:93a1, 2600:9000:2755:b800:1:f7c0:d180:93a1, 2600:9000:2755:c200:1:f7c0:d180:93a1, 2600:9000:2755:cc00:1:f7c0:d180:93a1
Response IP 108.156.133.43
Found Yes
Hash 5ab50fd367cbc5e636d99018ac5df9bca63bebe130a7ad04f3c83577d7adf884
SimHash 4a295891afa3

Groups

*

Rule Path
Disallow /rc.php?*
Disallow /no-cache/*
Disallow /more/*
Disallow /mmore/*
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie
Back to top

Other Records

Field Value
sitemap https://travel.okezone.com/sitemap.xml
Back to top