economy.okezone.com
robots.txt

Robots Exclusion Standard data for economy.okezone.com

Resource Scan

Scan Details

Site Domain economy.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-09-20T13:08:17+00:00
Next Scan 2024-10-20T13:08:17+00:00

Last Scan

Scanned2024-09-20T13:08:17+00:00
URL https://economy.okezone.com/robots.txt
Domain IPs 104.18.30.212, 104.18.31.212, 2606:4700::6812:1ed4, 2606:4700::6812:1fd4
Response IP 104.18.30.212
Found Yes
Hash a7c84a4b00fe6579151b2b09f0869fdf5207a5abb249851dbaf5d55d6a8cf3ac
SimHash 480d58859fb3

Groups

*

Rule Path
Disallow /index.php/ReadStory/
Disallow /index.php/HotPict/
Disallow /rc.php?*
Disallow /beritaanda/*
Disallow /more/*
Disallow /mmore/*
Disallow /beritaandawidget
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie

Other Records

Field Value
sitemap https://economy.okezone.com/sitemap.xml