megapolitan.okezone.com
robots.txt

Robots Exclusion Standard data for megapolitan.okezone.com

Resource Scan

Scan Details

Site Domain megapolitan.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-08-23T06:30:44+00:00
Next Scan 2024-09-22T06:30:44+00:00

Last Scan

Scanned2024-08-23T06:30:44+00:00
URL https://megapolitan.okezone.com/robots.txt
Domain IPs 104.18.30.212, 104.18.31.212, 2606:4700::6812:1ed4, 2606:4700::6812:1fd4
Response IP 104.18.31.212
Found Yes
Hash 04ccda666b36f5f65eb1478b3094e1643036f932b56975494085b7e294f970c9
SimHash 480d59859fb3

Groups

*

Rule Path
Disallow /rc.php?*
Disallow /more/*
Disallow /mmore/*
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie

Other Records

Field Value
sitemap https://megapolitan.okezone.com/sitemap.xml