techno.okezone.com
robots.txt

Robots Exclusion Standard data for techno.okezone.com

Resource Scan

Scan Details

Site Domain techno.okezone.com
Base Domain okezone.com
Scan Status Ok
Last Scan2024-05-22T01:30:26+00:00
Next Scan 2024-06-21T01:30:26+00:00

Last Scan

Scanned2024-05-22T01:30:26+00:00
URL https://techno.okezone.com/robots.txt
Domain IPs 18.155.68.125, 18.155.68.27, 18.155.68.54, 18.155.68.58, 2600:9000:23d2:1600:f:4e96:3e40:93a1, 2600:9000:23d2:3800:f:4e96:3e40:93a1, 2600:9000:23d2:5200:f:4e96:3e40:93a1, 2600:9000:23d2:600:f:4e96:3e40:93a1, 2600:9000:23d2:9200:f:4e96:3e40:93a1, 2600:9000:23d2:9400:f:4e96:3e40:93a1, 2600:9000:23d2:9a00:f:4e96:3e40:93a1, 2600:9000:23d2:a00:f:4e96:3e40:93a1
Response IP 18.155.68.27
Found Yes
Hash 8ff677a0bfe66bd776624db2b9cf063e7057c38f144387e8a0c60147509acf19
SimHash 4a09d8858fa3

Groups

*

Rule Path
Disallow /rc.php?*
Disallow /more/*
Disallow /mmore/*
Disallow /404_override

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /set-sso*
Disallow /set-alert*
Disallow /set-cookie*
Disallow /set-logout
Disallow /set-profile
Disallow /set-uuid
Disallow /clear-cookie

Other Records

Field Value
sitemap https://techno.okezone.com/sitemap.xml