koran.tempo.co
robots.txt

Robots Exclusion Standard data for koran.tempo.co

Resource Scan

Scan Details

Site Domain koran.tempo.co
Base Domain tempo.co
Scan Status Ok
Last Scan2024-05-19T19:41:43+00:00
Next Scan 2024-06-02T19:41:43+00:00

Last Scan

Scanned2024-05-19T19:41:43+00:00
URL https://koran.tempo.co/robots.txt
Domain IPs 13.33.30.128, 13.33.30.22, 13.33.30.8, 13.33.30.89, 2600:9000:229f:1800:a:8284:6e80:93a1, 2600:9000:229f:2c00:a:8284:6e80:93a1, 2600:9000:229f:4600:a:8284:6e80:93a1, 2600:9000:229f:5c00:a:8284:6e80:93a1, 2600:9000:229f:6400:a:8284:6e80:93a1, 2600:9000:229f:aa00:a:8284:6e80:93a1, 2600:9000:229f:e200:a:8284:6e80:93a1, 2600:9000:229f:e400:a:8284:6e80:93a1
Response IP 13.33.30.128
Found Yes
Hash 27481d5e08eb9d778bfab561423d8ebf90350549bd2f0dc527b76d58128788a2
SimHash 581199752711

Groups

googlebot

Rule Path
Disallow /ajax/
Disallow /search/
Disallow /indeks/

*

Rule Path
Allow /

grapeshot

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://koran.tempo.co/sitemap.xml