studev.co.id
robots.txt

Robots Exclusion Standard data for studev.co.id

Resource Scan

Scan Details

Site Domain studev.co.id
Base Domain studev.co.id
Scan Status Ok
Last Scan2025-11-19T17:42:18+00:00
Next Scan 2025-11-26T17:42:18+00:00

Last Scan

Scanned2025-11-19T17:42:18+00:00
URL https://studev.co.id/robots.txt
Domain IPs 104.21.38.43, 172.67.218.198, 2606:4700:3034::6815:262b, 2606:4700:3035::ac43:dac6
Response IP 104.21.38.43
Found Yes
Hash 33b9dccde420efcc6a2988be8ca90e29b3a69d93922795756dd07330c97f92f5
SimHash f820cb179f77

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /it-class/
Disallow /portal/
Disallow /sandbox/
Disallow /simulasi/
Disallow /tes-live/
Disallow /dev/
Disallow /course/
Disallow /cart/
Disallow /daftar/
Disallow /mail/
Disallow /cdn-cgi/
Disallow /kursus-bahasa/
Disallow /public/assets/
Disallow /kursus-ielts-online?*
Disallow /kursus-bahasa-inggris-online?*
Disallow /kursus-toefl-online?*
Disallow /bimbingan-beasiswa?*

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://studev.co.id/sitemap.xml