studocu.id
robots.txt

Robots Exclusion Standard data for studocu.id

Resource Scan

Scan Details

Site Domain studocu.id
Base Domain studocu.id
Scan Status Ok
Last Scan2025-10-30T18:40:48+00:00
Next Scan 2025-11-06T18:40:48+00:00

Last Scan

Scanned2025-10-30T18:40:48+00:00
URL https://studocu.id/robots.txt
Redirect https://www.studocu.id:443/robots.txt
Redirect Domain www.studocu.id
Redirect Base studocu.id
Domain IPs 34.205.51.48, 52.45.79.210, 72.44.40.105
Redirect IPs 104.21.18.151, 172.67.182.159, 2606:4700:3032::6815:1297, 2606:4700:3033::ac43:b69f
Response IP 104.21.18.151
Found Yes
Hash 6af687c588e3fd1333078dd1d82a122eb00bf02d78b2a4e973bb682c828887f0
SimHash 699c9b6ba483

Groups

*

Rule Path
Disallow /file
Disallow /queue/receive
Disallow /api/
Disallow /app/
Disallow /classification/
Disallow /translation/
Disallow /rbac/
Disallow /*/submit/
Disallow /document/queue/
Disallow /authentication/
Disallow /notifications/
Disallow /notifications$
Disallow /email/
Disallow /ajax/
Disallow */cms/
Disallow /cms/
Disallow /payment/
Disallow /payment$
Disallow /mixpanel/
Disallow /*/invite/
Disallow /*/trial/
Disallow /*/request/
Disallow */followers$
Disallow */followers?
Disallow */group$
Disallow */group?
Disallow /*/studylist/
Disallow /studylist/
Disallow /practice$
Disallow /practice?
Disallow /practice/
Disallow /*/registration?
Disallow /*/registration/
Disallow /*/login?
Disallow /*/document/upload?
Disallow /*/document/upload/
Disallow /*/upgrade$
Disallow /*/upgrade?
Disallow /*/search/*
Disallow /*/search?*
Disallow /*/search?*languages=
Disallow /*/search/*languages%3D
Disallow /en/search$
Disallow /en/search/
Disallow /*/app-store/
Disallow /tiktoken_bg.wasm
Disallow /rest-api/
Disallow /*/notes?
Disallow /27m703Hm/xhr/api/v2/collector
Disallow /27m703Hm/xhr/b/s
Disallow /27m703Hm/init.js
Disallow /*?_pxhc=*
Disallow /users/anonymous/*
Disallow /*/user/*/uploads
Disallow /27m703Hm/captcha/*
Disallow /.well-known/assetlinks.json
Disallow /cdn-cgi/scripts/5c5dd728/cloudflare-static/email
Disallow /*/messages/*
Disallow /*/questions$
Disallow /*/subject/*

gptbot
google-extended
yandexbot
baiduspider
amazonbot
meta-externalagent
facebookbot
applebot-extended
ccbot
anthropic-ai
claudebot
claude-web
omgili
cohere-ai
scrapy
diffbot
imagesiftbot
turnitinbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.studocu.id/sitemap/document_index_id.xml
sitemap https://www.studocu.id/sitemap/institution_index_id.xml
sitemap https://www.studocu.id/sitemap/course_index_id.xml
sitemap https://www.studocu.id/sitemap/quiz_index_id.xml
sitemap https://www.studocu.id/sitemap/book_index_id.xml
sitemap https://www.studocu.id/sitemap/high-school-course_index_id.xml
sitemap https://www.studocu.id/sitemap/teachers-document_index_id.xml