scholarhub.ui.ac.id
robots.txt

Robots Exclusion Standard data for scholarhub.ui.ac.id

Resource Scan

Scan Details

Site Domain scholarhub.ui.ac.id
Base Domain ui.ac.id
Scan Status Ok
Last Scan2025-04-02T08:53:01+00:00
Next Scan 2025-05-02T08:53:01+00:00

Last Scan

Scanned2025-04-02T08:53:01+00:00
URL https://scholarhub.ui.ac.id/robots.txt
Domain IPs 13.57.92.51, 50.18.241.247
Response IP 13.57.92.51
Found Yes
Hash 7cff9d951388f0c45b408799b6b48295205ec64374e05cb0f1fc75e7f4a330b4
SimHash 60dc8c76565b

Groups

popetech-crawlbot

Rule Path
Disallow

popetech-scanbot

Rule Path
Disallow

*

Rule Path
Disallow /cgi/areyousure.cgi
Disallow /cgi/author_dashboard.cgi
Disallow /cgi/author_downloads.cgi
Disallow /cgi/cgs_survey.cgi
Disallow /cgi/confirm.cgi
Disallow /cgi/disciplines.cgi
Disallow /cgi/editor.cgi
Disallow /cgi/errordoc.cgi
Disallow /cgi/help.cgi
Disallow /cgi/institutions.cgi
Disallow /cgi/ir_submit.cgi
Disallow /cgi/login.cgi
Disallow /cgi/mail_assets.cgi
Disallow /cgi/maileditor.cgi
Disallow /cgi/mysubscriptions.cgi
Disallow /cgi/nellco_setup.cgi
Disallow /cgi/notification.cgi
Disallow /cgi/openurl_forwarder.cgi
Disallow /cgi/proquest_setup.cgi
Disallow /cgi/query.cgi
Disallow /cgi/review_history.cgi
Disallow /cgi/site_setup.cgi
Disallow /cgi/submit.cgi
Disallow /cgi/submit_lawreview.cgi
Disallow /cgi/subscription_orders.cgi
Disallow /cgi/subscription_request.cgi
Disallow /cgi/unsubscribe.cgi
Disallow /cgi/upload_additional.cgi
Disallow /cgi/user_subscribe.cgi
Disallow /cgi/useradd.cgi
Disallow /areyousure.cgi
Disallow /author_dashboard.cgi
Disallow /author_downloads.cgi
Disallow /cgs_survey.cgi
Disallow /confirm.cgi
Disallow /disciplines.cgi
Disallow /editor.cgi
Disallow /errordoc.cgi
Disallow /help.cgi
Disallow /institutions.cgi
Disallow /ir_submit.cgi
Disallow /login.cgi
Disallow /mail_assets.cgi
Disallow /maileditor.cgi
Disallow /mysubscriptions.cgi
Disallow /nellco_setup.cgi
Disallow /notification.cgi
Disallow /openurl_forwarder.cgi
Disallow /proquest_setup.cgi
Disallow /query.cgi
Disallow /review_history.cgi
Disallow /site_setup.cgi
Disallow /submit.cgi
Disallow /submit_lawreview.cgi
Disallow /subscription_orders.cgi
Disallow /subscription_request.cgi
Disallow /unsubscribe.cgi
Disallow /upload_additional.cgi
Disallow /user_subscribe.cgi
Disallow /useradd.cgi
Disallow /do/email_editor
Disallow /do/
Disallow /fe-journals/

Other Records

Field Value
sitemap https://scholarhub.ui.ac.id/siteindex.xml
sitemap https://scholarhub.ui.ac.id/exhibit/sitemap.xml

Warnings

  • 2 invalid lines.