domestika.org
robots.txt

Robots Exclusion Standard data for domestika.org

Resource Scan

Scan Details

Site Domain domestika.org
Base Domain domestika.org
Scan Status Ok
Last Scan2024-05-19T17:08:26+00:00
Next Scan 2024-06-02T17:08:26+00:00

Last Scan

Scanned2024-05-19T17:08:26+00:00
URL https://domestika.org/robots.txt
Redirect https://www.domestika.org:443/robots.txt
Redirect Domain www.domestika.org
Redirect Base domestika.org
Domain IPs 18.155.68.114, 18.155.68.41, 18.155.68.51, 18.155.68.92
Redirect IPs 18.155.68.114, 18.155.68.41, 18.155.68.51, 18.155.68.92
Response IP 18.155.68.114
Found Yes
Hash e04ec936ccff114fa0a74ec6f233e32b86e583e42ddf0975ec337e69567f8c02
SimHash f7dfce0a6b98

Groups

*

Rule Path
Disallow */courses/l/*
Disallow /*/account
Disallow /*/dashboard
Disallow /*/invites
Disallow /*/projects/new
Disallow /*/projects/edit
Disallow /*/projects/publish
Disallow /*/topics/new
Disallow /*/forums/*/topics/new
Disallow /*/forums/*/topics/*/posts/new
Disallow /*/forums/*/topics/*/posts/*/edit
Disallow /*/courses/*/community/forum/topics/new
Disallow /*/courses/*/community/forum/topics/*/edit
Disallow /*/courses/*/community/forum/topics/*/posts/*/edit
Disallow /*/courses/*/admin
Disallow /*/jobs/new
Disallow /*/jobs/*/edit
Disallow /*/projects/*/like
Disallow /*/projects/*/favourite
Disallow /*/courses/*/purchase
Disallow /*/courses/*/gift
Disallow /*/courses/*/redeem
Disallow /*/courses/*/add_to_cart
Disallow */share
Disallow /*/login.js
Disallow /*/signup.js
Disallow /*/cart/*
Disallow /*/change_languages
Disallow /courses/course
Disallow /courses/course/unit/*
Disallow /courses/course/contents
Disallow /courses/course/projects
Disallow /courses/course/final-project
Disallow /courses/course/activity
Disallow /courses/course/admin
Disallow /courses/course/forum
Disallow /courses/course/forum/topic
Disallow /courses/course/topic/post
Disallow /courses/course/topic/edit
Disallow /courses/course/students
Disallow /interstitial
Disallow /cart
Disallow /checkout
Disallow /checkout/thank-you
Disallow /home
Disallow /users/user/who_to_follow
Disallow /jobs/offer
Disallow /job-offer/post
Disallow /job-offer/edit
Disallow /page/about
Disallow /page/contact
Disallow /page/terms
Disallow /page/privacy
Disallow /projects/project
Disallow /projects/post
Disallow /projects/edit
Disallow /projects/edit/details
Disallow /forums/forum
Disallow /forums/forum/topic
Disallow /topic/post
Disallow /topic/edit
Disallow /users/user
Disallow /users/user/projects
Disallow /users/user/favourites
Disallow /users/user/activity
Disallow /users/user/courses
Disallow /gift_codes/*
Disallow /interstitial
Disallow *atag%3D*
Disallow /api/*

moget
ichiro
yeti
youdaobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.domestika.org/sitemapindex.xml

Comments

  • Faceted/Sorting navigation
  • Disallow: *area=*
  • Disallow: *sorting=*
  • Disallow: *date=*
  • Disallow: *status=*
  • Disallow: /auth
  • Disallow: */search
  • Virtual URLs - Custom tracking