staging.cliffsnotes.com
robots.txt

Robots Exclusion Standard data for staging.cliffsnotes.com

Resource Scan

Scan Details

Site Domain staging.cliffsnotes.com
Base Domain cliffsnotes.com
Scan Status Ok
Last Scan2024-09-22T23:36:12+00:00
Next Scan 2024-10-22T23:36:12+00:00

Last Scan

Scanned2024-09-22T23:36:12+00:00
URL https://staging.cliffsnotes.com/robots.txt
Domain IPs 54.192.18.109, 54.192.18.117, 54.192.18.126, 54.192.18.35
Response IP 13.35.18.108
Found Yes
Hash 285f8aeb4df158fbd101b6d0bbe37960e510936f76e937e57fa7a68797b83951
SimHash 7e5548526480

Groups

*

Rule Path
Allow /api/v1/textbooks/
Allow /api/v2/search/
Allow /register/?coupon=STUDY40
Disallow */ajax/
Disallow /api/
Disallow /api/call/
Disallow /api/v1/textbooks/*/courses/
Disallow /api/v1/textbooks/exercises/
Disallow /api/v1/textbooks/track*
Disallow /Babout-at-I-daressentlesse-a-crue-an-endone-to-N
Disallow */courses/*?page=
Disallow */dashboard/
Disallow /db.php
Disallow /doc/
Disallow /doc-asset/bg/
Disallow /doc-asset/font/
Disallow /asset/bg/blur/
Disallow */fonts.css
Disallow /educator/free-access/
Disallow /_error/
Disallow /error/404/
Disallow /flashcards/
Disallow */forgot_password.php
Disallow /*?get_doc
Disallow /home/
Disallow /_Incapsula_Resource
Disallow /_lit/
Disallow /loadoriginal.php
Disallow /loadoriginal-reviewer.php
Disallow /loadpdf.php
Disallow /loadpdf-reviewer.php
Disallow /loadswf.php
Disallow /loadswf-reviewer.php
Disallow */manage/tutors/
Disallow /my-account/
Disallow /account/
Disallow /payment/
Disallow /please_wait.php
Disallow */purchase-unlock/
Disallow /qa/expert/
Disallow */qa/wait/
Disallow /qlink.php
Disallow /quiz/document/
Disallow /register/?*
Disallow /search/
Disallow */search_tracker.php
Disallow /_ssi/
Disallow /study-guides/*?s=
Disallow */%7B%5BtakedownUrl%5D%7D
Disallow /taxonomy/widget/
Disallow /textbooks/
Disallow /u/file/
Disallow */unlock-document/
Disallow */unlock-question/
Disallow /upload/
Disallow */view_thumbnail.php
Disallow */wp-login

google-extended
ccbot
gptbot
amazonbot
anthropic-ai
claude-web
claudebot
perplexitybot

Rule Path
Disallow /assets/
Disallow /file/
Disallow /lit/
Disallow /qa/attachment/
Disallow /sg/
Disallow /sitemap/
Disallow /study-guides/
Disallow /subjects/
Disallow /textbook-solutions/
Disallow /tutors-problems/

adsbot-google

Rule Path
Disallow /assets/
Disallow /file/
Disallow /qa/attachment/
Disallow /sg/
Disallow /sitemap/
Disallow /study-guides/
Disallow /subjects/
Disallow /tutors-problems/

yandex

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /popular/

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.coursehero.com/sitemaps/index_coursehero_robots_content.xml

Comments

  • All
  • AIBots
  • Adsbot
  • Yandex
  • Turnitin
  • Common Crawl