studysoup.com
robots.txt

Robots Exclusion Standard data for studysoup.com

Resource Scan

Scan Details

Site Domain studysoup.com
Base Domain studysoup.com
Scan Status Ok
Last Scan2024-05-28T16:44:10+00:00
Next Scan 2024-06-04T16:44:10+00:00

Last Scan

Scanned2024-05-28T16:44:10+00:00
URL https://studysoup.com/robots.txt
Domain IPs 54.189.254.180
Response IP 54.189.254.180
Found Yes
Hash a69d2c3549510081a78f178321183d3e7031c5bfc4275a4baecfcbe42fd85a35
SimHash 2208d8032b33

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /a/
Disallow /s/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /a/
Disallow /s/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /a/
Disallow /s/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /a/
Disallow /s/

Other Records

Field Value
sitemap https://studysoup.com/sitemap.xml.gz

Comments

  • Disallow: /cdn/
  • Disallow: /marketplace/search
  • Disallow: /marketplace/buy_now
  • Disallow: /users/auth/facebook