goodreads.com
robots.txt
Robots Exclusion Standard data for goodreads.com
Resource Scan
Scan Details
| Site Domain | goodreads.com |
| Base Domain | goodreads.com |
| Scan Status | Ok |
| Last Scan | 2024-05-11T00:13:06+00:00 |
| Next Scan | 2024-05-18T00:13:06+00:00 |
Last Scan
| Scanned | 2024-05-11T00:13:06+00:00 |
| URL | https://goodreads.com/robots.txt |
| Redirect | https://www.goodreads.com/robots.txt |
| Redirect Domain | www.goodreads.com |
| Redirect Base | goodreads.com |
| Domain IPs | 52.94.226.87, 52.94.237.126, 54.239.26.220 |
| Redirect IPs | 44.215.118.51 |
| Response IP | 44.215.119.15 |
| Found | Yes |
| Hash | ddede0b6f7f3a218a992f521db391ba3ea9673638519fe68450b7c657bb17f35 |
| SimHash | 909b0d4428e2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /about/team_member/ |
| Disallow | /admin |
| Disallow | /api |
| Disallow | /blog/list_rss |
| Disallow | /book/reviews/ |
| Disallow | /book_link/follow/ |
| Disallow | /buy_buttons/ |
| Disallow | /ebooks |
| Disallow | /event/show/ |
| Disallow | /home/index_rss |
| Disallow | /oggiPlayerLoader.htm |
| Disallow | /photo/group/ |
| Disallow | /quotes/list_rss |
| Disallow | /reader |
| Disallow | /review/list_rss |
| Disallow | /review/rate |
| Disallow | /search |
| Disallow | /shelf/user_shelves |
| Disallow | /story |
| Disallow | /tooltips |
| Disallow | /track |
| Disallow | /trivia/answer |
| Disallow | /user/updates_rss |
| Disallow | /videos/ |
| Disallow | /*reviewFilters |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.goodreads.com/siteindex.author.xml |
| sitemap | https://www.goodreads.com/siteindex.author_community_question.xml |
| sitemap | https://www.goodreads.com/siteindex.award.xml |
| sitemap | https://www.goodreads.com/siteindex.blog.xml |
| sitemap | https://www.goodreads.com/siteindex.book_community_question.xml |
| sitemap | https://www.goodreads.com/siteindex.genre.xml |
| sitemap | https://www.goodreads.com/siteindex.giveaway.xml |
| sitemap | https://www.goodreads.com/siteindex.group.xml |
| sitemap | https://www.goodreads.com/siteindex.index.xml |
| sitemap | https://www.goodreads.com/siteindex.interview.xml |
| sitemap | https://www.goodreads.com/siteindex.list.xml |
| sitemap | https://www.goodreads.com/siteindex.quote.xml |
| sitemap | https://www.goodreads.com/siteindex.quote_tag.xml |
| sitemap | https://www.goodreads.com/siteindex.related_work.xml |
| sitemap | https://www.goodreads.com/siteindex.topic.xml |
| sitemap | https://www.goodreads.com/siteindex.user.xml |
Comments