gbsecurityday.com
robots.txt
Robots Exclusion Standard data for gbsecurityday.com
Resource Scan
Scan Details
| Site Domain | gbsecurityday.com |
| Base Domain | gbsecurityday.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2026-01-31T23:56:09+00:00 |
| Next Scan | 2026-05-01T23:56:09+00:00 |
Last Successful Scan
| Scanned | 2023-04-13T03:31:23+00:00 |
| URL | https://www.gbsecurityday.com/robots.txt |
| Domain IPs | 104.21.51.160, 172.67.182.130, 2606:4700:3030::6815:33a0, 2606:4700:3034::ac43:b682 |
| Response IP | 172.67.182.130 |
| Found | Yes |
| Hash | dc55623e5487b48c4cf8478ba14a9f1999e5ef7b19ed416daa62f10e384a6e4d |
| SimHash | 929b0dc49ab4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /about/team_member/ |
| Disallow | /admin |
| Disallow | /api |
| Disallow | /blog/list_rss |
| Disallow | /book/reviews/ |
| Disallow | /book_link/follow/ |
| Disallow | /buy_buttons/ |
| Disallow | /ebooks |
| Disallow | /event/show/ |
| Disallow | /home/index_rss |
| Disallow | /oggiPlayerLoader.htm |
| Disallow | /photo/group/ |
| Disallow | /quotes/list_rss |
| Disallow | /reader |
| Disallow | /review/list_rss |
| Disallow | /review/rate |
| Disallow | /shelf/user_shelves |
| Disallow | /story |
| Disallow | /tooltips |
| Disallow | /track |
| Disallow | /trivia/answer |
| Disallow | /user/updates_rss |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.goodreads.com/siteindex.author.xml |
| sitemap | https://www.goodreads.com/siteindex.author_community_question.xml |
| sitemap | https://www.goodreads.com/siteindex.award.xml |
| sitemap | https://www.goodreads.com/siteindex.blog.xml |
| sitemap | https://www.goodreads.com/siteindex.book_community_question.xml |
| sitemap | https://www.goodreads.com/siteindex.genre.xml |
| sitemap | https://www.goodreads.com/siteindex.giveaway.xml |
| sitemap | https://www.goodreads.com/siteindex.group.xml |
| sitemap | https://www.goodreads.com/siteindex.index.xml |
| sitemap | https://www.goodreads.com/siteindex.interview.xml |
| sitemap | https://www.goodreads.com/siteindex.list.xml |
| sitemap | https://www.goodreads.com/siteindex.quote.xml |
| sitemap | https://www.goodreads.com/siteindex.quote_tag.xml |
| sitemap | https://www.goodreads.com/siteindex.related_work.xml |
| sitemap | https://www.goodreads.com/siteindex.topic.xml |
| sitemap | https://www.goodreads.com/siteindex.trivia.xml |
| sitemap | https://www.goodreads.com/siteindex.user.xml |
| sitemap | https://www.goodreads.com/siteindex.video.xml |
Comments