rock.rapgenius.com
robots.txt
Robots Exclusion Standard data for rock.rapgenius.com
Resource Scan
Scan Details
| Site Domain | rock.rapgenius.com |
| Base Domain | rapgenius.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-10T22:19:24+00:00 |
| Next Scan | 2024-11-17T22:19:24+00:00 |
Last Successful Scan
| Scanned | 2024-04-13T10:13:16+00:00 |
| URL | http://rock.rapgenius.com/robots.txt |
| Redirect | https://genius.com/robots.txt |
| Redirect Domain | genius.com |
| Redirect Base | genius.com |
| Domain IPs | 23.22.144.165, 23.22.52.7, 3.216.88.24, 3.219.96.23 |
| Redirect IPs | 104.18.22.208, 104.18.23.208, 2606:4700::6812:16d0, 2606:4700::6812:17d0 |
| Response IP | 104.18.22.208 |
| Found | Yes |
| Hash | 35edc35ecb676a19c9276d3a022508690775a0152f9f9d401047d91e74321b5f |
| SimHash | ee58e88caf06 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /songs/*/metadata |
| Disallow | /songs/*/comments |
| Disallow | /users/*/top_artist_iq_rank |
| Disallow | /artists/*/top_iq_earners |
| Disallow | /comments/for_profile_page |
| Disallow | /bagon/* |
| Disallow | /mecha/* |
| Disallow | /account/unsubscribe/* |
| Disallow | /email_notifications/*/unsubscribe |
| Disallow | /annotations/*/report_as_abusive |
| Disallow | /songs/for_profile_page |
| Disallow | /api$ |
| Disallow | /api/* |
| Disallow | /search?* |
| Disallow | /*/*/leaderboard |
| Disallow | /songs/*/apple_music_player* |
| Disallow | /songs/*/show_amp_header_play_toggle* |