genius.com
robots.txt
Robots Exclusion Standard data for genius.com
Resource Scan
Scan Details
Site Domain | genius.com |
Base Domain | genius.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-08T09:32:52+00:00 |
Next Scan | 2024-05-15T09:32:52+00:00 |
Last Successful Scan
Scanned | 2023-07-16T15:54:19+00:00 |
URL | https://genius.com/robots.txt |
Domain IPs | 104.18.22.208, 104.18.23.208, 2606:4700::6812:16d0, 2606:4700::6812:17d0 |
Response IP | 104.18.22.208 |
Found | Yes |
Hash | 35edc35ecb676a19c9276d3a022508690775a0152f9f9d401047d91e74321b5f |
SimHash | ee58e88caf06 |
Groups
*
Rule | Path |
---|---|
Disallow | /songs/*/metadata |
Disallow | /songs/*/comments |
Disallow | /users/*/top_artist_iq_rank |
Disallow | /artists/*/top_iq_earners |
Disallow | /comments/for_profile_page |
Disallow | /bagon/* |
Disallow | /mecha/* |
Disallow | /account/unsubscribe/* |
Disallow | /email_notifications/*/unsubscribe |
Disallow | /annotations/*/report_as_abusive |
Disallow | /songs/for_profile_page |
Disallow | /api$ |
Disallow | /api/* |
Disallow | /search?* |
Disallow | /*/*/leaderboard |
Disallow | /songs/*/apple_music_player* |
Disallow | /songs/*/show_amp_header_play_toggle* |