code.genius.com
robots.txt
Robots Exclusion Standard data for code.genius.com
Resource Scan
Scan Details
Site Domain | code.genius.com |
Base Domain | genius.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-03-17T14:28:45+00:00 |
Next Scan | 2024-05-16T14:28:45+00:00 |
Last Successful Scan
Scanned | 2023-07-20T01:30:52+00:00 |
URL | https://code.genius.com/robots.txt |
Redirect | https://genius.com/robots.txt |
Redirect Domain | genius.com |
Redirect Base | genius.com |
Domain IPs | 104.18.22.208, 104.18.23.208, 2606:4700::6812:16d0, 2606:4700::6812:17d0 |
Redirect IPs | 104.18.22.208, 104.18.23.208, 2606:4700::6812:16d0, 2606:4700::6812:17d0 |
Response IP | 104.18.22.208 |
Found | Yes |
Hash | 35edc35ecb676a19c9276d3a022508690775a0152f9f9d401047d91e74321b5f |
SimHash | ee58e88caf06 |
Groups
*
Rule | Path |
---|---|
Disallow | /songs/*/metadata |
Disallow | /songs/*/comments |
Disallow | /users/*/top_artist_iq_rank |
Disallow | /artists/*/top_iq_earners |
Disallow | /comments/for_profile_page |
Disallow | /bagon/* |
Disallow | /mecha/* |
Disallow | /account/unsubscribe/* |
Disallow | /email_notifications/*/unsubscribe |
Disallow | /annotations/*/report_as_abusive |
Disallow | /songs/for_profile_page |
Disallow | /api$ |
Disallow | /api/* |
Disallow | /search?* |
Disallow | /*/*/leaderboard |
Disallow | /songs/*/apple_music_player* |
Disallow | /songs/*/show_amp_header_play_toggle* |