musixmatch.com
robots.txt
Robots Exclusion Standard data for musixmatch.com
Resource Scan
Scan Details
| Site Domain | musixmatch.com |
| Base Domain | musixmatch.com |
| Scan Status | Ok |
| Last Scan | 2024-09-18T07:30:09+00:00 |
| Next Scan | 2024-09-25T07:30:09+00:00 |
Last Scan
| Scanned | 2024-09-18T07:30:09+00:00 |
| URL | https://musixmatch.com/robots.txt |
| Redirect | https://www.musixmatch.com/robots.txt |
| Redirect Domain | www.musixmatch.com |
| Redirect Base | musixmatch.com |
| Domain IPs | 52.84.229.124, 52.84.229.27, 52.84.229.53, 52.84.229.71 |
| Redirect IPs | 151.101.130.49, 151.101.194.49, 151.101.2.49, 151.101.66.49 |
| Response IP | 199.232.46.49 |
| Found | Yes |
| Hash | 5d6cd944be73b768f6faa91b3daa81344bcf5d83c3a268bb833304db37811cdd |
| SimHash | 650c930145b5 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
googlebot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
msnbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
bingbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
slurp
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
yahoo! slurp
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
baiduspider
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
yandex
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
grapeshot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
twitterbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
*
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /*/search |
| Disallow | /profile |
| Disallow | /*/profile |
| Disallow | /contribute |
| Disallow | /*/contribute |
| Disallow | /*/annotation |
| Disallow | /verify-user |
| Disallow | /crowdin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.musixmatch.com/community_sitemap/v3/sitemap.xml |
Comments