coinmarketcap.com
robots.txt
Robots Exclusion Standard data for coinmarketcap.com
Resource Scan
Scan Details
| Site Domain | coinmarketcap.com |
| Base Domain | coinmarketcap.com |
| Scan Status | Ok |
| Last Scan | 2024-09-18T12:57:51+00:00 |
| Next Scan | 2024-09-25T12:57:51+00:00 |
Last Scan
| Scanned | 2024-09-18T12:57:51+00:00 |
| URL | https://coinmarketcap.com/robots.txt |
| Domain IPs | 13.35.18.48, 13.35.18.59, 13.35.18.61, 13.35.18.71 |
| Response IP | 13.35.18.61 |
| Found | Yes |
| Hash | 099e07b6ac0e79f5fdf8a1cb570b260aed17751f26008e9e05490ea1a1c14ce9 |
| SimHash | aa04c8208fd3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /headlines/* |
| Disallow | /*/headlines/* |
| Disallow | /community/*/post/* |
| Disallow | /community/*/live/* |
| Disallow | /community/*/topics/* |
| Disallow | /community/*/coins/* |
| Disallow | /community/*/profile/* |