csmarketcap.com
robots.txt
Robots Exclusion Standard data for csmarketcap.com
Resource Scan
Scan Details
Site Domain | csmarketcap.com |
Base Domain | csmarketcap.com |
Scan Status | Ok |
Last Scan | 2025-08-19T13:36:37+00:00 |
Next Scan | 2025-09-18T13:36:37+00:00 |
Last Scan
Scanned | 2025-08-19T13:36:37+00:00 |
URL | https://csmarketcap.com/robots.txt |
Domain IPs | 104.26.14.74, 104.26.15.74, 172.67.74.54, 2606:4700:20::681a:e4a, 2606:4700:20::681a:f4a, 2606:4700:20::ac43:4a36 |
Response IP | 104.26.15.74 |
Found | Yes |
Hash | 88c3bc4539805e65a74231757660f3039a0c625106282df45d01db2b53befa72 |
SimHash | 20dd3a05a1d3 |
Groups
*
Rule | Path |
---|---|
Disallow | */da/* |
Disallow | */de/* |
Disallow | */es/* |
Disallow | */fr/* |
Disallow | */nl/* |
Disallow | */pl/* |
Disallow | */ro/* |
Disallow | */sv/* |
Disallow | */tr/* |
Disallow | */pt/* |
Disallow | */uk/* |
Disallow | *?search= |
Disallow | */comparison?* |
Disallow | *?offers= |
Disallow | */test |
Disallow | *?rarity=* |
Disallow | *?extra=* |
Disallow | *?highlighted=* |
Disallow | *undefined* |
Other Records
Field | Value |
---|---|
sitemap | https://csmarketcap.com/sitemap.xml |