cryptominers.ai
robots.txt
Robots Exclusion Standard data for cryptominers.ai
Resource Scan
Scan Details
Site Domain | cryptominers.ai |
Base Domain | cryptominers.ai |
Scan Status | Ok |
Last Scan | 2025-05-28T04:18:15+00:00 |
Next Scan | 2025-06-27T04:18:15+00:00 |
Last Scan
Scanned | 2025-05-28T04:18:15+00:00 |
URL | https://cryptominers.ai/robots.txt |
Domain IPs | 104.21.2.140, 172.67.129.73, 2606:4700:3032::ac43:8149, 2606:4700:3037::6815:28c |
Response IP | 104.21.2.140 |
Found | Yes |
Hash | 18cbaba2cb69d086159362248d4f2161777ee6fb1e766d9f525ccde9d3987c75 |
SimHash | e801be24a9b8 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets_main/ |
Disallow | /assets_user/ |
Disallow | /assets_front/ |
Disallow | /assets/ |
Other Records
Field | Value |
---|---|
sitemap | https://cryptominers.ai/sitemap.xml |