supermining.website
robots.txt
Robots Exclusion Standard data for supermining.website
Resource Scan
Scan Details
Site Domain | supermining.website |
Base Domain | supermining.website |
Scan Status | Ok |
Last Scan | 2024-10-02T16:03:29+00:00 |
Next Scan | 2024-10-09T16:03:29+00:00 |
Last Scan
Scanned | 2024-10-02T16:03:29+00:00 |
URL | https://supermining.website/robots.txt |
Redirect | https://www.supermining.website/robots.txt |
Redirect Domain | www.supermining.website |
Redirect Base | supermining.website |
Domain IPs | 104.21.79.78, 172.67.169.90, 2606:4700:3033::ac43:a95a, 2606:4700:3034::6815:4f4e |
Redirect IPs | 104.21.79.78, 172.67.169.90, 2606:4700:3033::ac43:a95a, 2606:4700:3034::6815:4f4e |
Response IP | 104.21.79.78 |
Found | Yes |
Hash | 4304bb9c571398b5d878272938bcc8ec99a35b064046811c4022cd5584c6f012 |
SimHash | cd455d04e656 |
Groups
*
Rule | Path |
---|---|
Disallow | /home/ajaxgetpayouts |
Disallow | /leaderboard |
Disallow | /signup |
Disallow | /dashboard |
Disallow | /index.php/dashboard |
Disallow | /index.php/signin_with_address |
Disallow | /ajax_content_redirect_model |
Disallow | /getajaxpayoutsdata |
Disallow | /?referral= |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.supermining.website/sitemap.xml |