supermining.website
robots.txt

Robots Exclusion Standard data for supermining.website

Resource Scan

Scan Details

Site Domain supermining.website
Base Domain supermining.website
Scan Status Ok
Last Scan2024-10-02T16:03:29+00:00
Next Scan 2024-10-09T16:03:29+00:00

Last Scan

Scanned2024-10-02T16:03:29+00:00
URL https://supermining.website/robots.txt
Redirect https://www.supermining.website/robots.txt
Redirect Domain www.supermining.website
Redirect Base supermining.website
Domain IPs 104.21.79.78, 172.67.169.90, 2606:4700:3033::ac43:a95a, 2606:4700:3034::6815:4f4e
Redirect IPs 104.21.79.78, 172.67.169.90, 2606:4700:3033::ac43:a95a, 2606:4700:3034::6815:4f4e
Response IP 104.21.79.78
Found Yes
Hash 4304bb9c571398b5d878272938bcc8ec99a35b064046811c4022cd5584c6f012
SimHash cd455d04e656

Groups

*

Rule Path
Disallow /home/ajaxgetpayouts
Disallow /leaderboard
Disallow /signup
Disallow /dashboard
Disallow /index.php/dashboard
Disallow /index.php/signin_with_address
Disallow /ajax_content_redirect_model
Disallow /getajaxpayoutsdata
Disallow /?referral=

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.supermining.website/sitemap.xml