minerslanding.com
robots.txt

Robots Exclusion Standard data for minerslanding.com

Resource Scan

Scan Details

Site Domain minerslanding.com
Base Domain minerslanding.com
Scan Status Ok
Last Scan2025-11-12T05:16:33+00:00
Next Scan 2025-12-12T05:16:33+00:00

Last Scan

Scanned2025-11-12T05:16:33+00:00
URL https://minerslanding.com/robots.txt
Redirect https://www.minerslanding.com/robots.txt
Redirect Domain www.minerslanding.com
Redirect Base minerslanding.com
Domain IPs 104.21.21.225, 172.67.200.237, 2606:4700:3033::6815:15e1, 2606:4700:3033::ac43:c8ed
Redirect IPs 104.21.21.225, 172.67.200.237, 2606:4700:3033::6815:15e1, 2606:4700:3033::ac43:c8ed
Response IP 104.21.21.225
Found Yes
Hash 81a0c416f78a49c21f6091f83d9b72d1c4b2fc0c08ea2f16f3fc63a096197f5a
SimHash 65055451e7b5

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.minerslanding.com/sitemap.xml