how-to-bitcoin.com.au
robots.txt

Robots Exclusion Standard data for how-to-bitcoin.com.au

Resource Scan

Scan Details

Site Domain how-to-bitcoin.com.au
Base Domain how-to-bitcoin.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-03T02:41:11+00:00
Next Scan 2026-03-03T02:41:11+00:00

Last Successful Scan

Scanned2022-03-21T20:26:36+00:00
URL https://www.how-to-bitcoin.com.au/robots.txt
Redirect https://howtobitcoin.com.au/robots.txt
Redirect Domain howtobitcoin.com.au
Redirect Base howtobitcoin.com.au
Response IP 172.67.129.136
Found Yes
Hash 825bbb3522e4f3070b8ec2a7cea08004d9aef298b3b6b92d65e3b6539e9993a8
SimHash 2434da64e3b3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

nerdybot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /