bitcoin.com.au
robots.txt

Robots Exclusion Standard data for bitcoin.com.au

Resource Scan

Scan Details

Site Domain bitcoin.com.au
Base Domain bitcoin.com.au
Scan Status Ok
Last Scan2025-12-01T07:45:45+00:00
Next Scan 2025-12-31T07:45:45+00:00

Last Scan

Scanned2025-12-01T07:45:45+00:00
URL https://bitcoin.com.au/robots.txt
Domain IPs 104.18.8.219, 104.18.9.219, 2606:4700::6812:8db, 2606:4700::6812:9db
Response IP 104.18.9.219
Found Yes
Hash 518bc51078fa80c92a596f3d84e7988234f0229a855dfc271350d27b2cfc701d
SimHash 493b6b216713

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /invite
Disallow /?invite=*
Disallow /api/
Disallow /api2/
Disallow /tradingview/

Other Records

Field Value
sitemap https://bitcoin.com.au/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content