aspirelr.com.au
robots.txt

Robots Exclusion Standard data for aspirelr.com.au

Resource Scan

Scan Details

Site Domain aspirelr.com.au
Base Domain aspirelr.com.au
Scan Status Ok
Last Scan2026-02-04T22:41:31+00:00
Next Scan 2026-03-06T22:41:31+00:00

Last Scan

Scanned2026-02-04T22:41:31+00:00
URL https://aspirelr.com.au/robots.txt
Redirect https://aspirelr.org.au/robots.txt
Redirect Domain aspirelr.org.au
Redirect Base aspirelr.org.au
Domain IPs 104.21.43.70, 172.67.221.240, 2606:4700:3033::6815:2b46, 2606:4700:3035::ac43:ddf0
Redirect IPs 104.21.49.185, 172.67.165.226, 2606:4700:3033::6815:31b9, 2606:4700:3036::ac43:a5e2
Response IP 104.21.49.185
Found Yes
Hash ca622c70a899fd9f037b4a2d9e75c1042822f6979ab7773dd6d01b5ea19053f2
SimHash fabd4d0f6950

Groups

*

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /user
Disallow /account
Disallow /api
Disallow /password

Other Records

Field Value
sitemap https://aspirelr.com.au/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /