sparesbox.com.au
robots.txt
Robots Exclusion Standard data for sparesbox.com.au
Resource Scan
Scan Details
| Site Domain | sparesbox.com.au |
| Base Domain | sparesbox.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-06T05:55:37+00:00 |
| Next Scan | 2026-03-06T05:55:37+00:00 |
Last Successful Scan
| Scanned | 2023-10-25T08:42:06+00:00 |
| URL | https://sparesbox.com.au/robots.txt |
| Redirect | https://www.sparesbox.com.au/robots.txt |
| Redirect Domain | www.sparesbox.com.au |
| Redirect Base | sparesbox.com.au |
| Domain IPs | 104.18.38.209, 172.64.149.47, 2606:4700:4400::6812:26d1, 2606:4700:4400::ac40:952f |
| Redirect IPs | 104.18.38.209, 172.64.149.47, 2606:4700:4400::6812:26d1, 2606:4700:4400::ac40:952f |
| Response IP | 172.64.149.47 |
| Found | Yes |
| Hash | f721a6c35b2cdcc430572c85af764f495e135b251f40f3aabcd4361ffd7f9716 |
| SimHash | a5e5d997c3ea |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mint/ |
| Disallow | /app/ |
| Disallow | /admin/ |
| Disallow | /cgi-bin/ |
| Disallow | /downloader/ |
| Disallow | /includes/ |
| Disallow | /lib/ |
| Disallow | /pkginfo/ |
| Disallow | /var/ |
| Disallow | /index.php/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /catalogsearch/ |
| Disallow | /control/ |
| Disallow | /customer/ |
| Disallow | /customize/ |
| Disallow | /install/ |
| Disallow | /private/ |
| Disallow | /tag/ |
| Disallow | /wishlist/ |
| Disallow | /cron.php |
| Disallow | /cron.sh |
| Disallow | /error_log |
| Disallow | /install.php |
| Disallow | /LICENSE.html |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE_AFL.txt |
| Disallow | /STATUS.txt |
| Disallow | /*.php$ |
| Disallow | *?dir=* |
| Disallow | *%26order%3D* |
| Disallow | *?price=* |
| Disallow | *?mode=* |
| Disallow | /vehicle/search/* |
| Disallow | /compare-parts/* |
| Disallow | /service/api/* |
| Disallow | /service/ajax/* |
| Disallow | /service/autodata/* |
| Disallow | /service/uberdata/* |
| Disallow | /*.sh |
| Disallow | /vehicles/ac/ |
| Disallow | /vehicles/alpina/ |
| Disallow | /vehicles/alpine/ |
| Disallow | /vehicles/alvis/ |
| Disallow | /vehicles/amc/ |
| Disallow | /vehicles/armstrong-siddeley/ |
| Disallow | /vehicles/austin/ |
| Disallow | /vehicles/bedford/ |
| Disallow | /vehicles/bentley/ |
| Disallow | /vehicles/bertone/ |
| Disallow | /vehicles/bmc/ |
| Disallow | /vehicles/bolwell/ |
| Disallow | /vehicles/borgward/ |
| Disallow | /vehicles/bugatti/ |
| Disallow | /vehicles/buick/ |
| Disallow | /vehicles/cadillac/ |
| Disallow | /vehicles/caterham/ |
| Disallow | /vehicles/chery/ |
| Disallow | /vehicles/chevrolet/ |
| Disallow | /vehicles/daimler/ |
| Disallow | /vehicles/dmc/ |
| Disallow | /vehicles/dodge/ |
| Disallow | /vehicles/eunos/ |
| Disallow | /vehicles/foton/ |
| Disallow | /vehicles/geely/ |
| Disallow | /vehicles/ginetta/ |
| Disallow | /vehicles/gmc/ |
| Disallow | /vehicles/great-wall/ |
| Disallow | /vehicles/haval/ |
| Disallow | /vehicles/hillman/ |
| Disallow | /vehicles/hino/ |
| Disallow | /vehicles/humber/ |
| Disallow | /vehicles/hummer/ |
| Disallow | /vehicles/infiniti/ |
| Disallow | /vehicles/international/ |
| Disallow | /vehicles/isuzu/ |
| Disallow | /vehicles/iveco/ |
| Disallow | /vehicles/jensen/ |
| Disallow | /vehicles/jmc/ |
| Disallow | /vehicles/kenworth/ |
| Disallow | /vehicles/lada/ |
| Disallow | /vehicles/lancia/ |
| Disallow | /vehicles/ldv/ |
| Disallow | /vehicles/leyland/ |
| Disallow | /vehicles/lincoln/ |
| Disallow | /vehicles/lti/ |
| Disallow | /vehicles/mack/ |
| Disallow | /vehicles/mahindra/ |
| Disallow | /vehicles/maybach/ |
| Disallow | /vehicles/mercury/ |
| Disallow | /vehicles/mg/ |
| Disallow | /vehicles/morgan/ |
| Disallow | /vehicles/morris/ |
| Disallow | /vehicles/noble/ |
| Disallow | /vehicles/opel/ |
| Disallow | /vehicles/pagani/ |
| Disallow | /vehicles/plymouth/ |
| Disallow | /vehicles/pontiac/ |
| Disallow | /vehicles/reliant/ |
| Disallow | /vehicles/riley/ |
| Disallow | /vehicles/rolls-royce/ |
| Disallow | /vehicles/rover/ |
| Disallow | /vehicles/scania/ |
| Disallow | /vehicles/seat/ |
| Disallow | /vehicles/singer/ |
| Disallow | /vehicles/smart/ |
| Disallow | /vehicles/ssangyong/ |
| Disallow | /vehicles/sunbeam/ |
| Disallow | /vehicles/tata/ |
| Disallow | /vehicles/tesla/ |
| Disallow | /vehicles/triumph/ |
| Disallow | /vehicles/tvr/ |
| Disallow | /vehicles/vauxhall/ |
| Disallow | /vehicles/westfield/ |
| Disallow | /vehicles/wolseley/ |
| Disallow | /vehicles/zhongxing/ |
| Disallow | /garage/ |
| Disallow | /vehicles/.*/.*/.*/.* |
| Disallow | /ws/ |
| Disallow | /ws |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sparesbox.com.au/blog/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/garage/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/part/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/shop/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/parts/sitemapv21.xml |
| sitemap | https://www.sparesbox.com.au/vehicles/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/vehicle/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/brands/sitemap.xml |
| sitemap | https://www.sparesbox.com.au/products/sitemap.xml |
Warnings
- 2 invalid lines.