outlawspeed.com.au
robots.txt

Robots Exclusion Standard data for outlawspeed.com.au

Resource Scan

Scan Details

Site Domain outlawspeed.com.au
Base Domain outlawspeed.com.au
Scan Status Ok
Last Scan2025-03-25T02:12:52+00:00
Next Scan 2025-04-24T02:12:52+00:00

Last Scan

Scanned2025-03-25T02:12:52+00:00
URL https://outlawspeed.com.au/robots.txt
Domain IPs 110.173.135.24
Response IP 110.173.135.24
Found Yes
Hash 36bc8edacc9dd2ac806095283d00b67744abe5a92fd2ccba570533285db65a9c
SimHash 2cd919736ef8

Groups

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

statuscake

Rule Path
Disallow /

*

Rule Path
Disallow /*?p=
Disallow /*?dir=
Disallow /*?parttype=
Disallow /*?brand=
Disallow /*?model=
Disallow /*?year=
Disallow /*?engine=
Disallow /*?construction=
Disallow /*?colour=
Disallow /*?size=
Disallow /*?degreeangle=
Disallow /*?hoselength=
Disallow /*?series=
Disallow /*?braidtype=
Disallow /*?leadcolour=
Disallow /*?bore=
Disallow /*?tyretype=
Disallow /*?tyrewidth=
Disallow /*?aspectratio=
Disallow /*?rimdiameter=
Disallow /*?cfm=
Disallow /*?barrels=
Disallow /*?fuel=
Disallow /*?secondaries=
Disallow /*?finish=
Disallow /*?availability=
Disallow /*?weight=
Disallow /*?gtin=
Disallow /*?dimensions=
Disallow /*?choke=
Disallow /*?booster=
Disallow /*?productmodel=
Disallow /*?type=
Disallow /*?lighting=
Disallow /*?gaugerange=
Disallow /*?material=
Disallow /*?filtershape=
Disallow /*?gaugeseries=
Disallow /*?mounting=
Disallow /*?tyrediameter=
Disallow /*?wheelsize=
Disallow /*?carburetortype=
Disallow /*?carburetorstyle=
Disallow /*?rockerratio=
Disallow /*?cylinderheadtype=
Disallow /*?liftertype=
Disallow /*?rpmrange=
Disallow /*?boltpattern=
Disallow /*?distributortype=
Disallow /*?boottype=
Disallow /*?shape=
Disallow /*?sleevetype=
Disallow /*?manifoldtype=
Disallow /*?amperage=
Disallow /*?flange=
Disallow /*?fueltype=
Disallow /*?bezelcolor=
Disallow /*?stroke=
Disallow /*?vehiclemake=
Disallow /*?enginetype=
Disallow /*?spokecolour=
Disallow /*?steeringwheeltype=
Disallow /*?tiretype=
Disallow /*?cylinders=
Disallow /*?wheeldiameter=
Disallow /*?rimwidth=
Disallow /*?bootmaterial=
Disallow /*?wireseries=
Disallow /*?transmissiontype=
Disallow /*?intakestyle=
Disallow /*?extended=
Disallow /*?thickness=
Disallow /*?gasketthickness=
Disallow /*?displaytype=
Disallow /*?aspectratio=
Disallow /*?barrels=
Disallow /*?boltpattern=
Disallow /*?bootmaterial=
Disallow /*?boottype=
Disallow /*?bore=
Disallow /*?braidtype=
Disallow /*?carburetorstyle=
Disallow /*?carburetortype=
Disallow /*?cfm=
Disallow /*?choke=
Disallow /*?cylinderheadtype=
Disallow /*?cylinders=
Disallow /*?degreeangle=
Disallow /*?engine=
Disallow /*?enginetype=
Disallow /*?filtershape=
Disallow /*?flange=
Disallow /*?fuel=
Disallow /*?fueltype=
Disallow /*?gasketthickness=
Disallow /*?hoselength=
Disallow /*?intakestyle=
Disallow /*?leadcolour=
Disallow /*?liftertype=
Disallow /*?manifoldtype=
Disallow /*?material=
Disallow /*?mounting=
Disallow /*?productmodel=
Disallow /*?rimdiameter=
Disallow /*?rockerratio=
Disallow /*?secondaries=
Disallow /*?series=
Disallow /*?shape=
Disallow /*?sleevetype=
Disallow /*?spokecolour=
Disallow /*?steeringwheeltype=
Disallow /*?stroke=
Disallow /*?thickness=
Disallow /*?tiretype=
Disallow /*?transmissiontype=
Disallow /*?type=
Disallow /*?tyretype=
Disallow /*?tyrewidth=
Disallow /*?vehiclemake=
Disallow /*?wheeldiameter=
Disallow /*?wireseries=
Disallow /*?fuelpumptype=
Disallow /*?unitquantity=
Disallow /*?wheelwidth=
Disallow /*?clothingsize=
Disallow /*?discount_type=
Disallow /*?rimwidth=
Disallow /*?tyrediameter=
Disallow /*?interchangepartnumber=
Disallow /*?cubicweight=
Disallow /*?oversizedparcel=
Disallow /*?amp%3B
Disallow /*?amp=
Disallow */404/
Disallow */app/
Disallow */cgi-bin/
Disallow */downloader/
Disallow */errors/
Disallow */includes/
Disallow */magento/
Disallow */media/captcha/
Disallow */media/customer/
Disallow */media/dhl/
Disallow */media/downloadable/
Disallow */media/import/
Disallow */media/pdf/
Disallow */media/sales/
Disallow */media/tmp/
Disallow */media/xmlconnect/
Disallow */pkginfo/
Disallow */report/
Disallow */scripts/
Disallow */shell/
Disallow */stats/
Disallow */var/
Disallow */index.php/
Disallow */catalog/product_compare/
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */catalog/product/gallery/
Disallow */catalogsearch/
Disallow */control/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow */poll/
Disallow */review/
Disallow */sendfriend/
Disallow */tag/
Disallow */wishlist/
Disallow */checkout/
Disallow */onestepcheckout/
Disallow */productpageshipping/
Disallow */cron.php
Disallow */cron.sh
Disallow */error_log
Disallow */install.php
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */STATUS.txt
Disallow */*?mode*
Disallow */*?___from_store=*
Disallow */*?___store=*
Disallow */*?cat=*
Disallow */*?price=*
Disallow */*.php$
Disallow */*?SID=

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://outlawspeed.com.au/shop/sitemap/sitemap.xml
sitemap https://outlawspeed.com.au/shop/sitemap/sitemap_1.xml
sitemap https://outlawspeed.com.au/shop/sitemap/sitemap_2.xml

Comments

  • Sitemap (uncomment, change and add language/shop specific sitemaps, if running on multiple domains
  • keep in mind sitemap can only point to own domain so something like sitemapindex.php is needed)
  • Crawlers Setup
  • Disallow paging & Attributes (unless paging inside a listing with more params, as disallowed below)
  • Directories
  • Disallow: */media/
  • Disallow: */media/catalog/
  • Disallow: */media/wysiwyg/
  • Disallow: */skin/
  • Paths (if using shop id in URL must prefix with * or copy for each)
  • Files
  • Do not crawl sub category pages that are sorted or filtered.
  • This would be very broad, could hurt (incl. SEO).
  • Disallow: /*?*
  • These are more specific, pick what you need - and do not forget to add your custom filters!
  • Paths that can be safely ignored (no clean URLs)