supercheapauto.com.au
robots.txt
Robots Exclusion Standard data for supercheapauto.com.au
Resource Scan
Scan Details
| Site Domain | supercheapauto.com.au |
| Base Domain | supercheapauto.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-14T20:23:13+00:00 |
| Next Scan | 2024-12-14T20:23:13+00:00 |
Last Scan
| Scanned | 2024-11-14T20:23:13+00:00 |
| URL | https://supercheapauto.com.au/robots.txt |
| Redirect | https://www.supercheapauto.com.au/robots.txt |
| Redirect Domain | www.supercheapauto.com.au |
| Redirect Base | supercheapauto.com.au |
| Domain IPs | 13.35.238.101, 13.35.238.59, 13.35.238.77, 13.35.238.78 |
| Redirect IPs | 3.165.82.21, 3.165.82.75, 3.165.82.85, 3.165.82.88 |
| Response IP | 3.165.82.21 |
| Found | Yes |
| Hash | 0145b64496816087d9cbf76443bca07d40fb68edec4d381a6633adac375920e2 |
| SimHash | e16185c64a36 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*demandware.static* |
| Allow | /*Analytics-Start* |
| Disallow | /*CAWELAID%3D* |
| Disallow | /*cb%3D* |
| Disallow | /*cid%3D* |
| Disallow | /*cm_vc%3D* |
| Disallow | /*gclid%3D* |
| Disallow | /*istBid%3D* |
| Disallow | /*istCompanyId%3D* |
| Disallow | /*istItemId%3D* |
| Disallow | /*maxfilter* |
| Disallow | /*mid%3D* |
| Disallow | /*original%3D* |
| Disallow | /*pmax%3D* |
| Disallow | /*pmin%3D* |
| Disallow | /*prefn1%3D* |
| Disallow | /*prefn2%3D* |
| Disallow | /*prefn3%3D* |
| Disallow | /*prefn4%3D* |
| Disallow | /*prefv1%3D* |
| Disallow | /*prefv2%3D* |
| Disallow | /*prefv3%3D* |
| Disallow | /*prefv4%3D* |
| Disallow | /*srule%3D* |
| Disallow | /*start%3D* |
| Disallow | /*sz%3D* |
| Disallow | /*vgid%3D* |
| Disallow | /*Product-Variation* |
| Disallow | /on/demandware.store/ |
| Disallow | *?crefn1=* |
| Disallow | *csortb*%3D* |
| Disallow | *fdid%3D* |
| Disallow | *src%3D* |
| Disallow | *dwvar_*%3D* |
| Disallow | *bvstate%3D* |
| Disallow | *bvroute%3D* |
| Disallow | /search?q=*bitcoin* |
| Disallow | /search?q=*Bityard* |
| Disallow | /blog?q=* |
| Disallow | /*format%3Dajax |
| Disallow | /fitment* |
| Disallow | /search?q=*bit%20coin* |
| Disallow | /search?q=*robux* |
| Disallow | /search?q=*snapchat* |
| Disallow | /search?q=*Instagram* |
| Disallow | /search?q=*hacks* |
| Disallow | /search?q=*hacker* |
| Disallow | /search?q=*hacking* |
| Disallow | /contactus |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.supercheapauto.com.au/sitemap_index.xml |
Comments