bigw.com.au
robots.txt
Robots Exclusion Standard data for bigw.com.au
Resource Scan
Scan Details
| Site Domain | bigw.com.au |
| Base Domain | bigw.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-07T07:50:30+00:00 |
| Next Scan | 2025-01-05T07:50:30+00:00 |
Last Successful Scan
| Scanned | 2023-09-04T19:51:28+00:00 |
| URL | https://bigw.com.au/robots.txt |
| Redirect | https://www.bigw.com.au/robots.txt |
| Redirect Domain | www.bigw.com.au |
| Redirect Base | bigw.com.au |
| Domain IPs | 23.207.181.52 |
| Redirect IPs | 23.52.113.39 |
| Response IP | 23.52.113.39 |
| Found | Yes |
| Hash | bc3cd208b820bf34d31c7185509fd3a1dee35128d861c5cfb858686abd7eb67c |
| SimHash | 8d460736eff2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /my-account |
| Disallow | /temporary/ |
| Disallow | /all-departments/ |
| Disallow | /search?* |
| Disallow | /*?departmentPage= |
| Disallow | /*promotion_regional/ |
| Disallow | /help/CompetitionsContent |
| Disallow | /*?filter |
| Disallow | /sales/c/2/ |
| Disallow | /c/2/ |
| Disallow | /collection/undefined/ |
| Disallow | /*?bvstate |
| Disallow | /*?q |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bigw.com.au/sitemap.xml |
Comments