commercialpropertyguide.com.au
robots.txt
Robots Exclusion Standard data for commercialpropertyguide.com.au
Resource Scan
Scan Details
| Site Domain | commercialpropertyguide.com.au |
| Base Domain | commercialpropertyguide.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-15T09:59:50+00:00 |
| Next Scan | 2026-02-13T09:59:50+00:00 |
Last Successful Scan
| Scanned | 2025-06-25T04:31:03+00:00 |
| URL | https://commercialpropertyguide.com.au/robots.txt |
| Redirect | https://www.commercialpropertyguide.com.au/robots.txt |
| Redirect Domain | www.commercialpropertyguide.com.au |
| Redirect Base | commercialpropertyguide.com.au |
| Domain IPs | 104.26.10.5, 104.26.11.5, 172.67.68.29, 2606:4700:20::681a:a05, 2606:4700:20::681a:b05, 2606:4700:20::ac43:441d |
| Redirect IPs | 104.26.10.5, 104.26.11.5, 172.67.68.29, 2606:4700:20::681a:a05, 2606:4700:20::681a:b05, 2606:4700:20::ac43:441d |
| Response IP | 104.26.11.5 |
| Found | Yes |
| Hash | 838e5d2c11cff40aefd09956ff16a92a10b1f2201b2c97d20c880e8ecd10eb5f |
| SimHash | 2900d17a8a32 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /myaccount/ |
| Disallow | /static/documents/ |
| Disallow | /static/floorplans/ |
| Disallow | /property/print/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-01-general.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-02-sale-lease.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-03-sale.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-04-lease.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-05-news.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-06-sold.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-07-leased.xml |
| sitemap | http://www.commercialpropertyguide.com.au/sitemaps/sitemap-08-coworking.xml |