localsearch.com.au
robots.txt
Robots Exclusion Standard data for localsearch.com.au
Resource Scan
Scan Details
| Site Domain | localsearch.com.au |
| Base Domain | localsearch.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-09T22:39:44+00:00 |
| Next Scan | 2024-06-08T22:39:44+00:00 |
Last Successful Scan
| Scanned | 2024-03-18T22:38:41+00:00 |
| URL | https://localsearch.com.au/robots.txt |
| Redirect | https://www.localsearch.com.au:443/robots.txt |
| Redirect Domain | www.localsearch.com.au |
| Redirect Base | localsearch.com.au |
| Domain IPs | 13.33.33.106, 13.33.33.11, 13.33.33.39, 13.33.33.51 |
| Redirect IPs | 108.157.254.21, 108.157.254.36, 108.157.254.67, 108.157.254.91, 2600:9000:2753:4000:3:8e4e:f280:93a1, 2600:9000:2753:a000:3:8e4e:f280:93a1, 2600:9000:2753:a800:3:8e4e:f280:93a1, 2600:9000:2753:b400:3:8e4e:f280:93a1, 2600:9000:2753:bc00:3:8e4e:f280:93a1, 2600:9000:2753:c00:3:8e4e:f280:93a1, 2600:9000:2753:d000:3:8e4e:f280:93a1, 2600:9000:2753:e00:3:8e4e:f280:93a1 |
| Response IP | 108.157.254.67 |
| Found | Yes |
| Hash | d3e41042cc9fe67edb694eefb797aa42ba7a99d445dd3f3ec7a3eb11b4a07e05 |
| SimHash | 615d003123bb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /newupdate/ |
| Disallow | /newlisting/ |
| Disallow | /preview/ |
| Disallow | /default/ |
| Disallow | /reviews/manager/ |
| Disallow | /reviews/ |
| Disallow | /legal/reviews/ |
| Disallow | /listing-request |
| Disallow | /update |
| Disallow | /newupdate |
| Disallow | /newlisting |
| Disallow | /manage-listing/ |
| Disallow | /recommended |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.localsearch.com.au/sitemap_index.xml |
| sitemap | https://www.localsearch.com.au/sitemap_priority_february.xml |
| sitemap | https://www.localsearch.com.au/sitemap_priority_categories.xml |
| sitemap | https://www.localsearch.com.au/sitemap_pacman_01.xml |
| sitemap | https://www.localsearch.com.au/sitemap_pacman_02.xml |