top4.com.au
robots.txt
Robots Exclusion Standard data for top4.com.au
Resource Scan
Scan Details
| Site Domain | top4.com.au |
| Base Domain | top4.com.au |
| Scan Status | Ok |
| Last Scan | 2026-01-29T11:16:09+00:00 |
| Next Scan | 2026-02-05T11:16:09+00:00 |
Last Scan
| Scanned | 2026-01-29T11:16:09+00:00 |
| URL | https://top4.com.au/robots.txt |
| Redirect | https://www.top4.com.au/robots.txt |
| Redirect Domain | www.top4.com.au |
| Redirect Base | top4.com.au |
| Domain IPs | 104.26.8.91, 104.26.9.91, 172.67.74.213, 2606:4700:20::681a:85b, 2606:4700:20::681a:95b, 2606:4700:20::ac43:4ad5 |
| Redirect IPs | 104.26.8.91, 104.26.9.91, 172.67.74.213, 2606:4700:20::681a:85b, 2606:4700:20::681a:95b, 2606:4700:20::ac43:4ad5 |
| Response IP | 104.26.9.91 |
| Found | Yes |
| Hash | d849b9d7d1cebd20053e9aaf1eeeb8d7747afaabdfe120b537be6474e4d4578a |
| SimHash | 0394d902ea31 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /members |
| Disallow | /sitemgr |
| Disallow | /theme |
| Disallow | /custom/content_files |
| Disallow | /custom/editor_files |
| Disallow | /custom/extra_files |
| Disallow | /custom/import_files |
| Disallow | /custom/lang |
| Disallow | /custom/theme |
| Disallow | /custom/tmp |
| Disallow | /listing/print.php |
| Disallow | /event/print.php |
| Disallow | /classified/print.php |
| Disallow | /article/print.php |
| Disallow | /article/print_detail.php |
| Disallow | /*_js_submit.php |
| Disallow | /listing_reports.php |
| Disallow | /product/guide/ |
| Disallow | /pressrelease/guide/ |
| Disallow | /promotion/guide/ |
| Disallow | /listing/search/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.top4.com.au/sitemap/sitemap.xml |
Warnings
- 2 invalid lines.