southbanklocalnews.com.au
robots.txt
Robots Exclusion Standard data for southbanklocalnews.com.au
Resource Scan
Scan Details
| Site Domain | southbanklocalnews.com.au |
| Base Domain | southbanklocalnews.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-29T04:42:33+00:00 |
| Next Scan | 2024-10-06T04:42:33+00:00 |
Last Scan
| Scanned | 2024-09-29T04:42:33+00:00 |
| URL | https://southbanklocalnews.com.au/robots.txt |
| Redirect | https://www.southbanklocalnews.com.au/robots.txt |
| Redirect Domain | www.southbanklocalnews.com.au |
| Redirect Base | southbanklocalnews.com.au |
| Domain IPs | 104.21.15.17, 172.67.161.5, 2606:4700:3030::ac43:a105, 2606:4700:3034::6815:f11 |
| Redirect IPs | 104.21.15.17, 172.67.161.5, 2606:4700:3030::ac43:a105, 2606:4700:3034::6815:f11 |
| Response IP | 104.21.15.17 |
| Found | Yes |
| Hash | 69a920456e90ecc6f5f51f2b32c71d0f9c48ccde37efd0513f54355bacdc99a6 |
| SimHash | 6b089c52cf91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.php$ |
| Disallow | /P*/ |
| Disallow | /search/results/* |
| Disallow | /*/c/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.southbanklocalnews.com.au/sitemap/ |