perthnow.com.au
robots.txt
Robots Exclusion Standard data for perthnow.com.au
Resource Scan
Scan Details
| Site Domain | perthnow.com.au |
| Base Domain | perthnow.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-21T17:33:49+00:00 |
| Next Scan | 2024-09-28T17:33:49+00:00 |
Last Scan
| Scanned | 2024-09-21T17:33:49+00:00 |
| URL | https://perthnow.com.au/robots.txt |
| Domain IPs | 13.35.18.126, 13.35.18.129, 13.35.18.14, 13.35.18.17, 2600:9000:20c7:0:1f:8d4d:e5c0:93a1, 2600:9000:20c7:1a00:1f:8d4d:e5c0:93a1, 2600:9000:20c7:3800:1f:8d4d:e5c0:93a1, 2600:9000:20c7:4000:1f:8d4d:e5c0:93a1, 2600:9000:20c7:7c00:1f:8d4d:e5c0:93a1, 2600:9000:20c7:a400:1f:8d4d:e5c0:93a1, 2600:9000:20c7:c400:1f:8d4d:e5c0:93a1, 2600:9000:20c7:f400:1f:8d4d:e5c0:93a1 |
| Response IP | 13.35.18.126 |
| Found | Yes |
| Hash | 82c12d33f18b11e2ace435de8e27b9a4004803fa7f566962daba4f9205bfb85a |
| SimHash | 6809e371aed2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://perthnow.com.au/sitemap.xml |
| sitemap | https://perthnow.com.au/news-sitemap.xml |