perthnow.com.au
robots.txt
Robots Exclusion Standard data for perthnow.com.au
Resource Scan
Scan Details
| Site Domain | perthnow.com.au |
| Base Domain | perthnow.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-09T19:01:09+00:00 |
| Next Scan | 2024-11-16T19:01:09+00:00 |
Last Scan
| Scanned | 2024-11-09T19:01:09+00:00 |
| URL | https://perthnow.com.au/robots.txt |
| Domain IPs | 13.33.28.104, 13.33.28.2, 13.33.28.63, 13.33.28.72, 2600:9000:229f:1400:1f:8d4d:e5c0:93a1, 2600:9000:229f:1a00:1f:8d4d:e5c0:93a1, 2600:9000:229f:6800:1f:8d4d:e5c0:93a1, 2600:9000:229f:8000:1f:8d4d:e5c0:93a1, 2600:9000:229f:8200:1f:8d4d:e5c0:93a1, 2600:9000:229f:d200:1f:8d4d:e5c0:93a1, 2600:9000:229f:e000:1f:8d4d:e5c0:93a1, 2600:9000:229f:fa00:1f:8d4d:e5c0:93a1 |
| Response IP | 13.33.28.2 |
| Found | Yes |
| Hash | 82c12d33f18b11e2ace435de8e27b9a4004803fa7f566962daba4f9205bfb85a |
| SimHash | 6809e371aed2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://perthnow.com.au/sitemap.xml |
| sitemap | https://perthnow.com.au/news-sitemap.xml |