rev.com.au
robots.txt
Robots Exclusion Standard data for rev.com.au
Resource Scan
Scan Details
| Site Domain | rev.com.au |
| Base Domain | rev.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-05T01:59:55+00:00 |
| Next Scan | 2024-11-19T01:59:55+00:00 |
Last Scan
| Scanned | 2024-11-05T01:59:55+00:00 |
| URL | https://www.rev.com.au/robots.txt |
| Domain IPs | 2600:9000:2721:3c00:18:219f:c6c0:93a1, 2600:9000:2721:4200:18:219f:c6c0:93a1, 2600:9000:2721:6200:18:219f:c6c0:93a1, 2600:9000:2721:7600:18:219f:c6c0:93a1, 2600:9000:2721:8600:18:219f:c6c0:93a1, 2600:9000:2721:a000:18:219f:c6c0:93a1, 2600:9000:2721:a200:18:219f:c6c0:93a1, 2600:9000:2721:b000:18:219f:c6c0:93a1, 3.165.102.108, 3.165.102.34, 3.165.102.58, 3.165.102.94 |
| Response IP | 3.165.102.108 |
| Found | Yes |
| Hash | 2bbb8d7cc8eac5016dc31e44890e35060e6902a0082f1cf10a2576a925648907 |
| SimHash | 49415460ed90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /styleguide |
| Disallow | /book-a-demo |
| Disallow | /careers |
| Disallow | /academy |
| Disallow | /academy/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rev.com.au/sitemap/sitemap-index.xml |
Warnings
- `host` is not a known field.