spitwater.com.au
robots.txt
Robots Exclusion Standard data for spitwater.com.au
Resource Scan
Scan Details
| Site Domain | spitwater.com.au |
| Base Domain | spitwater.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-17T05:37:01+00:00 |
| Next Scan | 2024-10-17T05:37:01+00:00 |
Last Scan
| Scanned | 2024-09-17T05:37:01+00:00 |
| URL | https://spitwater.com.au/robots.txt |
| Domain IPs | 18.155.68.129, 18.155.68.21, 18.155.68.79, 18.155.68.85 |
| Response IP | 18.155.68.129 |
| Found | Yes |
| Hash | 039858f8a364be78f487b750aeea0d4d30ba72e5b3857d0270c420449683b8cb |
| SimHash | c200fe32c1f1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /compare/ |
| Disallow | /rss.php* |
| Disallow | /product_images/ |
| Disallow | /automotive/ |
| Disallow | /goldline* |
| Disallow | /wishlist* |
| Disallow | /commercial/ |
| Disallow | /brands/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://spitwater.com.au/sitemap-index.xml |
Warnings
- `host` is not a known field.