hillspet.com.au
robots.txt
Robots Exclusion Standard data for hillspet.com.au
Resource Scan
Scan Details
Site Domain | hillspet.com.au |
Base Domain | hillspet.com.au |
Scan Status | Ok |
Last Scan | 2024-11-09T22:51:48+00:00 |
Next Scan | 2024-12-09T22:51:48+00:00 |
Last Scan
Scanned | 2024-11-09T22:51:48+00:00 |
URL | https://www.hillspet.com.au/robots.txt |
Domain IPs | 2600:1413:b000:1b::17d7:717, 2600:1413:b000:1b::17d7:71e, 96.17.180.45, 96.17.180.50 |
Response IP | 96.17.180.171 |
Found | Yes |
Hash | 938ac03706da00a3c9321c944d7ea542296c086abb97789b68a65896296b5b94 |
SimHash | 6d2c1a798793 |
Groups
*
Rule | Path |
---|---|
Disallow | */content/dam/cp-sites/hills/hills-pet/en_gb/general/documents/hills-100-guarantee-consumer-digital-version.pdf |
Disallow | /*?_BRAND= |
Disallow | /*?pr_rd_page= |
Disallow | /*?category_name= |
Disallow | /*?resource= |
Disallow | /*?_PRODUCTFORM= |
Disallow | /*?_SPECIES= |
Disallow | /*?_LIFESTAGE= |
Disallow | /*?Lightboxfired= |
Disallow | /*?_CONDITION= |
Disallow | /*?wcmmode= |
Disallow | /content/ |
Disallow | /cp-sites/ |
Disallow | /snippet/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.hillspet.com.au/sitemap.xml |
Warnings
- 1 invalid line.
- `x-robots-tag` is not a known field.