hillspet.ru
robots.txt

Robots Exclusion Standard data for hillspet.ru

Resource Scan

Scan Details

Site Domain hillspet.ru
Base Domain hillspet.ru
Scan Status Ok
Last Scan2024-06-18T00:01:37+00:00
Next Scan 2024-07-18T00:01:37+00:00

Last Scan

Scanned2024-06-18T00:01:37+00:00
URL https://hillspet.ru/robots.txt
Redirect https://www.hillspet.ru/robots.txt
Redirect Domain www.hillspet.ru
Redirect Base hillspet.ru
Domain IPs 34.230.254.189
Redirect IPs 23.52.40.16, 23.52.40.26, 2600:1417:3f::b81c:eb58, 2600:1417:3f::b81c:eb6b
Response IP 96.17.180.24
Found Yes
Hash 3e60f968a11b795c2f6caafca3fc870489fdac9d3be161ae8ecf64531a36adc0
SimHash 6d3c9879e69b

Groups

swiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /snippet/
Disallow *ru_ru.txt
Disallow */snippet/
Disallow */content/dam/cp-sites/hills/hills-pet/en_gb/general/documents/hills-100-guarantee-consumer-digital-version.pdf
Disallow /*?_BRAND=
Disallow /*?pr_rd_page=
Disallow /*?category_name=
Disallow /*?resource=
Disallow /*?_PRODUCTFORM=
Disallow /*?_SPECIES=
Disallow /*?_LIFESTAGE=
Disallow /*?Lightboxfired=
Disallow /*?_CONDITION=
Disallow /*?wcmmode=
Disallow /content/
Disallow /cp-sites/
Disallow /snippet/

Other Records

Field Value
sitemap https://www.hillspet.ru/sitemap.xml

Warnings

  • 1 invalid line.
  • `clean-param` is not a known field.