henkel.gr
robots.txt

Robots Exclusion Standard data for henkel.gr

Resource Scan

Scan Details

Site Domain henkel.gr
Base Domain henkel.gr
Scan Status Ok
Last Scan2024-09-23T07:47:46+00:00
Next Scan 2024-10-07T07:47:46+00:00

Last Scan

Scanned2024-09-23T07:47:46+00:00
URL https://henkel.gr/robots.txt
Redirect https://www.henkel.gr/robots.txt
Redirect Domain www.henkel.gr
Redirect Base henkel.gr
Domain IPs 185.132.25.11
Redirect IPs 185.132.25.11
Response IP 185.132.25.11
Found Yes
Hash 2a2a5f8a311038f3706d9bd1316d2dd7ff9c0f9c5a6de920ba80520cdc7bad13
SimHash c904c8604633

Groups

*

Rule Path
Allow /
Disallow /*ajax/collection

searchatlas

Rule Path
Allow /
Disallow /*ajax/collection

Other Records

Field Value
crawl-delay 6

semrushbot

Rule Path
Allow /
Disallow /*ajax/collection

Other Records

Field Value
crawl-delay 6

Other Records

Field Value
sitemap https://www.henkel.gr/service-sitemap-GR-sitemap_index.xml

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.