henkel.at
robots.txt

Robots Exclusion Standard data for henkel.at

Resource Scan

Scan Details

Site Domain henkel.at
Base Domain henkel.at
Scan Status Ok
Last Scan2024-09-20T12:33:55+00:00
Next Scan 2024-10-04T12:33:55+00:00

Last Scan

Scanned2024-09-20T12:33:55+00:00
URL https://henkel.at/robots.txt
Redirect https://www.henkel.at/robots.txt
Redirect Domain www.henkel.at
Redirect Base henkel.at
Domain IPs 185.132.25.11
Redirect IPs 185.132.25.11
Response IP 185.132.25.11
Found Yes
Hash 4521dc7ab3c831f0b07472bd99820046c42b9e5bc35f51123f5b2311ad13ea20
SimHash a904d0604633

Groups

*

Rule Path
Allow /
Disallow /*ajax/collection
Disallow /179458-179458
Disallow /presse-und-medien/presseinformationen-und-pressemappen/2022-03-04-henkel-stoppt-investitionen-in-russland-1626158

searchatlas

Rule Path
Allow /
Disallow /*ajax/collection
Disallow /179458-179458
Disallow /presse-und-medien/presseinformationen-und-pressemappen/2022-03-04-henkel-stoppt-investitionen-in-russland-1626158

Other Records

Field Value
crawl-delay 6

semrushbot

Rule Path
Allow /
Disallow /*ajax/collection
Disallow /179458-179458
Disallow /presse-und-medien/presseinformationen-und-pressemappen/2022-03-04-henkel-stoppt-investitionen-in-russland-1626158

Other Records

Field Value
crawl-delay 6

Other Records

Field Value
sitemap https://www.henkel.at/service-sitemap-at-sitemap_index.xml

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.