lorealprofessionnel.id
robots.txt

Robots Exclusion Standard data for lorealprofessionnel.id

Resource Scan

Scan Details

Site Domain lorealprofessionnel.id
Base Domain lorealprofessionnel.id
Scan Status Ok
Last Scan2024-10-06T12:28:47+00:00
Next Scan 2024-10-20T12:28:47+00:00

Last Scan

Scanned2024-10-06T12:28:47+00:00
URL https://lorealprofessionnel.id/robots.txt
Redirect https://www.lorealprofessionnel.id/robots.txt
Redirect Domain www.lorealprofessionnel.id
Redirect Base lorealprofessionnel.id
Domain IPs 104.17.48.201, 104.18.111.193, 2606:4700::6811:30c9, 2606:4700::6812:6fc1
Redirect IPs 104.17.48.201, 104.18.111.193, 2606:4700::6811:30c9, 2606:4700::6812:6fc1
Response IP 104.17.48.201
Found Yes
Hash faac639fa9128f021902cf081ba345c0983bae3bcc9552a04d7eee314e659a59
SimHash 3a813a14c430

Groups

*

Rule Path
Disallow /sitecore
Disallow */api/popin/
Disallow */api/productsearch/
Disallow */api/popin/Video/
Disallow /sitecore/*
Disallow /Sitecore
Disallow /Sitecore/*
Disallow /sitecore_files/
Disallow /App_Browsers/
Disallow /App_Config/
Disallow /App_Data/
Disallow /temp
Disallow /xsl/
Disallow */api/popin/*
Disallow /api/productsearch/*
Disallow /api/popin/Video/*
Disallow /search*

Other Records

Field Value
sitemap https://www.lorealprofessionnel.id/sitemap.xml

Warnings

  • 1 invalid line.