benefitcosmetics.com
robots.txt

Robots Exclusion Standard data for benefitcosmetics.com

Resource Scan

Scan Details

Site Domain benefitcosmetics.com
Base Domain benefitcosmetics.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-01T18:30:20+00:00
Next Scan 2024-11-08T18:30:20+00:00

Last Successful Scan

Scanned2024-10-17T10:49:37+00:00
URL https://benefitcosmetics.com/robots.txt
Redirect https://www.benefitcosmetics.com/robots.txt
Redirect Domain www.benefitcosmetics.com
Redirect Base benefitcosmetics.com
Domain IPs 23.215.7.11, 23.215.7.25, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:719
Redirect IPs 23.215.7.11, 23.215.7.25, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:719
Response IP 23.215.7.25
Found Yes
Hash cfb1a8b041d000bff5838181fc1325dd12a94e5c0e82bd806747fe639cede302
SimHash a9c5597bcd10

Groups

*

Rule Path
Disallow /EPiServer/CMS/
Disallow /Util/
Disallow /checkout
Disallow /cart

Other Records

Field Value
sitemap https://www.benefitcosmetics.com/de-de/sitemap_index.xml
sitemap https://www.benefitcosmetics.com/fr-fr/sitemap_index.xml
sitemap https://www.benefitcosmetics.com/en-gb/sitemap_index.xml
sitemap https://www.benefitcosmetics.com/en-us/sitemap_index.xml
sitemap https://www.benefitcosmetics.com/en-au/sitemap_index.xml