bathandbodyworks.cr
robots.txt

Robots Exclusion Standard data for bathandbodyworks.cr

Resource Scan

Scan Details

Site Domain bathandbodyworks.cr
Base Domain bathandbodyworks.cr
Scan Status Ok
Last Scan2024-08-28T03:33:23+00:00
Next Scan 2024-09-27T03:33:23+00:00

Last Scan

Scanned2024-08-28T03:33:23+00:00
URL https://www.bathandbodyworks.cr/robots.txt
Domain IPs 13.35.18.102, 13.35.18.118, 13.35.18.31, 13.35.18.36, 2600:9000:20c7:3800:a:b014:3800:93a1, 2600:9000:20c7:3a00:a:b014:3800:93a1, 2600:9000:20c7:400:a:b014:3800:93a1, 2600:9000:20c7:8200:a:b014:3800:93a1, 2600:9000:20c7:9600:a:b014:3800:93a1, 2600:9000:20c7:b200:a:b014:3800:93a1, 2600:9000:20c7:ba00:a:b014:3800:93a1, 2600:9000:20c7:c800:a:b014:3800:93a1
Response IP 13.35.18.118
Found Yes
Hash fb3fd24aaecf1f38a58f4c4f8fedda456e581a17517f369510a46f300d4d5435
SimHash f438cd474dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap http://bathandbodyworks.cr/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.