bathandbodyworks.widget.custhelp.com
robots.txt

Robots Exclusion Standard data for bathandbodyworks.widget.custhelp.com

Resource Scan

Scan Details

Site Domain bathandbodyworks.widget.custhelp.com
Base Domain custhelp.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-17T03:40:28+00:00
Next Scan 2026-01-15T03:40:28+00:00

Last Successful Scan

Scanned2023-06-06T23:09:17+00:00
URL https://bathandbodyworks.widget.custhelp.com/robots.txt
Domain IPs 147.154.107.92
Response IP 147.154.107.92
Found Yes
Hash c436eb3e4cc649e5b45570c8c0f17e160a1b7d3eeec6f83668f85ad0c14f5949
SimHash 2e4ada01c555

Groups

googlebot

Product Comment
googlebot Google # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

msnbot

Product Comment
msnbot MSN # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

slurp

Product Comment
slurp Yahoo! # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

Other Records

Field Value Comment
crawl-delay 0.2 ADDED BY HMS

teoma

Product Comment
teoma Ask.com # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

bingbot

Product Comment
bingbot Bing # ADDED BY HMS
Rule Path Comment
Disallow ADDED BY HMS

*

Product Comment
* ADDED BY HMS
Rule Path Comment
Disallow / ADDED BY HMS

Other Records

Field Value Comment
sitemap https://bathandbodyworks.custhelp.com/ci/sitemap/ ADDED BY HMS