bagsoflove.com
robots.txt

Robots Exclusion Standard data for bagsoflove.com

Resource Scan

Scan Details

Site Domain bagsoflove.com
Base Domain bagsoflove.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-30T05:21:02+00:00
Next Scan 2024-10-28T05:21:02+00:00

Last Successful Scan

Scanned2024-03-10T03:52:50+00:00
URL https://bagsoflove.com/robots.txt
Redirect https://www.bagsoflove.com/robots.txt
Redirect Domain www.bagsoflove.com
Redirect Base bagsoflove.com
Domain IPs 108.157.254.101, 108.157.254.122, 108.157.254.69, 108.157.254.71
Redirect IPs 108.157.254.101, 108.157.254.122, 108.157.254.69, 108.157.254.71
Response IP 108.157.254.69
Found Yes
Hash e0a76841f19138f8d8f9e52e9208739f5764976aaec35a4db56aa38e4e28baf7
SimHash e99199f06ff5

Groups

googlebot
googlebot-image

Rule Path
Allow /estore/design/
Allow /estore/*.css
Allow /estore/*.axd
Allow /estore/api/price/
Disallow /estore
Disallow /contest/submit
Disallow /store/

adsbot-google
adsbot-google-mobile
*

Rule Path
Disallow /store/
Disallow /estore
Disallow /contest/submit
Allow /estore/api/price/

rogerbot

Rule Path
Disallow /ugc/
Disallow /eStore/
Disallow /blog/category/
Disallow /blog/tag/
Disallow /estore/
Disallow /gifts/
Disallow /include/
Disallow /stores/
Disallow /media/
Disallow /resources/
Disallow /faq/
Disallow /blog/author/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.bagsoflove.com/sitemap.xml
sitemap https://www.bagsoflove.com/storesitemap.xml
sitemap https://www.bagsoflove.com/storecollectionsitemap.xml