bagsoflove.ae
robots.txt

Robots Exclusion Standard data for bagsoflove.ae

Resource Scan

Scan Details

Site Domain bagsoflove.ae
Base Domain bagsoflove.ae
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-03T02:52:13+00:00
Next Scan 2024-08-02T02:52:13+00:00

Last Successful Scan

Scanned2024-03-13T02:36:13+00:00
URL https://bagsoflove.ae/robots.txt
Redirect https://www.bagsoflove.ae/robots.txt
Redirect Domain www.bagsoflove.ae
Redirect Base bagsoflove.ae
Domain IPs 13.33.88.129, 13.33.88.35, 13.33.88.62, 13.33.88.65
Redirect IPs 13.33.88.129, 13.33.88.35, 13.33.88.62, 13.33.88.65
Response IP 13.33.88.35
Found Yes
Hash dd440de1d2a9762fd9c2feda8e460b78ae13481605d76e87b381582c79aa38e9
SimHash 48019860eb94

Groups

adsbot-google
adsbot-google-mobile
*

Rule Path
Disallow /store/
Disallow /estore/design/
Disallow /estore/basket
Disallow /estore/mobile/
Disallow /estore/preview/
Disallow /estore/account/
Disallow /estore/montage/
Disallow /estore/productdesign/
Disallow /estore/mvcupload/
Disallow /estore/order/
Disallow /estore/ruler/
Disallow /estore/BraintreeDropinUi/
Disallow /estore/paypal/
Disallow /estore/validation/
Disallow /estore/instagram/
Disallow /estore/clientcheckout/
Disallow /estore/PreviewHelp/
Disallow /estore/api/
Disallow /estore/contrado3d/
Disallow /contest/submit
Disallow /estore/StoresApi/GetStoreProductInfo
Allow /estore/api/price/

rogerbot

Rule Path
Disallow /ugc/
Disallow /eStore/
Disallow /blog/category/
Disallow /blog/tag/
Disallow /estore/
Disallow /gifts/
Disallow /include/
Disallow /stores/
Disallow /media/
Disallow /resources/
Disallow /faq/
Disallow /blog/author/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.bagsoflove.ae/sitemap.xml
sitemap https://www.bagsoflove.ae/storesitemap.xml
sitemap https://www.bagsoflove.ae/storecollectionsitemap.xml