Log In Sign Up

bestbuy.com
robots.txt

Robots Exclusion Standard data for bestbuy.com

Resource Scan

Scan Details

Site Domain bestbuy.com
Base Domain bestbuy.com
Scan Status Ok
Last Scan2024-11-11T01:39:33+00:00
Next Scan 2024-11-18T01:39:33+00:00

Last Scan

Scanned2024-11-11T01:39:33+00:00
URL https://bestbuy.com/robots.txt
Redirect https://www.bestbuy.com/robots.txt
Redirect Domain www.bestbuy.com
Redirect Base bestbuy.com
Domain IPs 23.207.192.215
Redirect IPs 23.73.12.165
Response IP 23.73.12.165
Found Yes
Hash a471fe5bf0638b000d554e0d01523cade2dae4a2dc9e9d97c4ea358e1383ec3c
SimHash 18cccb1ff095

Groups

*
googlebot

Rule Path
Disallow /nex/
Disallow /m/e/*
Disallow /site/builder/*
Disallow /site/olspage.jsp?id=pcat17098*
Disallow /site/olstemplatemapper.jsp?id=pcat17098*
Disallow /site/olspage.jsp?id=pcat17089*
Disallow /site/olstemplatemapper.jsp?id=pcat17089*
Disallow /site/olspage.jsp?id=cat13503*
Disallow /site/olstemplatemapper.jsp?id=cat13503*
Disallow /site/olspage.jsp?id=pcat17007*
Disallow /site/olstemplatemapper.jsp?id=pcat17007*
Disallow /site/olspage.jsp?id=pcat17408*
Disallow /site/olstemplatemapper.jsp?id=pcat17408*
Disallow /site/olspage.jsp?id=cat12091*
Disallow /site/olstemplatemapper.jsp?id=cat12091*
Disallow /site/olspage.jsp?id=pcat17005*
Disallow /site/olstemplatemapper.jsp?id=pcat17005*
Disallow /site/olspage.jsp?id=cat12076*
Disallow /site/olstemplatemapper.jsp?id=cat12076*
Disallow /site/olspage.jsp?id=cat12080*
Disallow /site/olstemplatemapper.jsp?id=cat12080*
Disallow /site/olspage.jsp?id=cat12101*
Disallow /site/olstemplatemapper.jsp?id=cat12101*
Disallow /site/olstemplatemapper.jsp?id=pcat17006*
Disallow /site/olspage.jsp?id=pcat17006*
Disallow /browse-api/*
Disallow /site/clp/test-pages/*
Disallow /site/test-pages/*
Disallow /site/misc/test-pages/*
Disallow /site/offer/*
Disallow /site/compare?skus=*
Disallow /api/*.json
Disallow /availability/*
Disallow /cart
Disallow /cart/*
Disallow /cartitems/*
Disallow /fulfillment/*
Disallow /location/*
Disallow /pricing/*
Disallow /productfulfillment/*
Disallow /profile/*
Disallow /*template%3D_gameDetailsTab
Disallow /*template%3D_movieDetailsTab
Disallow /*template%3D_musicDetailsTab
Disallow /*template%3D_softwareDetailsTab
Disallow /*template%3D_accessoriesTab
Disallow /*template%3D_castAndCrewTab
Disallow /*template%3D_editorialTab
Disallow /*template%3D_episodesTab
Disallow /*template%3D_protectionAndServicesTab
Disallow /*template%3D_specificationsTab
Disallow /*template%3D_featuresSpoke
Disallow /*template%3D_buyingOptionsNewTab
Disallow /site/modals/*
Disallow /site/clp/conditional-offers/*
Disallow /site/total-tech-support/*
Disallow /site/clp/annette-test-listing/*
Disallow /site/shop-view-test-page/*
Disallow /site/clp/test/*
Disallow /site/test-cloud-ready/*
Disallow /site/clp/mystery-rewards-certificate/pcmcat1524134875052.c?id=pcmcat1524134875052
Disallow /services/plans/*
Disallow /site/dni/*
Disallow /site/offerbuilder/*
Disallow /services/shoppingscheduler*
Disallow /site/test-page/*
Disallow /site/questions/submission*
Disallow /site/answers/submission*
Disallow /site/reviews/submission*
Disallow *%3D%3D$
Disallow */-?
Disallow */undefined$
Disallow */null$
Disallow *javascript%3Awinopengld*
Disallow */site/olspage.jsp*
Disallow */product-selector/*
Disallow /purchasehistory/gift-receipt*
Disallow /contact-us?*
Disallow /ease/email
Disallow /ihc/invoice*
Disallow /identity/newAccount?*
Disallow /identity/signin?*
Disallow /identity/signin/forgotPassword?*
Disallow /dossier/service/appointment/*/*-*
Disallow /dossier/service/appointment/search?*
Disallow *armodelformat_facet*
Disallow *awardtype_facet*
Disallow *awardwinner_facet*
Disallow *awardyear_facet*
Disallow *blenderfunctions_facet*
Disallow *boxdesign_facet*
Disallow *cast_facet*
Disallow *cleaningpathwidthrange_facet*
Disallow *consumerlifestage_facet*
Disallow *decade_facet*
Disallow *defrosttype_facet*
Disallow *departmentid_facet*
Disallow *depthtype_facet*
Disallow *displayport_facet*
Disallow *doorstylesv_facet*
Disallow *drawertype_facet*
Disallow *dynamiccategory_facet*
Disallow *effectivemegapixels_facet*
Disallow *flashmodesmv_facet*
Disallow *framematerialmv_facet*
Disallow *giftcardthemesv_facet*
Disallow *handletype_facet*
Disallow *headsetstylesv_facet*
Disallow *heatingsource_facet*
Disallow *imagesensorsize_facet*
Disallow *imagesensortype11_facet*
Disallow *includedcolors_facet*
Disallow *inkmodelcompatibilitymv_facet*
Disallow *internalorexternal_facet*
Disallow *laptopuse_facet*
Disallow *lengthofcable_facet*
Disallow *mattressmaterial_facet*
Disallow *maximumsensitivity_facet*
Disallow *minfocallengthrange_facet*
Disallow *mobileinternalmemory_facet*
Disallow *monitorresponsetimerange_facet*
Disallow *monitorsnumberofusb30typecports_facet*
Disallow *monitorsnumberofusb31typecports_facet*
Disallow *mountmaterial_facet*
Disallow *networkingcabletype_facet*
Disallow *numberofbedroomsef_facet*
Disallow *numberofburnerssv_facet*
Disallow *numberofbuttons_facet*
Disallow *numberofdryingcycles_facet*
Disallow *numberoffanspeedssv_facet*
Disallow *numberofhdmiinputssv_facet*
Disallow *numberoflanports_facet*
Disallow *numberofspeakers_facet*
Disallow *numberofspeedssv_facet*
Disallow *numberofthunderbolt_ports_facet*
Disallow *numberofwashrinsecycle_facet*
Disallow *papersize_facet*
Disallow *playbackformatsmv_facet*
Disallow *productcategories_facet*
Disallow *screensizediagonalrange_facet*
Disallow *securityconnectivity_facet*
Disallow *securityresolution_facet*
Disallow *securitystoragetype_facet*
Disallow *softwareformat_facet*
Disallow *sqbprocessormodel_facet*
Disallow *sqbtotalstoragecapacity_facet*
Disallow *stringtype_facet*
Disallow *subclassid_facet*
Disallow *subgenre_facet*
Disallow *thruthedoordispenser_facet*
Disallow *toastingslotssv_facet*
Disallow *totaltechdeals_facet*
Disallow *touchscreentype_facet*
Disallow *transferrate_facet*
Disallow *transistorsize_facet*
Disallow *transmitterdistance_facet*
Disallow *treeheight_facet*
Disallow *treelightbulbcolor_facet*
Disallow *tubfinishmv_facet*
Disallow *varyinganglescreen_facet*
Disallow *vendorcollection_facet*
Disallow *videomemory_facet*
Disallow *viewfindertypemv_facet*
Disallow *virtualrealitycompatibility_facet*
Disallow *wanportssv_facet*
Disallow *wearingstyle_facet*

getintentcrawler

Rule Path
Disallow /

adsbot-google
googlebot-image
mediapartners-google

Rule Path
Disallow

google-display-ads-bot

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://sitemaps.bestbuy.com/sitemaps_discover_learn.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_pdp.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_promos.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_qna.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_rnr.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_search_plps.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_standalone_qa.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_browse_plps.xml
sitemap https://sitemaps.bestbuy.com/sitemaps_manually_curated_pages.xml
Back to top

Comments

  • Crawler specific settings
Back to top