smartpak.com
robots.txt

Robots Exclusion Standard data for smartpak.com

Resource Scan

Scan Details

Site Domain smartpak.com
Base Domain smartpak.com
Scan Status Ok
Last Scan2024-09-16T07:33:03+00:00
Next Scan 2024-10-16T07:33:03+00:00

Last Scan

Scanned2024-09-16T07:33:03+00:00
URL https://smartpak.com/robots.txt
Redirect https://www.smartpakequine.com/robots.txt
Redirect Domain www.smartpakequine.com
Redirect Base smartpakequine.com
Domain IPs 23.215.7.24, 23.215.7.30, 2600:1413:b000:1b::17d7:718, 2600:1413:b000:1b::17d7:71e
Redirect IPs 23.215.7.24, 23.215.7.30, 2600:1413:b000:1b::17d7:718, 2600:1413:b000:1b::17d7:71e
Response IP 23.32.29.11
Found Yes
Hash d8ac7584f89b54feb47bb93661efde276e59831c3bee1cfeb65f9d28fd61d7c7
SimHash 230cf878a100

Groups

*

Rule Path
Allow /*?$
Disallow /productclass.aspx?productClassid=2461*
Disallow /productclass.aspx?productClassid=3747*
Disallow /western/CartView.aspx*
Disallow /western/HeaderNavigation.aspx*
Disallow /pdfs/SmartGut_Ultra_Research_Summary.pdf*
Disallow /account/register*
Disallow /search*
Disallow /Search*
Disallow /query*
Disallow /product/*/productDescriptions?tabType=Description
Disallow /product/*/AddSupply
Disallow /smartomega-3-ultra--equinox-365--12068p
Disallow /content/Supplement-Ingredients-Backed-by-Research
Disallow /content/content/Supplement-Ingredients-Backed-by-Research
Disallow /newsletter/
Disallow /ps/smartshine-6317
Disallow /ps/smartshine-ultra-6319
Disallow /ps/smartgain-4505
Disallow /mobile/ps/6317
Disallow /mobile/ps/6319
Disallow /mobile/ps/4505
Disallow /ps/smartflex-iv-ultimate-pellets-8293
Disallow /ps/smartflex-senior-pellets-7472
Disallow /ps/smartflex-rehab-pellets-9820
Disallow /mobile/ps/8293
Disallow /mobile/ps/7472
Disallow /mobile/ps/9820
Disallow /ps/smartflex-i-maintenance-pellets-7183
Disallow /ps/smartflex-ii-support-pellets-7184
Disallow /ps/smartflex-iii-resilience-pellets-7186
Disallow /ps/smartflex-senior-herbfree-pellets-8243
Disallow /mobile/ps/7183
Disallow /mobile/ps/7184
Disallow /mobile/ps/7186
Disallow /mobile/ps/8243
Disallow /ps/smartflex-senior-powder-4665
Disallow /ps/smartflex-i-maintenance-powder-3523
Disallow /ps/smartflex-iii-resilience-powder-4662
Disallow /mobile/ps/4665
Disallow /mobile/ps/3523
Disallow /mobile/ps/4662
Disallow *ProductClassDescription.aspx
Disallow /Wishlist?wishlistId=*
Disallow /cancellation/
Disallow /Cancellation/
Disallow /ps/smartflex-i-maintenance-pellets-original-7183
Disallow /ps/smartgain-original-4505
Disallow /ps/smartflex-senior-herbfree-pellets-original-8243
Disallow /ps/smartshine-original-6317
Disallow /ps/smartshine-ultra-original-6319
Disallow /ps/smartflex-rehab-pellets-original-9820
Disallow /ps/smartflex-ii-support-pellets-original-7184
Disallow /ps/smartflex-i-maintenance-powder-original-3523
Disallow /ps/smartflex-iii-resilience-pellets-original-7186
Disallow /ps/smartflex-iii-resilience-powder-original-4662
Disallow /ps/smartflex-senior-pellets-original-7472
Disallow /ps/smartflex-senior-powder-original-4665
Disallow /*/productDescriptions
Disallow /pt/pt/
Disallow /ps/ps/
Disallow /ProductCompare.aspx
Disallow /ProductClass.aspx
Disallow /Category.aspx
Disallow /CatalogRequest.aspx
Disallow /WhySmartPak.aspx
Disallow /productclass.aspx
Disallow /smartsupplements-849pc.aspx
Disallow /pt/ProductClass.aspx
Disallow /SmartPakSingleCalculator.aspx
Disallow /ProductClassNoLongerAvailable.aspx
Disallow /TeamSmartPakOrder.aspx
Disallow /products/customization/ShowAllOptionValues.aspx
Disallow /footwear-321pc.aspx
Disallow /tack-room-supplies-329pc.aspx
Disallow /rider-apparel-and-gear-365c.aspx
Disallow /hunterjumper-bridles-713pc.aspx
Disallow /horse-tack-supplies-and-equipment-687c.aspx
Disallow /horse-blankets-sheets-and-coolers-182c.aspx
Disallow /kids-casual-riding-apparel-and-accessories-1137pc.aspx
Disallow /horse-turnouts-307pc.aspx
Disallow /horse-bridles-692pc.aspx
Disallow /dog-food-485pc.aspx
Disallow /team-smartpak/jim-searles.aspx
Disallow /horse-coolers-303pc.aspx
Disallow /outerwear-318pc.aspx
Disallow /dog-and-cat-products-1214c.aspx
Disallow /equestrian-shirts-and-tops-320pc.aspx
Disallow /horse-grooming-supplies-4pc.aspx
Disallow /breeches-848pc.aspx
Disallow /bags-and-totes-221pc.aspx
Disallow /sale--view-all-dog-and-cat-540pc.aspx
Disallow /mountain-horse-1119pc.aspx
Disallow /horse-weight-gain-supplements-10pc.aspx
Disallow /equestrian-riding-helmets-392pc.aspx
Disallow /Sites/Canine/WhatIsAPortionPak.aspx
Disallow /protective-vests-824pc.aspx
Disallow /plussize-riding-gear--1057pc.aspx
Disallow /horse-hoof-supplements-6pc.aspx
Disallow /horse-fleeces-476pc.aspx
Disallow /horse-bits-773pc.aspx
Disallow /equestrian-apparel-and-shoes-by-brand-732pc.aspx
Disallow /boots-1294pc.aspx
Disallow /Products/Customization/ShowAllOptionValues.aspx
Disallow /happy-mouth-1078pc.aspx
Disallow /studs-and-plugs-248pc.aspx
Disallow /stirrup-leathers-1148pc.aspx
Disallow /spurs-1217pc.aspx
Disallow /horse-health-care-products-686c.aspx
Disallow /dog-supplies-1209pc.aspx
Disallow /horse-show-apparel-747pc.aspx

nimblecrawler

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

adsbot-google
adsbot-google-mobile

Rule Path
Disallow /Search/Searcha
Disallow /Search/searcha
Disallow /search/searcha
Disallow /search/Searcha
Disallow /Search/Searchp
Disallow /Search/searchp
Disallow /search/searchp
Disallow /search/Searchp

Other Records

Field Value
sitemap https://www.smartpakequine.com/sitemap.xml
sitemap https://www.smartpakequine.com/videositemap.xml
sitemap https://www.smartpakequine.com/trends/th-sitemap-0.xml.gz

Warnings

  • `noindex` is not a known field.