sweetwater.com
robots.txt

Robots Exclusion Standard data for sweetwater.com

Resource Scan

Scan Details

Site Domain sweetwater.com
Base Domain sweetwater.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-11-13T11:57:29+00:00
Next Scan 2024-11-20T11:57:29+00:00

Last Successful Scan

Scanned2024-10-29T11:57:23+00:00
URL https://sweetwater.com/robots.txt
Redirect https://www.sweetwater.com/robots.txt
Redirect Domain www.sweetwater.com
Redirect Base sweetwater.com
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 199.232.46.133
Found Yes
Hash deb6896fc82878483f46eb50eb94593e9446d1161b6c90aa30fb97337d705f67
SimHash 158098513734

Groups

*

Rule Path
Disallow /affirmthanks/
Disallow /store/checkout/
Disallow /myaccount/
Disallow /webservices_sw/
Disallow /store/cart.php
Allow */reviews
Allow /webservices_sw/content/cards/
Allow /webservices_sw/items/
Disallow /custom/westone/*?
Disallow /custom/mesa-boogie/*?
Disallow /customizer/64audio/*/*
Disallow /shop/24-fret-electric-guitars/?*
Disallow /shop/eligible-for-special-financing/?*
Disallow /sale/early-black-friday-2020
Disallow /c639--DW--Drums_and_Percussionhttp*
Disallow *Drums_and_Percussionhttps*
Disallow /store/best/half-stacks

googlebot

Rule Path
Disallow /store/search?s=wall*

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1.0

*

Rule Path
Disallow /store/best/footpedals?params=*
Disallow /store/best/computer_interfaces?params=*
Disallow /store/best/recording_interfaces?params=*
Disallow /store/best/guitar_amp_stacks?params=*

Other Records

Field Value
sitemap https://www.sweetwater.com/sitemap.xml
sitemap https://www.sweetwater.com/sweetcare/sitemap.xml
sitemap https://www.sweetwater.com/insync/sitemap.xml
sitemap https://www.sweetwater.com/insync/videos_sitemap.xml
sitemap https://www.sweetwater.com/used/sitemap.xml
sitemap https://www.sweetwater.com/sitemap_newproducts.xml

Comments

  • /robots.txt file for http://www.sweetwater.com/
  • mail webmaster@sweetwater.com for specific information
  • last updated 10-17-24 CAF