sweatybetty.com
robots.txt

Robots Exclusion Standard data for sweatybetty.com

Resource Scan

Scan Details

Site Domain sweatybetty.com
Base Domain sweatybetty.com
Scan Status Ok
Last Scan2024-09-19T14:43:41+00:00
Next Scan 2024-10-19T14:43:41+00:00

Last Scan

Scanned2024-09-19T14:43:41+00:00
URL https://sweatybetty.com/robots.txt
Redirect https://www.sweatybetty.com/robots.txt
Redirect Domain www.sweatybetty.com
Redirect Base sweatybetty.com
Domain IPs 104.17.57.1, 104.17.58.1
Redirect IPs 104.17.57.1, 104.17.58.1
Response IP 104.17.58.1
Found Yes
Hash 0217b51509e2c68d76f23db57bcdf24602b6e061977bfa23ecae69df32b1ccc5
SimHash eb1c447ba722

Groups

*

Rule Path
Disallow /*addwishlist
Disallow /*refine%3D
Disallow /*sort%3D
Disallow /*?siteId=
Disallow /*search
Disallow /search*
Disallow /*?q=
Disallow /*emailSignUp.html
Disallow /*?pid=
Disallow /*login?
Disallow /*?cgid
Disallow /*?srule
Disallow /birthday
Disallow /*strava-challenge
Disallow /*prefn1%3D
Disallow /*prefv1%3D
Disallow /*start%3D
Disallow /*pmax%3D
Disallow /*pmin%3D
Disallow /*Wishlist-Add
Disallow /*SendToFriend-Start
Disallow /*PowerReviews-WriteReview
Disallow /*Account-EmailaFriendDialog?
Disallow /*Product-Variation?pid=

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.sweatybetty.com/on/demandware.static/-/Library-Sites-sweatybettylibrary/default/sitemap/sitemap_global.xml
sitemap https://www.sweatybetty.com/sitemap_index.xml
sitemap https://www.sweatybetty.com/eu/sitemap_index.xml
sitemap https://www.sweatybetty.com/au/sitemap_index.xml
sitemap https://www.sweatybetty.com/us/sitemap_index.xml

Comments

  • OLD Rules kept for a few weeks after the release
  • END OF Old Rules
  • Global sitemap