petmeds.com
robots.txt

Robots Exclusion Standard data for petmeds.com

Resource Scan

Scan Details

Site Domain petmeds.com
Base Domain petmeds.com
Scan Status Ok
Last Scan2024-09-01T05:16:28+00:00
Next Scan 2024-10-01T05:16:28+00:00

Last Scan

Scanned2024-09-01T05:16:28+00:00
URL https://petmeds.com/robots.txt
Redirect https://www.1800petmeds.com/robots.txt
Redirect Domain www.1800petmeds.com
Redirect Base 1800petmeds.com
Domain IPs 108.156.133.127, 108.156.133.19, 108.156.133.40, 108.156.133.82, 2600:9000:2755:1200:1e:ea7:b900:93a1, 2600:9000:2755:1e00:1e:ea7:b900:93a1, 2600:9000:2755:2200:1e:ea7:b900:93a1, 2600:9000:2755:5200:1e:ea7:b900:93a1, 2600:9000:2755:5e00:1e:ea7:b900:93a1, 2600:9000:2755:6400:1e:ea7:b900:93a1, 2600:9000:2755:ec00:1e:ea7:b900:93a1, 2600:9000:2755:f200:1e:ea7:b900:93a1
Redirect IPs 104.16.134.104, 104.16.135.104
Response IP 104.16.134.104
Found Yes
Hash bdc12840a72fefd7047c627c9b20c1f3198dd155a30e27251888869ea63e318e
SimHash 2004c372c75c

Groups

*

Rule Path
Allow /
Disallow /*%3Bjsessionid*
Disallow /*%3Bjsessionid%3D*
Disallow /*%3Bjsessionid
Disallow /cart.jsp
Disallow /customerInfo.jsp
Disallow /request.jsp
Disallow /outofstock.jsp
Disallow /cart_redirect.jsp
Disallow /emailview.jsp
Disallow /.*emailview.jsp
Disallow /*?N=*
Disallow /*?Nr=*
Disallow /-.html?*
Disallow /*Account-CheckChat
Disallow /*Account-EditProfile
Disallow /*Account-EditEmail
Disallow /*Account-EditEmailPrefs
Disallow /*Account-EditPassword
Disallow /*Account-EditRxRefill
Disallow /*Account-EditRefillReminder
Disallow /*Account-LogoutView
Disallow /*Account-PasswordReset
Disallow /*Account-PaymentRemove
Disallow /*Account-ResetPasswordRequest
Disallow /*Account-ResetPasswordResponse
Disallow /*Account-PetNew
Disallow /*Account-PetEdit
Disallow /*Account-PetRemove
Disallow /*Account-PetSave
Disallow /*Account-SetNewPassword
Disallow /*Account-SetNewPasswordConfirm
Disallow /*Account-Show
Disallow /*Account-Registration
Disallow /*Account-VetEdit
Disallow /*Account-VetLogin
Disallow /*Account-VetNew
Disallow /*Account-WebChat
Disallow /*Address-List
Disallow /*Bazaarvoice-Container
Disallow /*Cart-Show
Disallow /*COBilling-Start
Disallow /*COCustomer-Start
Disallow /*Compare-Show
Disallow /*Compare-ShowBattle
Disallow /*Checkout-Begin
Disallow /*CheckoutServices-PlaceOrder
Disallow /*CheckoutServices-SubmitPayment
Disallow /*Default-Offline
Disallow /*Default-Start
Disallow /*Error-Start
Disallow /*Home-ErrorNotFound
Disallow /*Order-History
Disallow /*PaymentInstruments-List
Disallow /*Search-Show
Disallow /*Search-ShowContent
Disallow /*SourceCodeRedirect-Start
Disallow /account
Disallow /accountcreate
Disallow /addresslist
Disallow /billing
Disallow /cart
Disallow /compare
Disallow /confirm
Disallow /customer
Disallow /customerservicecontact
Disallow /customerserviceshow
Disallow /defaultstart
Disallow /editprofile
Disallow /errorstart
Disallow /maintenance
Disallow /newpasswordconfirm
Disallow /notfound
Disallow /orderhistory
Disallow /replenishauth
Disallow /replenishmaintain
Disallow /passwordreset
Disallow /paymentsettings
Disallow /search
Disallow /searchcontent
Disallow /setnewpassword
Disallow /shipping
Disallow /sourcecode
Disallow /submit
Disallow /submitreview

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Disallow /comparison?cgid=cat%5Cd%7B2%2C7%7D&p0=prod%5Cd%7B4%2C6%7D$
Disallow /Comparison-ShowBattle?

Other Records

Field Value
sitemap https://www.1800petmeds.com/sitemap_index.xml

Comments

  • Pipeline URLs
  • Pipeline URL Aliases
  • URL Query Parameters
  • Disallow: *product-show*
  • Disallow: *pmin*
  • Disallow: *pmax*
  • Disallow: *|*
  • Disallow: /*|*/*
  • Disallow: *%7C*
  • Disallow: *%7 C*
  • Disallow: *colorFamily*
  • Disallow: *prefv1*
  • Disallow: *prefv2*
  • Disallow: *prefn1*
  • Disallow: *prefn2*
  • Disallow: /*prefv1*
  • Disallow: /*prefv2*
  • Disallow: /*prefn1*
  • Disallow: /*prefn2*
  • Slow Down bingbot
  • Sitemap