Log In Sign Up

myupchar.com
robots.txt

Robots Exclusion Standard data for myupchar.com

Resource Scan

Scan Details

Site Domain myupchar.com
Base Domain myupchar.com
Scan Status Ok
Last Scan2024-09-22T12:56:51+00:00
Next Scan 2024-09-29T12:56:51+00:00

Last Scan

Scanned2024-09-22T12:56:51+00:00
URL https://myupchar.com/robots.txt
Domain IPs 104.21.94.236, 172.67.141.155, 2606:4700:3033::6815:5eec, 2606:4700:3036::ac43:8d9b
Response IP 104.21.94.236
Found Yes
Hash 043268891bec76af5e8d17b774b5098cff112274442663e08efd27cfdc36ed42
SimHash a4d49f8d6265

Groups

*

Rule Path
Disallow /search
Disallow /r/
Disallow /product/
Disallow /supplier/save_review
Disallow /supplier/save_review_vote
Disallow /product/ask_review_mail
Disallow /product/description
Disallow /users/
Disallow /cart/
Disallow /community/
Disallow /orders/
Disallow /feeds/
Disallow /symptom/*/search*
Disallow /medicine/dosage
Disallow /health-questions/
Disallow /medicines/medicines_list
Disallow /en/medicines/medicines_list
Disallow /bn/medicines/medicines_list
Disallow /mr/medicines/medicines_list
Disallow /ta/medicines/medicines_list
Disallow /te/medicines/medicines_list
Disallow /prescriptions
Disallow /medicines_list
Disallow /en/medicines_list
Disallow /bn/medicines_list
Disallow /mr/medicines_list
Disallow /ta/medicines_list
Disallow /te/medicines_list
Disallow /hospitals/search

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Baiduspider
  • Yandex
Back to top