vaidam.com
robots.txt

Groups

*

Other Records

Comments

• robots.txt
• This file is to prevent the crawling and indexing of certain parts
• of your site by web crawlers and spiders run by sites like Yahoo!
• and Google. By telling these "robots" where not to go on your site,
• you save bandwidth and server resources.
• This file will be ignored unless it is at the root of your host:
• Used: http://example.com/robots.txt
• Ignored: http://example.com/site/robots.txt
• For more information about the robots.txt standard, see:
• http://www.robotstxt.org/robotstxt.html
• ElasticSearch Admin - Blocked for all search engines
• Disallowed Other Urls 17-12-24
• Disallowed Language Urls 24-02-25
• Disallowed Country Urls 17-12-24 start
• reopen country on 27-02-25
• Disallow: */cyprus/*
• Disallow: */israel/*
• Disallow: */lithuania/*
• Disallow: */poland/*
• Disallow: */saudi-arabia/*
• Disallow: */switzerland/*
• Disallow: */austria/*
• Disallow: */cyprus$
• Disallow: */israel$
• Disallow: */lithuania$
• Disallow: */poland$
• Disallow: */saudi-arabia$
• Disallow: */switzerland$
• Disallow: */austria$
• Disallowed City Urls 17-12-24
• disallowed Treatment Urls 17-12-24
• Disallowed Tags Urls Without Search 21-12-24
• Disallowed Tags Urls With Search 21-12-24
• Disallowed Speciality urls 18-12-24
• Reopen on 27-02-25
• Disallow: */advanced-laparoscopic-minimal-access-and-bariatric-surgeon/*
• Disallow: */aesthetics-and-plastic-surgeon/*
• Disallow: */anaesthesia/*
• Disallow: */anaesthesia-pain-management-and-palliative-care/*
• Disallow: */anaesthetist/*
• Disallow: */arthoscopy-and-sports-medicine/*
• Disallow: */cardiac-surgeon/*
• Disallow: */cataract-surgeon/*
• Disallow: */colo-rectal-surgeon/*
• Disallow: */cornea-specialist/*
• Disallow: */cosmetic-surgeon/*
• Disallow: */dentist/*
• Disallow: */dermatologist/*
• Disallow: */dietician/*
• Disallow: */electrophysiologist/*
• Disallow: */endocrinologist-0/*
• Disallow: */endocrinologist/*
• Disallow: */endodontist/*
• Disallow: */endourologist/*
• Disallow: */endovascular-surgeon/*
• Disallow: */ent-surgeon/*
• Disallow: */foot-and-ankle-surgery/*
• Disallow: */general-paediatrician/*
• Disallow: */general-surgeon/*
• Disallow: */glaucoma-surgeon/*
• Disallow: */gynaecologist-and-obstetrician/*
• Disallow: */gynaecologist-and-obstetrician-0/*
• Disallow: */hair-transplant-specialist/*
• Disallow: */hand-and-wrist-surgery/*
• Disallow: */hematologist/*
• Disallow: */hepato-pancreato-biliary-surgeon/*
• Disallow: */hip-surgery/*
• Disallow: */implantologist/*
• Disallow: */infectious-disease-specialist/*
• Disallow: */infertility-specialist/*
• Disallow: */internal-medicine/*
• Disallow: */internal-medicine-0/*
• Disallow: */interventional-cardiologist/*
• Disallow: */interventional-radiologist/*
• Disallow: */ivf-specialist/*
• Disallow: */laparoscopic-surgeon/*
• Disallow: */liver-transplant-surgeon/*
• Disallow: */medical-gastroenterologist/*
• Disallow: */medical-oncologist/*
• Disallow: */neonatologist/*
• Disallow: */nephrologist/*
• Disallow: */nephrologlist/*
• Disallow: */neuro-intervention-radiologist/*
• Disallow: */neuro-ophthalmologist/*
• Disallow: */neurologist/*
• Disallow: */non-invasive-cardiologist/*
• Disallow: */nuclear-medicine/*
• Disallow: */obesity-and-bariatric-surgeon/*
• Disallow: */ocular-oncologist/*
• Disallow: */oculoplasty-specialist/*
• Disallow: */onco-nephrologist/*
• Disallow: */ophthalmologist/*
• Disallow: */oral-maxillofacial-surgeon/*
• Disallow: */orthodontist/*
• Disallow: */orthopaedic-and-joint-replacement-surgeon/*
• Disallow: */orthopaedic-oncologist/*
• Disallow: */orthopaedic-oncosurgeon/*
• Disallow: */orthopaedic-oncosurgeon-0/*
• Disallow: */paediatric-nephrologist/*
• Disallow: */paediatric-neurologist/*
• Disallow: */paediatric-ophthalmologist/*
• Disallow: */paediatric-orthopedecian/*
• Disallow: */paediatrician/*
• Disallow: */paedodontist/*
• Disallow: */pathologist/*
• Disallow: */pathology/*
• Disallow: */pediatric-cardiac-surgeon/*
• Disallow: */pediatric-cardiologist/*
• Disallow: */pediatric-endocrinologist/*
• Disallow: */pediatric-endocrinologist-0/*
• Disallow: */pediatric-gastroenterologist/*
• Disallow: */pediatric-hematologist/*
• Disallow: */pediatric-oncologist/*
• Disallow: */pediatric-pulmonologist/*
• Disallow: */pediatric-rheumatologist/*
• Disallow: */pediatric-urologist/*
• Disallow: */periodontist/*
• Disallow: */physician/*
• Disallow: */physiotherapist/*
• Disallow: */prosthodontist/*
• Disallow: */psychiatrist/*
• Disallow: */psychologist/*
• Disallow: */pulmonologist/*
• Disallow: */radiation-oncologist/*
• Disallow: */radiology/*
• Disallow: */refractive-surgeon/*
• Disallow: */retinal-ophthalmologist/*
• Disallow: */rheumatologist/*
• Disallow: */sexologist/*
• Disallow: */shoulder-surgery/*
• Disallow: */spine-and-pain-specialist/*
• Disallow: */spine-surgeon/*
• Disallow: */squint-specialist/*
• Disallow: */stem-cell-specialist/*
• Disallow: */surgeon/*
• Disallow: */surgical-gastroenterologist/*
• Disallow: */surgical-oncologist/*
• Disallow: */testing-psy-master-specialty/*
• Disallow: */testing-psy-super-speciality/*
• Disallow: */upper-gastrointestinal-tract-surgeon/*
• Disallow: */urologist/*
• Disallow: */urologist-and-andrologist/*
• Disallow: */urologist-and-renal-transplant-specialist/*
• Disallow: */vascular-surgeon/*
• Crawl-delay: 10
• Directories
• Files
• Paths (clean URLs)
• Disallow: /tag-search/
• Paths (no clean URLs)
• Disallow: /hp/