doctor.webmd.com
robots.txt

Robots Exclusion Standard data for doctor.webmd.com

Resource Scan

Scan Details

Site Domain doctor.webmd.com
Base Domain webmd.com
Scan Status Ok
Last Scan2024-05-09T08:44:39+00:00
Next Scan 2024-05-23T08:44:39+00:00

Last Scan

Scanned2024-05-09T08:44:39+00:00
URL https://doctor.webmd.com/robots.txt
Domain IPs 104.18.43.59, 172.64.144.197
Response IP 172.64.144.197
Found Yes
Hash bf9a9004479e3c690a1e018187daaecf95bc66ffbcda9d34f6b4c13275d1bf42
SimHash 08578a544113

Groups

*

Rule Path
Disallow /results*
Disallow /*?*write-review
Disallow /doctor/.*/claim
Disallow /doctor/.*/thanks
Disallow *sort%3Doldest*
Disallow *sort%3Dhigh*
Disallow *sort%3Dlow*
Disallow *fpmspecid%3D29298%2C29272*
Disallow /content/ss*
Disallow /kapi/
Disallow /api/

sortsite/5.36.866.0

Rule Path
Allow /

sortsite/5.38.880.0

Rule Path
Allow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://doctor.webmd.com/sitemap-xmls/overview/overview-index.xml

Comments

  • robots.txt for http://doctor.webmd.com
  • Updated 8/24/2023