doctor.com
robots.txt

Robots Exclusion Standard data for doctor.com

Resource Scan

Scan Details

Site Domain doctor.com
Base Domain doctor.com
Scan Status Ok
Last Scan2024-10-05T16:36:56+00:00
Next Scan 2024-10-12T16:36:56+00:00

Last Scan

Scanned2024-10-05T16:36:56+00:00
URL https://doctor.com/robots.txt
Redirect https://www.doctor.com/robots.txt
Redirect Domain www.doctor.com
Redirect Base doctor.com
Domain IPs 3.164.85.46, 3.164.85.61, 3.164.85.84, 3.164.85.9
Redirect IPs 104.18.2.82, 104.18.3.82, 2606:4700::6812:252, 2606:4700::6812:352
Response IP 104.18.3.82
Found Yes
Hash cd9201fc88fdde20d6ce2974c4de1325c4389c5b16250b2625fc5f20e10fc36d
SimHash 031aca22c3b3

Groups

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /Find-A-Doctor.php
Disallow /find-a-doctor
Disallow /site/webrequest
Disallow /review_requests
Disallow /index.php?r=site%2Fwebrequest
Disallow /index.php
Disallow /*.pdf

powermapper

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.doctor.com/sitemap-index.xml
sitemap https://www.doctor.com/sitemap_index.xml