mayocliniclabs.com
robots.txt

Robots Exclusion Standard data for mayocliniclabs.com

Resource Scan

Scan Details

Site Domain mayocliniclabs.com
Base Domain mayocliniclabs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-30T11:38:40+00:00
Next Scan 2024-08-28T11:38:40+00:00

Last Successful Scan

Scanned2023-10-11T08:25:58+00:00
URL https://mayocliniclabs.com/robots.txt
Redirect https://www.mayocliniclabs.com/robots.txt
Redirect Domain www.mayocliniclabs.com
Redirect Base mayocliniclabs.com
Domain IPs 129.176.1.88
Redirect IPs 23.50.82.13
Response IP 23.15.108.2
Found Yes
Hash 750824702efebf49419854a01df7e9e8667e7045ed2711dfe5819167fc024eb2
SimHash 19e820c0e721

Groups

*

Rule Path
Disallow *.csi
Disallow /_baks/
Disallow /_mm/
Disallow /_notes/
Disallow /Archived/
Disallow /customer-service/client-price-lookup/index.html
Disallow /customer-service/billing/pay/
Disallow /customer-service/billing/pfa.html
Disallow /it-mmfiles/active-referred-tests.xlsx
Disallow /it-mmfiles/z-code-identifiers.xlsx
Disallow /mediax/
Disallow /MMWIP/
Disallow /mobile/
Disallow /mockup/
Disallow /qa/
Disallow /register/index.php
Disallow /search.php
Disallow /test-catalog/appendix/referred-tests.html
Disallow /test-catalog/appendix/policies-ReadMe.txt
Disallow /test-catalog/diseases/
Disallow /test-catalog/print/
Disallow /test-catalog/search.php
Disallow /test-catalog/setup.php
Disallow /test-info/pediatric/refvalues/
Disallow /test-notifications/z-code-identifiers-index.html
Disallow /customer-service/billing/pfa.html

Other Records

Field Value
crawl-delay 5