mayocliniclabs.com
robots.txt
Robots Exclusion Standard data for mayocliniclabs.com
Resource Scan
Scan Details
Site Domain | mayocliniclabs.com |
Base Domain | mayocliniclabs.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-28T11:39:04+00:00 |
Next Scan | 2024-11-26T11:39:04+00:00 |
Last Successful Scan
Scanned | 2023-10-11T08:25:58+00:00 |
URL | https://mayocliniclabs.com/robots.txt |
Redirect | https://www.mayocliniclabs.com/robots.txt |
Redirect Domain | www.mayocliniclabs.com |
Redirect Base | mayocliniclabs.com |
Domain IPs | 129.176.1.88 |
Redirect IPs | 23.50.82.13 |
Response IP | 23.15.108.2 |
Found | Yes |
Hash | 750824702efebf49419854a01df7e9e8667e7045ed2711dfe5819167fc024eb2 |
SimHash | 19e820c0e721 |
Groups
*
Rule | Path |
---|---|
Disallow | *.csi |
Disallow | /_baks/ |
Disallow | /_mm/ |
Disallow | /_notes/ |
Disallow | /Archived/ |
Disallow | /customer-service/client-price-lookup/index.html |
Disallow | /customer-service/billing/pay/ |
Disallow | /customer-service/billing/pfa.html |
Disallow | /it-mmfiles/active-referred-tests.xlsx |
Disallow | /it-mmfiles/z-code-identifiers.xlsx |
Disallow | /mediax/ |
Disallow | /MMWIP/ |
Disallow | /mobile/ |
Disallow | /mockup/ |
Disallow | /qa/ |
Disallow | /register/index.php |
Disallow | /search.php |
Disallow | /test-catalog/appendix/referred-tests.html |
Disallow | /test-catalog/appendix/policies-ReadMe.txt |
Disallow | /test-catalog/diseases/ |
Disallow | /test-catalog/print/ |
Disallow | /test-catalog/search.php |
Disallow | /test-catalog/setup.php |
Disallow | /test-info/pediatric/refvalues/ |
Disallow | /test-notifications/z-code-identifiers-index.html |
Disallow | /customer-service/billing/pfa.html |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |