media.mercola.com
robots.txt
Robots Exclusion Standard data for media.mercola.com
Resource Scan
Scan Details
| Site Domain | media.mercola.com |
| Base Domain | mercola.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-08T06:50:58+00:00 |
| Next Scan | 2024-07-07T06:50:58+00:00 |
Last Successful Scan
| Scanned | 2023-08-16T17:37:36+00:00 |
| URL | https://media.mercola.com/robots.txt |
| Redirect | https://media.mercola.com/media-robots.txt |
| Domain IPs | 104.18.35.82, 172.64.152.174 |
| Response IP | 104.18.35.82 |
| Found | Yes |
| Hash | ac9bfb06f8c1281075e43ff4d3b37247a642f9ce030b426095a869283957f833 |
| SimHash | b1108e41ed71 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /js/*.jsp |
| Allow | /js/*.js |
| Allow | /themes/*.gif |
| Allow | /themes/*.jpg |
| Allow | /themes/*.jpeg |
| Allow | /themes/*.png |
| Allow | /themes/*.svg |
| Allow | /themes/*.css |
| Allow | /themes/*.js |
| Disallow | /App_WebReferences/ |
| Disallow | /aspnet_client/ |
| Disallow | /badges/ |
| Disallow | /Bin/ |
| Disallow | /Controls/ |
| Disallow | /Errors/ |
| Disallow | /nav/ |
| Disallow | /test/ |
| Disallow | /OptimizeTest/ |
| Disallow | /CommunityServer/ |
| Disallow | /Audio/ |
| Disallow | /js/ |
| Disallow | /ShadowBox/ |
| Disallow | /themes/ |
| Disallow | /manifest.txt |
Comments