dhd.discovery.com
robots.txt
Robots Exclusion Standard data for dhd.discovery.com
Resource Scan
Scan Details
Site Domain | dhd.discovery.com |
Base Domain | discovery.com |
Scan Status | Ok |
Last Scan | 2024-05-19T00:34:41+00:00 |
Next Scan | 2024-05-26T00:34:41+00:00 |
Last Scan
Scanned | 2024-05-19T00:34:41+00:00 |
URL | http://dhd.discovery.com/robots.txt |
Redirect | https://www.discovery.com/robots.txt |
Redirect Domain | www.discovery.com |
Redirect Base | discovery.com |
Domain IPs | 52.200.90.116, 54.84.72.86 |
Redirect IPs | 23.210.106.27 |
Response IP | 23.202.134.222 |
Found | Yes |
Hash | d87f8a8bc68df27dbea4432c5584bd0bd4b7d80c41dc9db967636ff7e654ebd4 |
SimHash | 6900d842c033 |
Groups
*
Rule | Path |
---|---|
Allow | /content/dam/ |
Allow | /content/discovery-com/jcr%3Acontent/analytics.sitecatalyst.js |
Disallow | /content/ |
Allow | /libs/granite/ |
Disallow | /libs/ |
Disallow | /services/ |
Disallow | /search/ |
Disallow | /features/apple-news/ |
Disallow | /shows/tv-schedule.* |
Disallow | *.embed |
Allow | *.lazy-fetch* |
Allow | *hotspot* |
Other Records
Field | Value |
---|---|
sitemap | https://www.discovery.com/sitemaps/www-legacy-index.xml.gz.xml |
sitemap | https://www.discovery.com/sitemaps/sitemap_discovery_index.xml |