discovery.com
robots.txt
Robots Exclusion Standard data for discovery.com
Resource Scan
Scan Details
| Site Domain | discovery.com |
| Base Domain | discovery.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T18:08:49+00:00 |
| Next Scan | 2024-11-02T18:08:49+00:00 |
Last Scan
| Scanned | 2024-10-26T18:08:49+00:00 |
| URL | https://discovery.com/robots.txt |
| Redirect | https://www.discovery.com/robots.txt |
| Redirect Domain | www.discovery.com |
| Redirect Base | discovery.com |
| Domain IPs | 34.198.37.254, 75.101.175.190 |
| Redirect IPs | 23.210.106.27 |
| Response IP | 23.15.101.184 |
| Found | Yes |
| Hash | a43ea3f20f60968a862d2b44909cf5408b1c499c1624d4aea6155ca32f09fe96 |
| SimHash | 6b00d862c233 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /content/dam/ |
| Allow | /content/discovery-com/jcr%3Acontent/analytics.sitecatalyst.js |
| Disallow | /content/ |
| Allow | /libs/granite/ |
| Disallow | /libs/ |
| Disallow | /services/ |
| Disallow | /features/apple-news/ |
| Disallow | /shows/tv-schedule.* |
| Disallow | *.embed |
| Allow | *.lazy-fetch* |
| Allow | *hotspot* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.discovery.com/sitemaps/www-legacy-index.xml.gz.xml |
| sitemap | https://www.discovery.com/sitemaps/sitemap_discovery_index.xml |