team.discovery.com
robots.txt
Robots Exclusion Standard data for team.discovery.com
Resource Scan
Scan Details
Site Domain | team.discovery.com |
Base Domain | discovery.com |
Scan Status | Ok |
Last Scan | 2024-05-31T15:00:03+00:00 |
Next Scan | 2024-06-07T15:00:03+00:00 |
Last Scan
Scanned | 2024-05-31T15:00:03+00:00 |
URL | http://team.discovery.com/robots.txt |
Redirect | https://www.discovery.com/robots.txt |
Redirect Domain | www.discovery.com |
Redirect Base | discovery.com |
Domain IPs | 34.207.14.63, 75.101.203.147 |
Redirect IPs | 23.15.101.184 |
Response IP | 23.15.101.184 |
Found | Yes |
Hash | d87f8a8bc68df27dbea4432c5584bd0bd4b7d80c41dc9db967636ff7e654ebd4 |
SimHash | 6900d842c033 |
Groups
*
Rule | Path |
---|---|
Allow | /content/dam/ |
Allow | /content/discovery-com/jcr%3Acontent/analytics.sitecatalyst.js |
Disallow | /content/ |
Allow | /libs/granite/ |
Disallow | /libs/ |
Disallow | /services/ |
Disallow | /search/ |
Disallow | /features/apple-news/ |
Disallow | /shows/tv-schedule.* |
Disallow | *.embed |
Allow | *.lazy-fetch* |
Allow | *hotspot* |
Other Records
Field | Value |
---|---|
sitemap | https://www.discovery.com/sitemaps/www-legacy-index.xml.gz.xml |
sitemap | https://www.discovery.com/sitemaps/sitemap_discovery_index.xml |