ted.com
robots.txt
Robots Exclusion Standard data for ted.com
Resource Scan
Scan Details
Site Domain | ted.com |
Base Domain | ted.com |
Scan Status | Ok |
Last Scan | 2024-11-08T23:48:31+00:00 |
Next Scan | 2024-11-15T23:48:31+00:00 |
Last Scan
Scanned | 2024-11-08T23:48:31+00:00 |
URL | https://ted.com/robots.txt |
Redirect | https://www.ted.com/robots.txt |
Redirect Domain | www.ted.com |
Redirect Base | ted.com |
Domain IPs | 3.211.53.63, 54.161.172.208 |
Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645 |
Response IP | 199.232.46.133 |
Found | Yes |
Hash | 68933f6baaea73ae5773604202db580268ad580b93bd5ab948e113b08dc3554b |
SimHash | 6424ff72ed92 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /latest |
Disallow | /latest-talk |
Disallow | /latest-playlist |
Disallow | /people |
Disallow | /profiles |
Disallow | /themes/rss |
Disallow | /discussions |
Disallow | /talks2 |