ted.com
robots.txt

Robots Exclusion Standard data for ted.com

Resource Scan

Scan Details

Site Domain ted.com
Base Domain ted.com
Scan Status Ok
Last Scan2024-11-08T23:48:31+00:00
Next Scan 2024-11-15T23:48:31+00:00

Last Scan

Scanned2024-11-08T23:48:31+00:00
URL https://ted.com/robots.txt
Redirect https://www.ted.com/robots.txt
Redirect Domain www.ted.com
Redirect Base ted.com
Domain IPs 3.211.53.63, 54.161.172.208
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645
Response IP 199.232.46.133
Found Yes
Hash 68933f6baaea73ae5773604202db580268ad580b93bd5ab948e113b08dc3554b
SimHash 6424ff72ed92

Groups

*

Rule Path
Disallow /search
Disallow /latest
Disallow /latest-talk
Disallow /latest-playlist
Disallow /people
Disallow /profiles
Disallow /themes/rss
Disallow /discussions
Disallow /talks2

baiduspider

Rule Path
Disallow /search
Disallow /latest
Disallow /latest-talk
Disallow /latest-playlist
Disallow /people
Disallow /profiles
Disallow /discussions
Disallow /talks2

gptbot

Rule Path
Disallow /