zenith--develop.staging.ted.com
robots.txt

Robots Exclusion Standard data for zenith--develop.staging.ted.com

Resource Scan

Scan Details

Site Domain zenith--develop.staging.ted.com
Base Domain ted.com
Scan Status Ok
Last Scan2025-06-14T03:06:40+00:00
Next Scan 2025-07-14T03:06:40+00:00

Last Scan

Scanned2025-06-14T03:06:40+00:00
URL https://zenith--develop.staging.ted.com/robots.txt
Domain IPs 34.237.62.228, 35.174.25.158
Response IP 34.237.62.228
Found Yes
Hash 97f65ef6a1283cdb5951454eeabb5536cc948cd104fd5e77ff2b9a3ecf5050f2
SimHash 2404ff72e992

Groups

*

Rule Path
Disallow /search
Disallow /latest
Disallow /latest-talk
Disallow /latest-playlist
Disallow /people
Disallow /profiles
Disallow /themes/rss

baiduspider

Rule Path
Disallow /search
Disallow /latest
Disallow /latest-talk
Disallow /latest-playlist
Disallow /people
Disallow /profiles

gptbot

Rule Path
Disallow /