masterclass.ted.com
robots.txt

Robots Exclusion Standard data for masterclass.ted.com

Resource Scan

Scan Details

Site Domain masterclass.ted.com
Base Domain ted.com
Scan Status Ok
Last Scan2024-05-04T12:39:25+00:00
Next Scan 2024-05-18T12:39:25+00:00

Last Scan

Scanned2024-05-04T12:39:25+00:00
URL https://masterclass.ted.com/robots.txt
Domain IPs 75.2.60.5
Response IP 75.2.60.5
Found Yes
Hash 17cde34d6dd204b95d6b84f954a3ded9fc0fe64d005a8a8dd63ffb5d84b52cdb
SimHash 88005851c3b1

Groups

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /congratulations

Other Records

Field Value
sitemap https://masterclass.ted.com/sitemap.xml

Warnings

  • `host` is not a known field.