{"id":83583,"date":"2012-08-22T05:57:00","date_gmt":"2012-08-22T02:57:00","guid":{"rendered":"https:\/\/www.technion.ac.il\/blog\/give-me-a-voice-brain-science-speech\/"},"modified":"2012-08-22T05:57:00","modified_gmt":"2012-08-22T02:57:00","slug":"give-me-a-voice-brain-science-speech","status":"publish","type":"post","link":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/","title":{"rendered":"Give me a Voice. Brain Science & Speech"},"content":{"rendered":"
\n
<\/div>\n
Technion & UCLA researchers have identified a structured code for representing speech movements by neurons in the human brain.\u00a0<\/span><\/span><\/strong>The researchers were able to directly decode vowels from neural activity – a finding which could allow individuals who are paralyzed to “speak” to people around them through a brain-computer interface<\/span><\/strong><\/div>\n

\n<\/span><\/strong><\/div>\n\n\n\n\n
\"\"<\/a><\/td>\n<\/tr>\n
\n
In the photo: the two language areas where cell reactions during speech were researched. The graphs present a selective code for vowels in an area in the frontal lobe and a non-selective code in an area in the temporal lobe (each color represents a neuron).\u00a0<\/span>The image highlights the brain areas where neurons with a structured code for speech\u00a0<\/span>generation were found. In the frontal region neurons were highly vowel-selective while in the temporal region (on the right) the code was broad and non-selective<\/span>.<\/span><\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
<\/div>\n
Technion and UCLA researchers have directly decoded vowels from the neural activity which leads to their articulation – a finding which could allow individuals who are\u00a0<\/span>paralyzed to “speak” to the people around them through a direct brain-computer interface.\u00a0<\/span>
\n
\n<\/span>Prof. Shy Shoham<\/a> and Dr. Ariel Tankus<\/a> of the Technion Department of Biomedical Engineering,<\/a> together with Prof. Itzhak Fried<\/a> of the University of California Los Angeles (UCLA) and the Tel Aviv University and Medical Center departments of Neurosurgery, describe <\/span>the way in which neurons in different areas of the human brain encode different speech segments (vowels) during their articulation\u00a0<\/span>in the scientific journal\u00a0<\/span>Nature Communications<\/a><\/em>.\u00a0<\/span>
\n
\n<\/span>The discovery will indirectly enable scientists to decode the content of the subjects’ speech based on brain activity alone. One of the possible applications of speech decoding from brain activity is the creation of a brain-computer interface that can restore speech faculties in paralyzed individuals who have lost them.<\/span><\/div>\n

\n<\/span><\/div>\n
“There are diseases in which the patient’s entire body is paralyzed, he is effectively ‘locked in’ (locked-in syndrome) and is unable to communicate with the environment, but his mind still functions”, explains Prof. Shoham, Head of the Neural Interface Engineering Laboratory in the Technion Department of Biomedical Engineering. “Our long term goal is to restore these patients’ ability to speak using systems that will include implanting electrodes in their brains, decoding the neural activity that encodes speech, and sounding artificial speech sounds. For this purpose, we wanted to first understand how the information about the articulated syllable is encoded in the electrical activity of an individual brain neuron and of a neuron population. In our experiments we identified cell populations that distinctly participate in the representation. For example, cells we registered in an area in the medial frontal lobe that includes the anterior cingulate cortex, surprised us in the manner in which they ‘sharply’ represented certain vowels but not others, even though the area is not necessarily known as having a major role in the speech generation process”.<\/span><\/div>\n

\n<\/span><\/div>\n
The experiments were conducted in the UCLA Medical Center with the participation of epilepsy patients, in whose brain Prof. Fried and his team implanted depth electrodes. The objective of the implant is to locate the epileptic focus, which is the area in the brain where epileptic seizures begin. After the surgery, the patients were hospitalized for a week or two with the electrodes in their brain, and waited for the occurrence of spontaneous seizures.\u00a0<\/span>
\n
\n<\/span>During that time, Dr. Tankus, who was a post-doctoral fellow at UCLA and is now a researcher at the Technion, conducted experiments in which he asked patients to articulate vowels as well as syllables comprising a consonant and a vowel, and recorded the resulting neuronal activity in their brain.\u00a0<\/span>
\n
\n<\/span>The researchers discovered two neuron populations that encode the information about the vowel articulated in an entirely different way. In the first population, identified in the medial frontal lobe, each neuron encodes only one or two vowels by changing its firing rate, but does not change its activity when other vowels are articulated. However, in the second population, located in the superior temporal gyrus, each neuron reacts to all vowels tested, but the cell’s reaction strength changes gradually between vowels.\u00a0<\/span>
\n
\n<\/span>Moreover, the researchers were able to deduce a mathematical arrangement of the manner in which the vowels are represented in the brain, showing it to match the phonetic vowel trapezoid, which is built according to the location of the highest point of the tongue during articulation. Thus, the researchers succeeded in connecting the brain representation with the anatomy and physiology of vowel articulation.<\/span><\/div>\n

\n<\/span><\/div>\n
Understanding brain representation of speech generation constitutes a significant step on the road to decoding cellular activity using a computer, as Dr. Tankus explains: “We have developed a new algorithm that improves the ability to identify from brain activity which syllable was articulated, and this algorithm has allowed us to obtain very high identification rates. Based on the present findings, we are currently conducting experiments toward the creation of a brain-machine interface that will restore \u00a0speech faculties”.<\/span><\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Technion & UCLA researchers have identified a structured code for representing speech movements by neurons in the human brain.\u00a0The researchers were able to directly decode vowels from neural activity – a finding which could allow individuals who are paralyzed to “speak” to people around them through a brain-computer interface In the photo: the two language… Continue Reading Give me a Voice. Brain Science & Speech<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[24],"tags":[],"class_list":["post-83583","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"acf":[],"yoast_head":"\nGive me a Voice. Brain Science & Speech - \u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Give me a Voice. Brain Science & Speech - \u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc\" \/>\n<meta property=\"og:description\" content=\"Technion & UCLA researchers have identified a structured code for representing speech movements by neurons in the human brain.\u00a0The researchers were able to directly decode vowels from neural activity – a finding which could allow individuals who are paralyzed to “speak” to people around them through a brain-computer interface In the photo: the two language… Continue Reading Give me a Voice. Brain Science & Speech\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/\" \/>\n<meta property=\"og:site_name\" content=\"\u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc\" \/>\n<meta property=\"article:published_time\" content=\"2012-08-22T02:57:00+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg\" \/>\n<meta name=\"author\" content=\"shlomi ben-oz\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"shlomi ben-oz\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/\",\"url\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/\",\"name\":\"Give me a Voice. Brain Science & Speech - \u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc\",\"isPartOf\":{\"@id\":\"https:\/\/www.technion.ac.il\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg\",\"datePublished\":\"2012-08-22T02:57:00+00:00\",\"author\":{\"@id\":\"https:\/\/www.technion.ac.il\/en\/#\/schema\/person\/d65b78b7a7446bdf9fb69078573b8320\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#primaryimage\",\"url\":\"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg\",\"contentUrl\":\"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home Page\",\"item\":\"https:\/\/www.technion.ac.il\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Give me a Voice. Brain Science & Speech\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.technion.ac.il\/en\/#website\",\"url\":\"https:\/\/www.technion.ac.il\/en\/\",\"name\":\"\u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.technion.ac.il\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.technion.ac.il\/en\/#\/schema\/person\/d65b78b7a7446bdf9fb69078573b8320\",\"name\":\"shlomi ben-oz\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.technion.ac.il\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/96b13158d164281df14ad8583ec2cb64?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/96b13158d164281df14ad8583ec2cb64?s=96&d=mm&r=g\",\"caption\":\"shlomi ben-oz\"},\"url\":\"https:\/\/www.technion.ac.il\/en\/blog\/author\/ben-ozshlomitechnion-ac-il\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Give me a Voice. Brain Science & Speech - \u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/","og_locale":"en_US","og_type":"article","og_title":"Give me a Voice. Brain Science & Speech - \u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc","og_description":"Technion & UCLA researchers have identified a structured code for representing speech movements by neurons in the human brain.\u00a0The researchers were able to directly decode vowels from neural activity – a finding which could allow individuals who are paralyzed to “speak” to people around them through a brain-computer interface In the photo: the two language… Continue Reading Give me a Voice. Brain Science & Speech","og_url":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/","og_site_name":"\u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc","article_published_time":"2012-08-22T02:57:00+00:00","og_image":[{"url":"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg","type":"","width":"","height":""}],"author":"shlomi ben-oz","twitter_card":"summary_large_image","twitter_misc":{"Written by":"shlomi ben-oz","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/","url":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/","name":"Give me a Voice. Brain Science & Speech - \u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc","isPartOf":{"@id":"https:\/\/www.technion.ac.il\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#primaryimage"},"image":{"@id":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#primaryimage"},"thumbnailUrl":"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg","datePublished":"2012-08-22T02:57:00+00:00","author":{"@id":"https:\/\/www.technion.ac.il\/en\/#\/schema\/person\/d65b78b7a7446bdf9fb69078573b8320"},"breadcrumb":{"@id":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#primaryimage","url":"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg","contentUrl":"http:\/\/3.bp.blogspot.com\/-d5B8S_V8chA\/UDSCb5j7MxI\/AAAAAAAABgI\/1k7c09KP2QQ\/s400\/download.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/www.technion.ac.il\/en\/blog\/give-me-a-voice-brain-science-speech\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home Page","item":"https:\/\/www.technion.ac.il\/en\/"},{"@type":"ListItem","position":2,"name":"Give me a Voice. Brain Science & Speech"}]},{"@type":"WebSite","@id":"https:\/\/www.technion.ac.il\/en\/#website","url":"https:\/\/www.technion.ac.il\/en\/","name":"\u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df-\u05de\u05db\u05d5\u05df \u05d8\u05db\u05e0\u05d5\u05dc\u05d5\u05d2\u05d9 \u05dc\u05d9\u05e9\u05e8\u05d0\u05dc","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.technion.ac.il\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.technion.ac.il\/en\/#\/schema\/person\/d65b78b7a7446bdf9fb69078573b8320","name":"shlomi ben-oz","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.technion.ac.il\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/96b13158d164281df14ad8583ec2cb64?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/96b13158d164281df14ad8583ec2cb64?s=96&d=mm&r=g","caption":"shlomi ben-oz"},"url":"https:\/\/www.technion.ac.il\/en\/blog\/author\/ben-ozshlomitechnion-ac-il\/"}]}},"_links":{"self":[{"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/posts\/83583","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/comments?post=83583"}],"version-history":[{"count":0,"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/posts\/83583\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/media?parent=83583"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/categories?post=83583"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.technion.ac.il\/en\/wp-json\/wp\/v2\/tags?post=83583"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}