"We can have the model rover go left or right using silently ‘spoken’ words," Jorgensen said. His team is planning tests with a simulated Mars rover. This proves we could browse the Web without touching a keyboard," Jorgensen explained.Ī second demonstration will be to control a mechanical device using a simple set of commands, according to Jorgensen. We used the numbers again to choose Web pages to examine. We electronically numbered the Web pages that came up as search results. "So we silently spelled out ‘NASA’ and then submitted it to a well-known Web search engine. We numbered the columns and rows, and we could identify each letter with a pair of single-digit numbers," Jorgensen said. "We took the alphabet and put it into a matrix - like a calendar. Please credit photo to NASA Ames Research Center, Dominic Hart. The first sub-vocal words the system ‘learned’ were ‘stop,’ ‘go,’ ‘left,’ ‘right,’ ‘alpha’ and ‘omega’ and the digits ‘zero’ through ‘nine.’ Silently speaking these words, scientists conducted simple searches on the Internet by using a number chart that represents the alphabet to control a Web browser program. Initial word recognition results were an average of 92 percent accurate.
#Subvocalization versus auditory imagery software#
In their first experiment, scientists ‘trained’ special software to recognize six words and 10 digits that the researchers ‘repeated’ subvocally. "It’s recognizing the pattern of a word in the signal." "We use neural network software to learn and classify the words," Jorgensen said. These are processed to remove noise, and then we process them to see useful parts of the signals to show one word from another," Jorgensen said.Īfter the signals are amplified, computer software ‘reads’ the signals to recognize each word and sound. "We use an amplifier to strengthen the electrical nerve signals. To learn more about what is in the patterns of the nerve signals that control vocal chords, muscles and tongue position, NASA Ames scientists are studying the complex nerve signal patterns. "What is analyzed is silent, or sub-auditory, speech, such as when a person silently reads or talks to himself," said Chuck Jorgensen (pictured), a scientist whose team is developing silent, subvocal speech recognition at NASA Ames Research Center in California’s Silicon Valley. In preliminary experiments, NASA scientists found that small, button-sized sensors, stuck under the chin and on either side of the ‘Adam’s apple,’ could gather nerve signals, send them to a processor and then to a computer program that translates them into words. (Contains 6 footnotes.NASA scientists have begun to computerize human, silent reading using nerve signals in the throat that control speech. It is concluded that auditory imagery (a) preserves many structural and temporal properties of auditory stimuli, (b) can facilitate auditory discrimination but interfere with auditory detection, (c) involves many of the same brain areas as auditory perception, (d) is often but not necessarily influenced by subvocalization, (e) involves semantically interpreted information and expectancies, (f) involves depictive components and descriptive components, (g) can function as a mnemonic but is distinct from rehearsal, and (h) is related to musical ability and experience (although the mechanisms of that relationship are not clear).
Data on (a) imagery for auditory features (pitch, timbre, loudness), (b) imagery for complex nonverbal auditory stimuli (musical contour, melody, harmony, tempo, notational audiation, environmental sounds), (c) imagery for verbal stimuli (speech, text, in dreams, interior monologue), (d) auditory imagery's relationship to perception and memory (detection, encoding, recall, mnemonic properties, phonological loop), and (e) individual differences in auditory imagery (in vividness, musical ability and experience, synesthesia, musical hallucinosis, schizophrenia, amusia) are considered. The empirical literature on auditory imagery is reviewed.
0 kommentar(er)
