Search

Brain–machine-interface device translates internal speech into text - Nature.com

kembaliui.blogspot.com

For patients affected by speech disorders, brain–machine-interface (BMI) devices could restore their ability to verbally communicate. In this work, we captured neural activity associated with internal speech — words said within the mind with no associated movement or audio output — and translated these cortical signals into text in real time.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Internal and vocalized speech are significantly decodable both offline and online.

References

  1. Makin, J. G., Moses, D. A. & Chang, E. F. Machine translation of cortical activity to text with an encoder–decoder framework. Nat. Neurosci. 23, 575–582 (2020). An article that presents high-accuracy vocalized speech decoding into text using electrocorticogram data.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Moses, D. A. et al. Neuroprosthesis for decoding speech in a paralyzed person with anarthria. N. Engl. J. Med. 385, 217–227 (2021). An article that presents high-accuracy attempted speech decoding into text using electrocorticogram data.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Willett, F. R. et al. A high-performance speech neuroprosthesis. Nature 620, 1031–1036 (2023). An article that presents high-accuracy attempted and mimed speech decoding into text using multielectrode arrays.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Metzger, S. L. et al. A high-performance neuroprosthesis for speech decoding and avatar control. Nature 620, 1037–1046 (2023). An article that presents high-accuracy attempted and mimed speech decoding into text, audio and avatar movement using electrocorticogram data.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Wandelt, S. K. et al. Decoding grasp and speech signals from the cortical grasp circuit in a tetraplegic human. Neuron 110, 1777–1787 (2022). An article that presents grasp and vocalized speech decoding from the SMG.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This is a summary of: Wandelt, S. K. et al. Representation of internal speech by single neurons in human supramarginal gyrus. Nat. Hum. Behav. https://doi.org/10.1038/s41562-024-01867-y (2024).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brain–machine-interface device translates internal speech into text. Nat Hum Behav (2024). https://ift.tt/PzjMd3T

Download citation

  • Published:

  • DOI: https://ift.tt/PzjMd3T

Adblock test (Why?)



"interface" - Google News
May 13, 2024 at 10:27PM
https://ift.tt/cbg7OG4

Brain–machine-interface device translates internal speech into text - Nature.com
"interface" - Google News
https://ift.tt/Uo6AiHG
https://ift.tt/dzb8ORI

Bagikan Berita Ini

0 Response to "Brain–machine-interface device translates internal speech into text - Nature.com"

Post a Comment

Powered by Blogger.