August 15, 2024

"Mr. Harrell’s team sank into his brain’s outer layer four electrode arrays that looked like tiny beds of nails."

"That was double the number that had recently been implanted in the speech areas of someone with A.L.S., or amyotrophic lateral sclerosis, in a separate study. Each array’s 64 spikes picked up electric impulses from neurons that fired when Mr. Harrell tried to move his mouth, lips, jaw and tongue to speak.Three weeks after surgery, scientists gathered in Mr. Harrell’s living room in Oakland, Calif., to 'plug him in,' connecting the implant to a bank of computers with cables attached to two metal posts protruding from Mr. Harrell’s skull."

From "A.L.S. Stole His Voice. A.I. Retrieved It. In an experiment that surpassed expectations, implants in a patient’s brain were able to recognize words he tried to speak, and A.I. helped produce sounds that came close to matching his true voice" (NYT)(free access link).

"After only briefly training the computers to recognize Mr. Harrell’s speech, the implant began recording what he intended to say from a 50-word vocabulary with 99.6 percent accuracy. The device worked so well, so soon, that the scientists had to cut an initial session from their analysis: Halfway through trying to speak his first prompt aloud — 'What good is that?' — a shaking, smiling Mr. Harrell crumpled into tears. To the average listener, 'what' and 'good' had come out of Mr. Harrell’s mouth muddled and indecipherable. But to the electrodes tuned to individual neurons in Mr. Harrell’s brain, the words were perfectly clear. A screen in front of him displayed exactly what he had been trying to say."

21 comments:

rehajm said...

That’s an amazing bit of accuracy…

John henry said...

Not musk's neurolink, apparently.

John Henry

rehajm said...

I’m torn with his using this success to harass Blackrock and Vanguard to destroy even more wealth in the name of petty and pointless and destructive political pursuit. They are rotten enough as it is…

rehajm said...

…plus, the yacht rock?

n.n said...

Anthropogenic Intelligence (AI).

Inference and signal processing. Science cannot discern origin and expression.

Rocco said...

No, no, no! What came out of their mouth was incorrect. What they meant to say was actually…
- Once the tool is hooked up to the Ministry of Disinformation

AlbertAnonymous said...

What were his first words?

Make me a sammich?

traditionalguy said...

I stand amazed. The times are indeed a changing.

Rusty said...

See? This is what AI is for. We have a very promising future if the Democrats don't screw it up.

stlcdr said...

Is it AI, though? Isn't is just algorithmic pattern matching, or is that what we are calling AI? I don't think AI is bringing anything to the table, just greater processing power today than what we had decades ago. Regardless, whatever you call it, progress in creating real world solutions.

Michael K said...

Something like this was being worked on in vision but I haven't seen much about it lately.

Skeptical Voter said...

Talk with folks like me who have cochlear implants. Electrodes are implanted in the auditory nerve. The technology originated 50 years ago and there's been significant improvement and development in the technology since. For some of the hearing challenged it's a miracle--for others, a bit like me, not so much.

rehajm said...

Yah I had that issue, lumping in to the AI pile instead of what it it is, more of a probability model. I suppose it could be getting feedback to hat is correct along the way, which I suppose would fall into the AI pile...

Tom T. said...

How do we know that was what he was trying to say?

Kakistocracy said...

The human body as is all life based around electricity and magnetism, you scratch your self the body doubles the voltage in the cells around the wound and it is electricity that provides the energy for the cells to repair themselves while the magnetism activates the templates needed to know how the cells should rearrange themselves. A whole new universe of healing is opening up. This why artificial means can create the environment of electrical charge that triggers repairs.

Pat said...

I wonder how painful and expensive the brain surgery is. It does seem like a lot of investment for a very short payoff. I absolutely see how it would work though. My father had ALS and when he was near the end, I would hold up a sheet with the alphabet on it while pointing at letters as he would nod or grunt to spell out words. Brutal. A horrible disease.

Pat said...

@stlcdr
I think it sounds like the AI portion of this is simply the text-to-speech software. Since this man was part of the study, they probably took recordings of his voice while he could speak to train an AI voice. As a caregiver, I could take or leave that. But the text would be very valuable. The AI is just here for publicity or advertising.

Rusty said...

Maybe it would give Rich a three digit IQ. Worth a shot. I'll chip in.

Kakistocracy said...


⬆️ Both Neptune and Pluto were predicted long before they had ever been seen because of peculiarities in the orbits of the other outer planets. It made me think that planets weren’t so very different from people. Seeing what happened around them was enough to tell you where they were and what they were.
¯\_(ツ)_/¯

Jamie said...
This comment has been removed by the author.
Jamie said...

Both Neptune and Pluto were predicted long before they had ever been seen because of peculiarities in the orbits of the other outer planets. It made me think that planets weren’t so very different from people.

Wow, Rich, you must be really old!

😀