Chatbots are now running rampant, appearing in new-model cars, while we’re told to “be nice to chatbots.” Stores are using “digital price tags,” which rely on surveillance to set the price to the company’s liking. Meantime, Google’s AI is giving wrong answers, in some cases, almost half the time. All these and more in Mark’s dystopia update.
As talking to chatbots is now becoming more like normal conversations, AI users face an awkward ethical dilemma: Bots are programmed to be polite, but do we have to reciprocate? Is it wrong to speak harshly to them? . . .• From Axios (Oct 23, 2024), cars may soon come with a surveillance chatbot installed:
“The litmus test for how good a person you are is if you are nice to a waiter,” said Alana O’Grady, an executive at a tech startup based in San Mateo, Calif. “In the future, it’ll be how kind you are to your AI companion.”
Qualcomm announced yesterday that it is bringing its next-generation Oryon processor to its in-car computer systems for both entertainment and automated driving. . . .• Surveillance Capitalism: A Conversation with Shoshana Zuboff and Jim Balsillie (video from Feb 28, 2024), speaking about cars as loss leaders
- Mercedes said it would use Qualcomm’s Snapdragon Cockpit Elite chip to power future in-car information systems.
- Qualcomm also announced a partnership with Google to jointly promote Android Auto and Qualcomm’s digital cockpit to automakers. . . .
- “We think people will be able to truly converse with their cars, not just like an AI chatbot, but actually with intelligence around what the vehicle can see, what the vehicle knows about itself and what it knows about the driver,” Patrick Brady, VP of engineering for Android at Google, said in an interview.
- The power increases further when AI is combined with self-driving abilities. In a concept video, Qualcomm featured a car’s AI assistant telling the driver: “There is no parking nearby. You can unload here and I will park the car.”
- China’s Li Auto showed an AI assistant that can answer all the questions that kids ask while you are in the car, while also powering travel-related and entertainment tasks and remembering its owner’s preferences.
Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near “human level robustness and accuracy.” But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences . . .• We Built the Technosphere. Now We Must Resist It (by Andrew Nikiforuk in The Tyee, Jan 16, 2024):
In an example [researchers] uncovered, a speaker said, “He, the boy, was going to, I’m not sure exactly, take the umbrella.”
But the transcription software added: “He took a big piece of a cross, a teeny, small piece ... I’m sure he didn’t have a terror knife so he killed a number of people.”
A speaker in another recording described “two other girls and one lady.” Whisper invented extra commentary on race, adding “two other girls and one lady, um, which were Black.”
In a third transcription, Whisper invented a non-existent medication called “hyperactivated antibiotics.”
. . . Over 30,000 clinicians and 40 health systems, including the Mankato Clinic in Minnesota and Children’s Hospital Los Angeles, have started using a Whisper-based tool built by Nabla, which has offices in France and the U.S.
What course of action, then, is left to any one person? Jacques Ellul, a man who loved life, offered three choices. He wrote in 1989 that people can accept technology as our determined fate, bear witness to its transgressions, or resist its dominance in every human affair. Only the last two paths, he wrote, offer promise, hope and, finally, liberation. And if we are to achieve any “exit from this terrible swamp of ours,” he said, “above all things we must avoid the mistake of thinking that we are free.” First we must acknowledge our confinement in the technosphere. Then, “seeing the Hydra head of trickery and the Gorgon face of hi-tech, the only thing we can do is set them at a critical distance, for it is by being able to criticize that we show our freedom.”• Octavia Butler, quoted by Audrey Watters in her Nov 4, 2024 newsletter:
“So do you really believe that in the future we’re going to have the kind of trouble you write about in your books?” a student asked me as I was signing books after a talk. The young man was referring to the troubles I’d described in Parable of the Sower and Parable of the Talents, novels that take place in a near future of increasing drug addiction and illiteracy, marked by the popularity of prisons and the unpopularity of public schools, the vast and growing gap between the rich and everyone else, and the whole nasty family of problems brought on by global warming.• Movie recommendation: Robot Dreams (2023)
“I didn’t make up the problems,” I pointed out. “All I did was look around at the problems we’re neglecting now and give them about 30 years to grow into full-fledged disasters.”
“Okay,” the young man challenged. “So what’s the answer?”
“There isn’t one,” I told him.
“No answer? You mean we’re just doomed?” He smiled as though he thought this might be a joke.
“No,” I said. “I mean there’s no single answer that will solve all of our future problems. There’s no magic bullet. Instead there are thousands of answers — at least. You can be one of them if you choose to be.”