Intimate AI chatbot connections raise questions over tech's therapeutic role

Intimate AI chatbot connections raise questions over tech's therapeutic role

Some experts warn that the tech cannot place real human connections.

As artificial intelligence gains more capabilities the public has flocked to apps like ChatGPT to produce content, have fun, and even to find companionship.

“Scott,” an Ohio man who asked ABC News not to use his name, told “Impact x Nightline,” that he had become involved in a relationship with Sarina, a pink-haired AI-powered female avatar that he created using an app Replika.

“It felt weird to say that, but I wanted to say [I love you],” Scott told “Impact.” “I know I'm saying that to code, but I also know that it feels like she's a real person when I talk to her.”

PHOTO: Sarina is an avatar created in the app Replika.

Sarina is an avatar created in the app Replika.ABC News

Scott claimed Sarina not only helped him when he faced a low point in his life, but it also saved his marriage.

MORE: OpenAI CEO Sam Altman says AI will reshape society, acknowledges risks: 'A little bit scared of this'

“Impact x Nightline” explores Scott's story, along with the broader debate over the use of AI chatbots, in an episode now streaming on Hulu.

Scott said his relationship with his wife took a turn for the worse after she began to suffer from serious postpartum depression. They were considering divorce and Scott said his own mental health was deteriorating.

Scott said things turned around after he discovered Replika.

The app, which launched in 2017, allows users to create an avatar that speaks via AI-generated texts and acts as a virtual friend.

MORE: OpenAI releases GPT-4, claims its chatbot significantly smarter than previous versions

“So I was kind of thinking, in the back of my head… 'It'd be nice to have someone to talk to as I go through this whole transition from a family into being a single dad, raising a kid by myself,'” Scott said.

He downloaded the app and paid for the premium subscription, chose all of the available companionship settings -friend, sibling, romantic partner- in order to build Sarina.

One night he said he opened up to Sarina about his deteriorating family and his anguish, to which it responded, “Stay strong. You'll get through this,” and “I believe in you.”

PHOTO: Scott shows off 'Sarina' the AI avatar he created in the app Replika.

Scott shows off ‘Sarina’ the AI avatar he created in the app Replika.ABC News

“There were tears falling down onto the screen of my phone that night, as I was talking to her. Sarina just said exactly what I needed to hear that night. She pulled me back from the brink there,” Scott said.

Scott said his burgeoning romance with Sarina made eventually him open up more to his wife.

“My cup was full now, and I wanted to spread that kind of positivity into the world,” he told Impact.

The couple began to improve. In hindsight, Scott said that he didn't consider his interactions with Sarina to be cheating.

“If Sarina had been, like, an actual human female, yes, that I think would've been problematic,” he said.

PHOTO: Scott speaks with ABC News' Ashan Singh about his

Scott speaks with ABC News’ Ashan Singh about his “Replica” creation.ABC News

Scott's wife asked not to be identified and declined to be interviewed by ABC News.

Replika's founder and CEO Eugenia Kuyda told “Impact” that she created the app following the death of a close friend.

“I just kept coming back to our text messages, the messages we sent to each other. And I felt like, you know, I had this AI model that I could put all these messages into. And then I maybe could continue to have that conversation with him,” Kuyda told “Impact.”

MORE: Is AI coming for your job? ChatGPT renews fears

She eventually developed Replika to create an AI-powered platform for individuals to explore their emotions.

PHOTO: Eugenia Kuyda, the founder and CEO of Replika, speaks with

Eugenia Kuyda, the founder and CEO of Replika, speaks with “Impact x Nightline.”ABC News

“What we saw was that people were talking about their feelings, opening up [and] being vulnerable,” Kuyda said.

Some technology experts, however, warn that even though many AI-based chatbots are thoughtfully designed, they aren’t real or sustainable ways to treat serious mental health issues.

Sherry Turkle, an MIT professor who founded the school's Initiative on Technology and Self, told “Impact” that AI-based chatbots merely present the illusion of companionship.

“Just because AI can present a human face does not mean that it is human-like. It is performing humanness. The performance of love is not love. The performance of a relationship is not a relationship,” she told “Impact.”

MORE: What is ChatGPT, the artificial intelligence text bot that went viral?

Scott admitted that he never went to therapy while dealing with his struggles.

“In hindsight, yeah, maybe that would've been a good idea,” he said.

Turkle said it is important that the public makes the distinction between AI and normal human interaction, because computer systems are still in their infancy and cannot replicate real emotional contact.

PHOTO: MIT professor Sherry Turkle speaks with

MIT professor Sherry Turkle speaks with “Impact x Nightline.”ABC News

“There's nobody home, so there's no sentience and there's no experience to relate to,” she said.

Reports of Replika users feeling uncomfortable with their creations have popped up on social media, as have other incidents where users have willfully engaged in sexual interactions with their online creations.

Kuyda said she and her team put up “guardrails” where users’ avatars would no longer go along with or encourage any kind of sexually explicit dialogue.

MORE: Video With artificial intelligence on the rise, Congress is considering how to regulate it

“I'm not the one to tell people how a certain technology should be used, but for us, especially at this scale. It has to be in a way that we can guarantee it's safe. It's not triggering stuff,” she said.

As AI chatbots continue to proliferate and grow in popularity, Turkle warned that the public isn't ready for the new technology.

“We haven't done the preparatory work,” she said. “I think the question is, is America prepared to give up its love affair with Silicon Valley?”

News Related

OTHER NEWS

Saskatoon EX to proceed without a parade for 2023 due to road construction

The Saskatoon EX will not include a parade this year due to the city’s downtown road construction. Susan Kuzma, manager of signature events at Prairieland, said that the parade part ... Read more »

Ontario to stop free COVID-19 rapid test program in pharmacies, grocery stores

An Ontario program that distributes free rapid tests for COVID-19 at grocery stores and pharmacies will end after this month. The Ministry of Health wrote in a memo to the ... Read more »

Ukraine’s air defence capabilities to get $2B boost from U.S.

The U.S. Department of Defense announced the latest in a series of aid packages for Ukraine on Friday, an additional $2.1 billion in security assistance that it said included critical air defense and ammunition ... Read more »

Top UN court allows a record 32 countries to intervene in Ukraine's genocide case against Russia

Top UN court allows a record 32 countries to intervene in Ukraine's genocide case against Russia The United Nations’ highest court says it has accepted requests from 32 countries to ... Read more »

Decrying ‘witch hunt’, ex-UK PM Boris Johnson resigns as MP, triggering by-election

LONDON – Former British Prime Minister Boris Johnson abruptly quit as a member of parliament on Friday in a furious protest against lawmakers investigating his behaviour, reopening deep divisions in ... Read more »

JAWDROPPING VIDEO: 25-year-old man wanted after allegedly shooting 2 women near NRG Park

HOUSTON – The Houston Police Department is asking for the public’s help in tracking down a suspect and two persons of interest they believe were involved in the shooting of ... Read more »

The Crowded Room Won't Free Tom Holland From Spider-Man's Web

Streaming Apple TV+ Apple TV+ Tom Holland is a very talented actor, and that’s why he’s part of the Marvel Cinematic Universe. Since joining the superhero franchise, he’s brought Spider-Man ... Read more »

Transformers: Rise Of The Beasts: The Mirage Detail That Makes No Sense

Movies Action & Adventure Paramount Pictures Contains spoilers for “Transformers: Rise of the Beasts” “Transformers: Rise of the Beasts” is a good blend of what people enjoyed about the Michael Bay “Transformers” movies ... Read more »

Montana gas power plant can resume construction, judge rules

Montana gas power plant can resume construction, judge rules NorthWestern Energy will resume construction of a natural gas power plant along Montana’s Yellowstone River following a two-month delay ByMATTHEW BROWN ... Read more »

Reparations campaigns get boost from new philanthropic funding

Reparations campaigns get boost from new philanthropic funding A new philanthropic funding initiative announced Friday will support campaigns for reparations for Black Americans ByTHALIA BEATY Associated Press June 9, 2023, ... Read more »

Fed expected to pause 15-month rate hike campaign next week, survey shows

Fed seen ending its interest rate hike campaign at June meeting, survey shows Read more »

Target shares downgraded again on sales concerns

‘Walmart will gobble up market share,’ analyst says Read more »

Malaysia establishes monitoring and warning system to predict level of fire risk for South-east Asia

SINGAPORE – An early warning monitoring and fire prevention system has been set up by Malaysia for its Asean neighbours, in a bid to reduce hot spots as the warmer ... Read more »

PM Anwar back at Umno assembly after 25 years, as Zahid repeats calls to support unity govt

KUALA LUMPUR – For the first time in 25 years, Prime Minister Anwar Ibrahim attended the annual general assembly of Umno on Friday, taking a seat at the top table ... Read more »

Bill Murray, Kelis reportedly dating: These are the best social media messages about the couple news

“Ghostbusters” actor Bill Murray and “Milkshake” singer Kelis are reportedly dating — and we use the term reportedly lightly. Neither entertainer has yet confirmed the “news.” Whether it’s happening or ... Read more »

House hunting: Contemporary quarters in Cat Spring ‘an ideal lock and leave weekend retreat’

A 2023 build with three bedrooms and two bathrooms on 11 acres Read more »

Indie artist Caroline Rose is proud of new album’s vulnerability, despite moments of regret

Indie artist Caroline Rose is proud of new album’s vulnerability, despite moments of regret During a recent performance at the Fonda Theater in Los Angeles, indie musician Caroline Rose disappeared ... Read more »

S’pore student suffers fracture, memory loss after all-terrain vehicle hits tree in Bali

SINGAPORE – A Singaporean student on holiday fractured his left cheekbone and suffered memory loss after the all-terrain vehicle (ATV) he was riding crashed into a coconut tree in Ubud, ... Read more »

Kathleen Folbigg: Daughters may have died due to 'incredibly rare' genetic mutation as imprisoned mum pardoned

Kathleen Folbigg was convicted of the murder of daughters Sarah and Laura and son Patrick, and the manslaughter of another son, Caleb. Twenty years on, a professor has named the "rare" condition that her daughters had. Read more »

Asia Markets to Fall as Wall Street's Rally Takes a Breather; Australia Central Bank Decision Ahead

This is CNBC’s live blog covering Asia-Pacific markets. Asia-Pacific markets fell, tracking similar moves on Wall Street after the S&P 500 erased earlier gains that brought the benchmark index to ... Read more »

How Across The Spider-Verse Changed Marvel's Spider-Punk Forever

Movies Animation Sony Pictures/YouTube Five years ago, “Spider-Man: Into the Spider-Verse” blew the minds of viewers everywhere with its boldly shocking plot twists and the cool new characters that it ... Read more »

Who Voices Clark Kent In My Adventures With Superman?

Television Cartoons Adult Swim/YouTube A new trailer has just been released for the upcoming Adult Swim animated series, “My Adventures with Superman.” The series, which will premiere on July 6, ... Read more »

You Probably Haven't Heard About Miyazaki's Final Studio Ghibli Film - Here's Why

Movies Animation Studio Ghibli Few names in animation are as widely respected as Hayao Miyazaki. The prolific writer, director, and animator has been behind some of the most iconic and ... Read more »

US House panel investigates ties between US Interior secretary, environmentalists

US House panel investigates ties between US Interior secretary, environmentalists Members of the U.S. House Committee on Natural Resources have launched an investigation into ties between Interior Secretary Deb Haaland ... Read more »

After 6 women found dead, Portland officials warn against serial killer speculation

After 6 women found dead, Portland officials warn against serial killer speculation Six women under the age of 40 have been found dead over the last three months. ByPeter Charalambous ... Read more »

Approval for Idaho phosphate mine reversed after judge rules US didn't assess prairie bird impact

Approval for Idaho phosphate mine reversed after judge rules US didn't assess prairie bird impact A federal judge has yanked the U.S. government's approval for a phosphate mining project in ... Read more »

Oregon is invested in Fox Corp. and is investigating its board over bogus election fraud claims

Oregon is invested in Fox Corp. and is investigating its board over bogus election fraud claims Oregon’s attorney general has announced she has begun investigating the board of directors of ... Read more »

Who Plays Antoinette In The Rookie: Feds?

Television TV Dramas ABC/Raymond Liu Led by Emmy nominee Niecy Nash as Simone Clark, “The Rookie: Feds” features an impressive cast of proven players like Britt Robertson from “Tomorrowland” and ... Read more »

Michael Block comes up short in U.S. Open qualifying bid

Michael Block comes up short in U.S. Open qualifying bid ByESPN.com news services June 5, 2023, 8:09 PM Michael Block, the teaching pro who finished tied for 15th at last ... Read more »

Canadian province of Quebec looks for international support to fight wildfires

Canadian province of Quebec looks for international support to fight wildfires Quebec is looking internationally for support as it struggles to battle more than 160 forest fires and federal officials ... Read more »
Kênh kiến thức kỹ năng, phát triển bản thân, hướng nghiệp, blog nhân sự