DeepMind tells Google it has no idea how to make AI less toxic

Google, Natural language processing, artificial intelligence, GPT, state of the art, bigotry

Did you know Neural is taking the stage this fall? Together with an amazing line-up of experts, we will explore the future of AI during TNW Conference 2021. Secure your ticket now!

Opening the black box. Reducing the massive power consumption it takes to train deep learning models. Unlocking the secret to sentience. These are among the loftiest outstanding problems in artificial intelligence. Whoever has the talent and budget to solve them will be handsomely rewarded with gobs and gobs of money.

But there’s an even greater challenge stymieing the machine learning community, and it’s starting to make the world’s smartest developers look a bit silly. We can’t get the machines to stop being racist, xenophobic, bigoted, and misogynistic.

Nearly every big tech outfit and several billion-dollar non-profits are heavily invested in solving . And, according to the latest study on the subject, we’re not really getting anywhere.

The prob: Text generators, such as OpenAI’s GPT-3, are toxic. Currently, OpenAI has to limit usage when it comes to GPT-3 because, without myriad filters in place, it’s almost certain to generate offensive text.

In essence, numerous researchers have learned that text generators trained on unmitigated datasets (such as those containing conversations from Reddit) tend towards bigotry.

It’s pretty easy to reckon why: because a massive percentage of human discourse on the internet is biased with bigotry towards minority groups.

Background: It didn’t seem like toxicity was going to be an insurmountable problem back when deep learning exploded in 2014.

We all remember that time Google’s AI right? That’s very unlikely to happen now. Computer vision’s gotten much better in the interim.

But progress has been less forthcoming in the field of NLP (natural language processing).

Simply put, the only way to stop a system such as GPT-3 from spewing out toxic language is to block it from doing so. But this solution has its own problems.

What’s new: DeepMind, the creators of AlphaGo and a Google sister company under the Alphabet umbrella, recently conducted a study of state-of-the-art toxicity interventions for NLP agents.

The results were discouraging.

Per from the DeepMind research team:

We demonstrate that while basic intervention strategies can effectively optimize previously established automatic metrics on the REALTOXICITYPROMPTS dataset, this comes at the cost of reduced LM (language model) coverage for both texts about, and dialects of, marginalized groups.

Additionally, we find that human raters often disagree with high automatic toxicity scores after strong toxicity reduction interventions — highlighting further the nuances involved in careful evaluation of LM toxicity.

The researchers ran the intervention paradigms through their paces and compared their efficacy with that of human evaluators.

A group of paid study participants evaluated text generated by state-of-the-art text generators and rated its output for toxicity. When the researchers compared the human’s assessment to the machine’s, they found a large discrepancy.

AI may have a superhuman ability to generate toxic language but, like most bigots, it has no clue what the heck it’s talking about. Intervention techniques failed to accurately identify toxic output with the same accuracy as humans.

Quick take: This is a big deal. Text generators are poised to become ubiquitous in the business world. But if we can’t make them non-offensive, they can’t be deployed.

Right now, a text-generator that can’t tell the difference between a phrase such as “gay people exist” and “gay people shouldn’t exist,” isn’t very useful. Especially when the current solution to keeping it from generating text like the latter is to block it from using any language related to the LGBTQ+ community.

Blocking references to minorities as a method to solve toxic language is the NLP equivalent of a sign that says “for use by straight whites only.”

The scary part is that DeepMind, one of the world’s most talented AI labs, conducted this study and then forwarded the results to . That’s Google’s crack problem-solving team. It’s been unsuccessfully trying to solve this problem since 2016.

The near-future doesn’t look bright for NLP.

You can read the whole paper .

Internet Explorer Channel Network
News Related

OTHER NEWS

GCHQ will store classified material in the Amazon cloud

Amazon will not have access to information stored in the system, according to reports – REUTERS Britain's most classified material is to be hosted in the cloud by Amazon after ... Read more »

Airline sells tickets to mystery locations via vending machine

After more than 19 months of boarder restrictions, it’s not uncommon to hear someone say they would travel ‘anywhere’ if given the chance. But what if the destination was decided ... Read more »

OVHcloud releases new Advance Bare Metal Servers for SMEs

OVHcloud has announced a new lineup of mid-range dedicated servers aimed at SMEs which are equipped with the latest generation of components. As part of this new offering, the European ... Read more »

Coronation Street confirms Corey Brent's exit storyline

Coronation Street spoilers follow. Coronation Street has revealed that Corey Brent's storyline will finally come to a head next week. Fans are hoping that Corey will face his comeuppance at ... Read more »

Chef spoofs Salt Bae's £1,450 steak by serving £12 gold leaf pork pie

Chef Gareth Mason from the Absolute Bar and Bistro, Bolton, who has spoofed Salt Bae with his golden pork pie. (SWNS) Celebrity chef Salt Bae has taken a lot of ... Read more »

Samsung Card Q3 net profit up 8.9 pct. to 139.5 bln won

SEOUL, Oct. 26 (Yonhap) — Samsung Card Co. on Tuesday reported its third-quarter net income of 139.5 billion won (US$119.5 million), up 8.9 percent from a year earlier. Operating profit ... Read more »

(LEAD) SK hynix delivers solid Q3 performance on rising memory prices

(ATTN: CHANGES headline, lead; REWRITES; ADDS photos)By Woo Jae-yeon SEOUL, Oct. 26 (Yonhap) — SK hynix Inc., South Korea’s No. 2 chipmaker, reported strong third-quarter earnings Tuesday on the back ... Read more »

At least 2 dead in Boise, Idaho, mall shooting, authorities say; suspect arrested

At least two people are dead and four others are injured, including a police officer, after a shooting at a shopping mall Monday in Boise, Idaho, authorities said. At a ... Read more »

Jeff Bezos' Blue Origin unveils plans to occupy space

Jeff Bezos apparently wasn’t satisfied with merely flying through space. The world’s richest person now wants to occupy it. Bezos’ Blue Origin on Monday to build a commercial space station ... Read more »

EU tech rules should curb cloud computing providers, study says

FILE PHOTO: The logos of Amazon, Apple, Facebook and Google By Foo Yun Chee BRUSSELS (Reuters) – Draft EU rules to curb the power of Amazon, Apple, Alphabet unit Google ... Read more »

Rust Gaffer Says He Held Halyna Hutchins 'While She Was Dying,' Blames Her Death on 'Negligence'

Cinematographer Halyna Hutchins' colleague on the set of Rust is revealing his account of the tragic shooting that took her life last week. Serge Svetnoy, who served as the electrician ... Read more »

Cybercriminals secretly plan to run down entire security teams, here's what businesses can do

After a year of high-profile cyberattacks, including ransomware campaigns on organizations such as JBS, Colonial Pipeline, Kaseya and more, the need for organizations to prioritize cybersecurity holds more weight than ... Read more »

Google's 'FrightGeist' lists the most popular 2021 Halloween costumes. Is yours one of them?

Worried about someone having the same costume as you at the Halloween party you are going to? Google may be able to help you. With COVID-19 cases down compared to ... Read more »

MacBook Air (2020) vs MacBook Pro (2020) which is the best for you?

When it comes to the Apple MacBook Air (2020) vs MacBook Pro (2020) in the battle for the M1 crown, it’s really going to come down to whether you’re looking ... Read more »

GameStop PS5 restock in-store event on Friday – all 225 stores and times listed

There’s another GameStop PS5 restock in-store event in the US, and the official date is Friday, October 29. This is your chance to buy the Sony PlayStation 5 console, if ... Read more »

Tech hub Shenzhen calls off new trade shows in city amid rising Covid-19 infections in other parts of China

Shenzhen, the southern tech hub known as China’s Silicon Valley, has either postponed or cancelled a number of trade fairs and exhibitions that the city was expected to host this ... Read more »

Saints vs Seahawks live stream: how to watch NFL Monday Night Football online anywhere

Geno Smith isn’t exactly getting an easy time of it on his return to NFL action. First the Rams, then the Steelers, and now a well-rested Saints team coming off ... Read more »

Facebook profits top $9bn despite facing recent whistleblower revelations

© Provided by The Guardian Photograph: Jenny Kane/AP Facebook’s profits topped $9bn during its most recent financial quarter, clearing investor predictions even as the company faces an onslaught of negative ... Read more »

Zoom free users are getting this super helpful feature at last

Zoom has announced that it will bring a popular feature from the paid version of its video conferencing software to all of its free users in an effort to make ... Read more »

10 super spooky horror games to play this Halloween

— Recommendations are independently chosen by Reviewed’s editors. Purchases you make through our links may earn us a commission. While nothing is stopping you from playing horror games at any ... Read more »

France plans 'go slow' strategy on British lorries in retaliation over fishing row

Lorries – Paul Grover for the Telegraph France is preparing to implement a go-slow strategy for customs checks on shipments to and from Britain ahead of Christmas in an escalation ... Read more »

Katharine Hayhoe, The Nature Conservancy and Christian Braneon, NASA GISS, on Yahoo Finance's AMS 2021

Understanding climate change and its effects, with Katharine Hayhoe The Nature Conservancy Chief Scientist & Christian Braneon NASA Goddard Institute for Space Studies Columbia University Climate School Read more »

Intel CEO: My job is to win Apple back

Intel CEO Pat Gelsinger says the ball is in the chip giant's court to win back lost business from the Mac making Apple. “My job is to win them [Apple] ... Read more »

Facebook whistleblower tells UK lawmakers until 'incentives change,' the company won't

Facebook whistleblower Frances Haugen, weeks after testifying before Congress, on Monday delivered to members of the British Parliament a similar message : The social network giant has cultivated a platform ... Read more »

Closing the gap between understanding climate change and fixing it

In an interview with Yahoo Finance’s Rick Newman, Katharine Hayhoe The Nature Conservancy Chief Scientist & Christian Braneon NASA Goddard Institute for Space Studies Columbia University Climate School discuss how ... Read more »

Giovanni Pernice denies ‘wrongdoing' after reported split from Maura Higgins

Strictly Come Dancing star Giovanni Pernice has denied that “wrongdoing” led to his recent breakup following his reported split from Maura Higgins. The professional dancer was reported to have split ... Read more »

Shiloh Jolie-Pitt's Yellow Leopard Sneakers Make Headlines - Here's Where They're From

Angelina Jolie may be dropping jaws left and right, wearing beautiful gowns by Atelier Versace, Balmain, and Ralph Lauren on the Eternals red carpets, but her daughters are making sustainable ... Read more »

Judi Love says 'Strictly' fitness is helping her cope with COVID

Judi Love says her Strictly fitness is helping her fight COVID. (BBC/Guy Levy) Judi Love has said she is thankful for having got fit through training for Strictly Come Dancing ... Read more »

So it turns out the MacBook Pro's M1 Max isn't a gaming chip, does it matter?

The M1 Max was announced, along with the new MacBook Pro computers, about a week ago. I was pretty impressed by it on paper, but now performance information is starting ... Read more »

Shop the Allswell Friends and Family sale for dreamy discounts on luxury mattresses and more

— Recommendations are independently chosen by Reviewed’s editors. Purchases you make through our links may earn us a commission. While the holidays may be the most wonderful time of the ... Read more »

The best city building games to rule the urban jungle

The best city building games give you power. Like, a lot of power. All the power, sometimes. And, depending on your own sensibilities, sometimes too much power. Which is to ... Read more »

Oakley vs. 3M: How does a $100+ and a $10 pair of safety glasses compare?

— Recommendations are independently chosen by Reviewed’s editors. Purchases you make through our links may earn us a commission. A good pair of safety glasses is one of the most ... Read more »

We might have just seen our first exoplanet in another galaxy

Astronomers at the Chandra X-ray Observatory just announced that they might have identified an exoplanet in another galaxy for the first time ever. The possible exoplanet candidate was spotted in ... Read more »

No one is coming to save our graphics cards from the cryptomines

There are a lot of reasons why the best graphics cards are nearly impossible to find right now. There’s the issue of the ongoing chip shortage, a broader supply chain ... Read more »

Ransomware cyber attacks double in a year, reveals spy chief

Increasing numbers of people are being held to ransom by cyber attackers – Peter Byrne/PA Wire Cyber attacks doubled in the last year, the chief of GCHQ has revealed – ... Read more »

Why the Musk vs. Bezos space feud is probably fake

Flick through a news feed on your phone and you are likely to scroll across an article of the new space race. Forget the geopolitical struggles of a cold war. ... Read more »

Sony WF-1000XM3 Wireless Earbuds

The Sony WF-1000XM3 True Wireless headphones have a lot to live up to: Launched as part of the brand’s lauded 1000X family of noise-cancelling headphones – that includes the award-winning ... Read more »

Best iPad deals 2021: cheapest iPad Air, iPad Pro and iPad Mini prices

Apple’s iPads are some of the best tablets around. And with a range of models at various price points, there’s something for everyone. Here we’ve rounded up the best iPad ... Read more »

2 border agents are fired for offensive Facebook posts

Two Border Patrol agents were fired from among 60 found to have committed misconduct for participating in a private Facebook group that mocked migrants and lawmakers, investigators said Monday in ... Read more »
On free-english-test.com you will find lots of free English exam practice materials to help you improve your English skills: grammar, listening, reading, writing, ielts, toeic