DeepMind's new 280 billion-parameter language model kicks GPT-3's butt in accuracy

Artificial intelligence, GPT, Google’s massive trillion-parameter LLM, Follow @neural

Move over GPT-3, there’s a scrappy new contender for the crown of world’s greatest language model and it’s from our old pals over at DeepMind.

Up front: The Alphabet-owned UK outfit that answered the question of whether humans or computers are better at chess once and for all – – has now set its sights on the world of large language models (LLM).

To that end, today it announced “Gopher,” a language model that’s about 60% larger, parameter-wise, than GPT-3 and a little over a quarter of the size of Google’s massive trillion-parameter LLM.

Per on the DeepMind blog:

In our research, we found the capabilities of Gopher exceed existing language models for a number of key tasks. This includes the Massive Multitask Language Understanding (MMLU) benchmark, where Gopher demonstrates a significant advancement towards human expert performance over prior work.

Background: DeepMind accomplished the improvements by focusing in on areas where expanding the size of an AI model made sense.

The more power you can shove into a model for, say, reading comprehension, the better. But the team found that other areas of LLM architecture didn’t benefit as much from brute force.

By prioritizing how the system utilizes and distributes resources, the team was able to tweak their algorithms to outperform state-of-the-art models in 80% of the benchmarks used.

Artificial intelligence, GPT, Google’s massive trillion-parameter LLM, Follow @neural
Credit: DeepMind

The DeepMind team also released papers discussing the ethics and architecture of LLMs, you can read those and .

Quick take: To paraphrase the great poet Montell Jordan: this is how you do it. Instead of careening the field towards ruin by increasing the size of models exponentially until GPT-5 or GPT-6 ends up being larger than the known universe, DeepMind’s trying to squeeze more oomph out of smaller models.

Don’t get me wrong, Gopher has significantly more parameters than GPT-3. But, when you consider that , it looks like DeepMind’s moving in a more feasible direction.

News Related

OTHER NEWS

Shop the best TV deals under $500 from Samsung, TCL, Hisense and Vizio

— Recommendations are independently chosen by Reviewed’s editors. Purchases you make through our links may earn us a commission. TVs are a major investment, both as a home essential and ... Read more »

These software flaws could have left your Tesla open to anyone

A vulnerability in a logging software used by Tesla car owners, paired with some poor security practices by the same owners, allowed a cybersecurity researcher to take “full control” of ... Read more »

Google To Replace Third-Party Cookies With Topics API Browser Approach

Google  – Alphabet Inc (NASDAQ:GOOGL) is testing a new approach called Topics API, aiming to replace the FLoC – Federated Learnings of Cohorts – announced last year. With the move, ... Read more »

Every Entrepreneur Should Back Up Their Email

From internal communications to email marketing, email remains king of the business world in 2022. Sure, instant messaging apps like Slack and Microsoft Teams have made headways, but in the ... Read more »

BrewDog founder James Watt threatens to sue BBC over claims of inappropriate behaviour

BrewDog founder James Watt – Chris Ratcliffe/Bloomberg The founder of BrewDog is threatening to sue the BBC over claims the broadcaster obtained private information by “underhand means”. James Watt is ... Read more »

Report: Nvidia may soon drop Arm bid

By the time you read this Nvidia’s nearly two-year-long quest to consume mobile chip giant Arm may be over. Bloomberg is reporting that Nvidia may be winding down efforts to ... Read more »

Cases of ‘more transmissible' Omicron sub-lineage BA.2 increasing in UK

A COVID testing centre outside Goodison Park stadium in Liverpool. (Getty) Cases of the “more transmissible” Omicron sub-lineage BA.2 are increasing in the UK. The UK Health Security Agency (UKHSA) ... Read more »

Coleen Nolan reveals surprising reason she was nervous about introducing her boyfriend to children

1 / 2Coleen Nolan reveals surprising reason she was nervous about introducing her boyfriend to childrencoleen-michael Coleen Nolan has revealed the surprising reason why she was “really nervous” about introducing ... Read more »

Rishi Sunak accidentally went to Boris Johnson's No 10 birthday event

Chancellor Rishi Sunak was unintentionally present at the prime minister’s birthday gathering during lockdown, a Treasury source said. (PA Images) Rishi Sunak accidentally attended Boris Johnson's birthday gathering during lockdown, ... Read more »

Big Dog was now The Suspect, but at least Gray's report would be delayed… Oh.

Boris Johnson’s day goes from bad to worse, with only a hardcore of loyalists left defending him Big Dog was having a bad morning. Normally he could rely on Grant ... Read more »

Amazon just announced the most popular Valentine's Day gifts—here's what to buy

— Recommendations are independently chosen by Reviewed’s editors. Purchases you make through our links may earn us a commission. Whether you’re shopping for your significant other, your friends or your ... Read more »

This new Sony soundbar offers 5.1 surround sound from a simple 2.1 system

Sony has started to announce its 2022 lineup of audio products, beginning with the new HT-S400 soundbar that will become available around April of this year for $299 (around £220, ... Read more »

Warm up your winter with 35% off Solo Stove bundles

— Recommendations are independently chosen by Reviewed’s editors. Purchases you make through our links may earn us a commission. Cold weather getting you down? Bring the heat with Solo Stove. ... Read more »

Meta's new AI supercomputer will create the backbone for the metaverse

Meta (née Facebook) has announced it is building its own AI supercomputer in support of its efforts to bring the metaverse to fruition. The AI Research SuperCluster (RSC) is already ... Read more »

Chinese fashion retailer Shein revives plan for New York listing in 2022

Hong Kong/Singapore: Chinese fashion retailer Shein is reviving plans to list in New York this year and its founder is considering a citizenship change to bypass proposed tougher rules for ... Read more »

One of the best Google Chrome features is getting an upgrade

Juggling multiple tasks, windows and displays at work could soon be a lot easier thanks to a new update coming to Google Chrome. The browser is set to upgrade its ... Read more »

The James Webb Space Telescope owes its success to Hubble's bumpy start

When the Hubble Space Telescope launched in April 1990, it was an instrument decades in the making. Originally called the Large Space Telescope, Hubble was the most advanced telescope ever ... Read more »

Dwayne Johnson is making a new video game movie – so what could it be?

Dwayne Johnson has revealed he’s developing a movie based on “one of the biggest, most badass games” of all time – and yes, we’re hoping it isn’t Doom II, too. ... Read more »

Female student ‘chased man across nightclub after he exposed himself on dancefloor'

Suranga Wijethunga, 36, outside Oxford Crown Court. (SWNS) A man exposed his privates and then pressed himself against a woman’s back on a nightclub dance floor, a court heard. Suranga ... Read more »

Girl named 'Ikea' after mum saw TV ad has to change name due to bullying

Jasmine said her mum Linda had agreed to the name change, despite benefiting from perks from the company after her birth. (SWNS) A teenager who was named 'Ikea' after her ... Read more »

Marilyn Manson responds to allegations he ‘raped' Evan Rachel Wood on music video set

Watch: Marilyn Manson denies sexually assaulting Evan Rachel Wood on music video set Marilyn Manson has denied “essentially raping” Evan Rachel Wood on camera while filming a music video in ... Read more »

Adele Did Not Postpone Concert Over COVID, Caesars Palace Sources Claim

Christopher Polk/Getty Images As Adele continues to issue refunds and FaceTime fans who’d shown up in Las Vegas for her abruptly postponed residency, it appears some insiders want to set ... Read more »

Yasmin Chkaifi: Woman stabbed to death in Maida Vale by ‘demon' ex-husband pictured

Yasmin Chkaifi, 43, has been named as the victim of a stabbing in Maida Vale, west London (Family handout/Metropolitan Police) A mother stabbed to death in broad daylight by her ... Read more »

Downing Street parties: The tweets coming back to haunt Boris Johnson

Boris Johnson has been hit by allegations of yet another party said to have taken place at Downing Street while social restrictions were in place to stop the spread of ... Read more »

PUBG going free-to-play has paid off tremendously

PlayerUnknown’s Battlegrounds has been free-to-play for almost two weeks now and the switch appears to have paid off in a big way. According to PUBG’s parent company Krafton (via GameSpot), ... Read more »

Mobvoi announces super-cheap wireless earbuds with active noise cancellation

Mobvoi has unveiled its new Earbuds ANC, wireless earbuds that boast active noise cancellation and up to 21 hours of battery life. If that wasn’t enticing enough, these lightweight earbuds ... Read more »

Home Depot Presidents' Day sale 2022: when it is and today's best deals

The Home Depot Presidents’ Day sale is always a highly anticipated shopping event with incredible bargains on everything from major appliances, furniture, tools, kitchen devices, and more. We’ve created this ... Read more »

Save $150 on the MacBook Air with this deal exclusive to Amazon

Are you looking for a MacBook deal? Thanks to a new voucher, you can currently get the excellent 2020 MacBook Air M1 for its cheapest price so far this year. ... Read more »

Three new Star Wars games are on the way, including Jedi: Fallen Order follow-up

Respawn, the developer behind Jedi: Fallen Order and Apex Legends, is making three new video games set in the Star War universe. Alongside another entry in the Star Wars Jedi ... Read more »

Dottir Freedom On-Grid review

One-minute review The Dottir Freedom On-Grid are sports-focused headphones that deliver rich audio and stay in place even during tough interval workouts. Dottir Audio takes its name from the Icelandic ... Read more »

Microsoft's Satya Nadella, and Google's Sundar Pichai get Padma Bhushan, India's third-highest civilian award

In a big honour for the top India-origin tech prowess that has virtually taken over the Silicon Valley in the US, the Indian government has awarded Padma Bhushan to Microsoft ... Read more »

Battlefield 2042 is losing popularity on Xbox while Steam reviews remain negative

Only two months since it launched, Battlefield 2042 appears to be waning in popularity on Xbox. Initially spotted by Theorry on ResetEra, both the Xbox One and Xbox Series X|S ... Read more »

The Ricoh Theta X is a pocket 360 camera for creating immersive virtual tours

It’s been almost a decade since Ricoh introduced one of the first 360-degree cameras, and now it’s made a new Theta model that brings a few useful, if not entirely ... Read more »

LG Energy Solution, GM to build $2.1 billion EV battery plant

South Korea’s LG Energy Solution (LGES) plans to spend $2.1 billion with General Motors to build a U.S. electric vehicle (EV) battery plant, parent firm LG Chem said on Tuesday. ... Read more »

Hyderabad-based tech startup Darwinbox turns unicorn

Hyderabad-based technology startup Darwinbox has turned unicorn with the raising of $72 million funding in the latest round for global expansion.With this round, the company’s valuation will cross the $1 ... Read more »

3 U.S. States, D.C. Sue Google for 'Deceptive' Location Tracking

Texas, Indiana, Washington State and the District of Columbia each filed suit against Google in their respective state courts on Monday, alleging that the company has implemented “dark patterns” and deceptive ... Read more »

Google Docs will now really let you stamp your mark on your work

Making sure your work gets the respect it deserves will soon be a lot easier in Google Docs thanks to a new privacy tool coming to the service. The word ... Read more »

LG's 65-inch C1 OLED TV drops to record-low price just ahead of the Super Bowl

The big game is just weeks away, and if you’re looking to snag an epic Super Bowl TV deal on a stunning display, then you’re in luck. We’ve just spotted ... Read more »

MWC 2022 cancellations: which brands will be at this year's show?

Mobile World Congress is the largest mobile technology show in the world, and its next iteration is set to take place in Barcelona at the end of February. That’s despite ... Read more »

Samsung Galaxy Buds Pro vs Apple AirPods Pro: the noise-cancelling earbuds compared

The Samsung Galaxy Buds Pro arrived in January 2021, following months of leaks and rumors – and with active noise cancellation and 3D audio support, they’re a serious rival for ... Read more »
On free-english-test.com you will find lots of free English exam practice materials to help you improve your English skills: grammar, listening, reading, writing, ielts, toeic