CPUs, bottlenecks, and games: the problem with CPU benchmarking

cpus, bottlenecks, and games: the problem with cpu benchmarking

CPUs, bottlenecks, and games: the problem with CPU benchmarking

The long-awaited Ryzen 7000X3D series is here, and everyone agrees that the Ryzen 9 7950X3D is the fastest CPU for gaming… but by how much? That’s a tough question to answer because the reviews are all over the place. Some publications found that the 7950X3D was barely any faster than Intel’s Core i9-13900K, while others found larger margins of over 10%. It’s not like reviewers are testing completely different games, and in non-gaming benchmarks like Cinebench R23, the scores are about the same across the board, give or take a percentage point.

This isn’t the first time reviewers can’t agree on how fast CPUs are for games. In fact, it happens to pretty much every CPU, whether it has a fancy 3D V-Cache or not. We don’t really see these wide, varying margins for reviews on GPUs, SSDs, or even CPUs in non-gaming benchmarks. So what’s the deal? It ultimately comes down to the unique behavior of CPUs in games and the different testing methodologies used from review to review.

The curious case of the CPU bottleneck

Modern GPUs have anywhere from hundreds to tens of thousands of cores. These cores are highly flexible and are ideal for tackling workloads that scale in difficulty. This means the best gaming GPUs can handle graphics settings that result in varying visual quality and frames per second. Lowering graphics settings like resolution makes the math for rendering frames easier, meaning more frames can be rendered per second. On the other hand, if frames are harder to render, fewer will be made per second.

The role of the CPU in games is vastly different from that of the GPU. Since the early 2000s, many processes originally performed on the CPU are now done by the GPU, leaving the CPU with relatively little to do. The most important task of the CPU is just to get these minimal tasks done as soon as possible.

But there are two major problems. Firstly, these tasks can’t be spread evenly to all cores and threads, so more cores doesn’t always mean better performance. Secondly, bigger cores with more computational power won’t be useful since these workloads are so basic. These factors make clock speed and cache size disproportionately important for gaming. Cache reduces the time spent waiting for data, which is a significant factor in performance loss. Clock speed, on the other hand, is the only realistic way to speed up workloads that can’t take advantage of modern chips’ raw horsepower.

A PC’s gaming performance is determined mainly by the GPU and the CPU (storage and RAM are usually secondary factors), but not at the same time because at any given moment, your performance is either limited by the GPU or the CPU. That naturally leads to one big question: When is a PC limited by the CPU or the GPU? This question actually gets to the heart of one of the most confusing things about gaming benchmarks because the difference between GPU and CPU bottlenecks isn’t very intuitive.

When your PC is GPU limited, the graphics card will be running at or close to 100% usage, which means using as many resources as possible and usually hitting the max power consumption. This means that you can trade frames for visual quality and vice versa. But for most games, these graphics settings don’t directly impact the CPU, and even in games with CPU-related settings, there are usually only a few.

Increasing graphics settings isn’t necessary to create a CPU bottleneck in games. In fact, increasing graphics settings practically ensures you’ll never see a CPU bottleneck. Remember, the CPU is pretty limited in the amount of work it can do, and while there are few, if any, settings you can tweak to increase the workload in games, you can increase the framerate by lowering graphics settings.

Since the early 2000s, many processes originally performed on the CPU are now done by the GPU, leaving the CPU with relatively little to do.

Running into a CPU bottleneck is simple if you increase the framerate to where the GPU can render more frames than the CPU can deal with. This basically means a CPU has a limit to how many frames it can show in any given game. There are only two realistic ways to remove a CPU bottleneck in games. You can get faster RAM with higher frequency and timings for a small performance boost or lower the framerate — and it’s that second option that creates problems for benchmarking.

Imagine a reviewer is testing two hypothetical CPUs, Gamma and Zeta. In a big-budget, graphically intense game like Atomic Heart, Gamma can get up to 200 FPS while Zeta can achieve 300. Depending on how the reviewers test the CPUs and how hard they push the framerate up, they could find that both CPUs are roughly equal, that Zeta has a slight advantage, or that Zeta has a commanding lead. This is why CPU reviewers often come to different conclusions about CPU performance in games.

Therein likes the basic dilemma of reviewing CPUs in games. You need to push the framerate as high as possible to expose CPU bottlenecks and thus show the true limits of each CPU, often resulting in an unrealistic benchmark. As you can imagine, this phenomenon has been causing controversy for years.

The dilemma of benchmarking CPUs in games

Most enthusiasts take one of two positions when it comes to CPU benchmarking. The first position advocates for a more scientific approach that exposes the bottleneck without regard for realistic settings, while the second argues that reviewers should test at settings that mean more to readers who want to make purchasing decisions.

Each school of thought has its strengths and weaknesses. The proponents of the scientific position (usually reviews and fans of the company with the fastest CPU) are undoubtedly correct in that this approach reveals the CPU’s true limits in gaming. However, they also often argue that these tests accurately predict future performance. When you upgrade your GPU and suddenly have the capacity for higher framerates, you obviously want a better CPU.

This argument about future performance has been debunked multiple times. While AMD’s FX CPUs initially launched to poor results in gaming compared to Intel’s offerings, over time, chips like the FX-8350 actually gained ground and even overtook their Core i5 counterparts as games started to use more cores and threads. Additionally, I would argue that gamers rarely upgrade graphics cards purely for higher framerates. Gamers want better framerates and better quality settings, including higher resolutions. This reduces the chances of exposing a CPU bottleneck after a GPU upgrade.

The argument for “realistic” settings is more intuitive and easier to follow, but most of the rhetoric is just about how bad 1080p is for testing high-end CPUs. The thing is, can you even properly test a high-end CPU against one that’s midrange or lower at a higher resolution? If you have a Core i9-13900K, you’re simply more likely to aim for higher framerates purely because your PC also has a high-end GPU like the RTX 4090, while a user with a Core i3-13100 is unlikely to aim much further past 60 FPS because they probably also have a lower-end GPU like an RX 6500 XT. Do you test at settings realistic for the 13900K or for the 13100?

That being said, I think this second camp is making some valid points. I can’t say for certain what the average user wants, but as long time member of this community, I would imagine that most target anywhere 60 to 144 FPS since 60Hz and 144Hz are very popular refresh rates, often come with G-SYNC or FreeSync, and surpassing the refresh rate breaks those technologies. 144 FPS isn’t that much higher for modern CPUs, so CPU bottlenecking is less likely, and consequently, benchmarks that show CPUs getting 300 FPS probably aren’t very useful to most users.

This debate goes back at least six years, and I first encountered it when the first-generation Ryzen series launched in 2017. Reviewers have mostly remained committed to either the scientific point of view or generally indifferent to either side in their testing. On the other hand, readers mostly get upset when their preferred brand loses in the reviews, but they bring up some good points. However, I believe there’s a middle path that can satisfy the requirements of both philosophies, a way of benchmarking that uses both realistic settings and achieves results that are relevant to readers.

Why the framerate itself is a key part of a CPU benchmark

I’ve always been fascinated by testing methodology and ways to show people results that actually mean something. This is more of a thought experiment rather than a serious proposal, and it’s something I use for fun, but I’ve come up with my own CPU testing methodology.

We can’t ignore the potential maximum framerates made possible by the GPU because it determines how CPUs perform and how realistic it is for users. What I propose is to turn this concept on its head and select settings to achieve a certain framerate rather than setting specific presets or setting everything to minimum.

Here’s the basic methodology. Select a control CPU that every other CPU will be compared against. Since CPUs have a performance limit, the control chip should be the fastest CPU you’re testing, such as a Core i9-13900K or a Ryzen 9 7950X3D. Next, start at higher graphics settings, run your benchmarks, and keep tweaking the settings until your control CPU achieves your desired framerate. For example, in esports titles like Counter-Strike: Global Offensive, your desired framerate should probably be at least 240 FPS on average — if not higher.

A CPU review is supposed to show what’s worth buying and what isn’t, and although reviews are the product of many hours of hard work, not every review critically analyzes the data.

Once you’ve found the settings that achieve your preferred framerate on the control CPU, use those settings when testing other chips. The idea is to show how much faster the control CPU can be compared to theoretically slower CPUs in a test that is both scientific and realistic. What people want to know is whether a higher-end CPU is worth the money, and this kind of methodology is very good at showing that.

There’s one obvious problem with this kind of benchmarking, though: It takes time. Tweaking graphics settings and running benchmarks until the control CPU has the right framerate is time-consuming, and not using presets can mean changing individual settings on each new CPU for each game. Additionally, new CPUs and games require additional calibration, perhaps to the point where you need to make a different CPU the control. Just choosing a preset or setting everything to minimum is way easier.

There are alternatives to this methodology that are much easier to implement. Many reviewers test at multiple resolutions to show the shifting CPU bottleneck, with 1080p having the most CPU bottlenecking and 1440p or 4K the least. Techspot and Anandtech sometimes test multiple GPUs to achieve the same effect since faster GPUs will have a higher potential framerate that may reveal CPU bottlenecking.

Analysis is even more important than methodology

A good testing methodology and high-quality data are only half of what makes a review comprehensive. The other half is analysis, which is when the reviewer informs the readers what the results mean. Many users can make up their own minds about what data means, but not everybody into PC gaming is an enthusiast.

If a review shows a benchmark where one CPU is hitting 500 FPS and another 300, there should be some context on what that means. If it’s an esports title, that difference could be important to anyone who wants to play competitively and needs the highest framerates. For most other games, the performance advantage offered by the faster CPU will unlikely be fully realized or appreciated. I’ve seen some reviews show benchmarks with these kinds of results in very old games and hype up the faster CPU, while other reviews found much more modest margins in more realistic tests.

Ultimately, a CPU review is supposed to show what’s worth buying and what isn’t, and although reviews are the product of many hours of hard work, not every review critically analyzes the data. I appreciate the reviewers who take a moment to discuss CPU bottlenecks and how they grow or shrink with different GPUs and graphics settings. It’s certainly true that some CPUs are faster than others, and are better for gaming, but it’s never clear-cut if that means it’s better for every single user.

News Related


Skip College and Get to Work: 20 Highest Paying Jobs ($100k+) With No Degree Required

Many high-paying jobs don’t require a college degree; you only need a high school diploma to start working in some of these well-paying positions. Many of these jobs even pay ... Read more »

Do gun buybacks work?

HOUSTON – The jury is still out for the gift card initiative known as the gun buyback program. Whether it’s $50 or $200, just turn in a gun, and Houston-area ... Read more »

Gwyneth Paltrow Accuser Calls Utah Ski Crash ‘Serious Smack'

Paltrow’s attorneys have argued the lawsuit is an attempt by an “obsessed” man to exploit the actor-turned-lifestyle influencer's wealth and celebrity Read more »

College Athlete Influencers Confront Security Concerns

Athletes are becoming mindful of staying safe with the possibility of overzealous fans becoming menacing rising Read more »

Highland Park Mother Visiting Nashville Delivers Plea After Deadly School Shooting

Three adults and three children were killed early Monday by a 28-year-old woman at The Covenant School in Nashville, police said. Read more »

What happens when YOU die? VR 'death simulator' lets you find out

What happens when you die is the world’s greatest mystery, but virtual reality may help put people’s fears of the afterlife to rest. Artist Shaun Gladwell developed an immersive near-death ... Read more »

Fast X Image With Vin Diesel & Brie Larson Breaks A Franchise Tradition

Fast X Image With Vin Diesel & Brie Larson Breaks A Franchise Tradition Vin Diesel and Fast and the Furious newcomer Brie Larson break a surprising long-held franchise tradition in ... Read more »

The Bachelorette Season 20 Announces New Time Slot

The Bachelorette Season 20 Announces New Time Slot The Bachelorette season 20 starring Charity Lawson will debut in June, and ABC has announced a new time slot. Charity, a 27-year-old ... Read more »

Terry Sanderson testifies he went 'flying' in Gwyneth Paltrow ski collision, sustained concussion

Terry Sanderson, who is suing Gwyneth Paltrow for $300,000 over a 2016 ski crash, has a different recollection of events than the actress put forth in court on Friday. Sanderson, 76, took ... Read more »

Waco True Story: 14 Biggest Details The Netflix Documentary Leaves Out

Waco True Story: 14 Biggest Details The Netflix Documentary Leaves Out Trigger warning! This article contains discussions of real-world murder and death, including young children. Warning: Contains SPOILERS for WACO: ... Read more »

The new @MicrosoftTeams is here and its making me want to switch from Slack

If you purchase an independently reviewed product or service through a link on our website, BGR may receive an affiliate commission. The new @MicrosoftTeams is here and its making me ... Read more »

A recession in 2023 is now inevitable. Layoffs in tech and finance will spread to other sectors

More than a year ago, I forecast a recession would begin in the second half of 2023. That was a no-brainer. Years of virtually zero interest rates ignited stock markets, ... Read more »

Russian forces have a new focus, and the target city already looks like a 'place from post-apocalyptic movies,' Ukrainian officials say

A military vehicle drives through an area destroyed after a strike, in the city of Avdiivka, Donetsk Oblast, on March 18, 2023. ARIS MESSINIS/AFP via Getty Images Russian forces have ... Read more »

Almost Half Of All A380s Are Still Stored, Scrapped, Or In Maintenance

Almost Half Of All A380s Are Still Stored, Scrapped, Or In Maintenance The Queen of the Skies has graced airports worldwide since it debuted into commercial service. Today, 124 of ... Read more »

Rapper Da Brat, Wife Jessica Harris-Dupart Reveal Their Baby's Gender

Da Brat, left and Jessica Dupart attend “Brat Loves Judy” Season Two Premiere on June 9, 2022 in Atlanta, Georgia. Updated as of 3/27/2023 at 11:40a.m.: Over a month after ... Read more »

Your Weekly Horoscope Predicts Spontaneous Romantic Encounters & Exciting New Friendships

Your Weekly Horoscope Predicts Spontaneous Romantic Encounters & Exciting New Friendships Your horoscope for the week of March 27 to April 2 says universe has been throwing a lot of ... Read more »

What is the healthiest cheese? Here are some low-sodium, low-calorie and low-fat options.

While the internet remains agog over the viral ‘Butter Board’ trend, snack board purists will remember the blueprint: the charcuterie board. Chock full of cheese, crackers, and occasionally a marmalade and some ... Read more »

Fed’s Barr calls Silicon Valley Bank a ‘textbook case of mismanagement’

Top bank regulator to testify Tuesday alongside other officials Read more »

The Rock's Daughter Set For In-Ring Debut At WWE NXT Stand & Deliver

Ava Backstage At A WWE NXT Show Ava, the daughter of WWE legend The Rock, will make her in-ring debut at next Saturday’s “WWE NXT” Stand & Deliver premium live ... Read more »

Harry Potter: Things That Made Dolores Umbridge Scarier Than Voldemort

Harry Potter: Things That Made Dolores Umbridge Scarier Than Voldemort Dolores Umbridge was arguably the most evil character in the Harry Potter series, sometimes more so than Lord Voldemort, mainly ... Read more »

Kaspersky releases tool for decrypting ransomware

Source code leaked last month by infighting members of the Conti gang was used to build the antidote to their attacks. Kaspersky has published a new version of a decryption ... Read more »

The 'Gilmore Girls' Costume Designer Has Just Confirmed The Father Of Rory’s Baby

The costume designer took to TikTok to end the speculation and told fans that it’s obviously Logan. If you need a reminder: Logan is Rory’s now married college boyfriend, who ... Read more »

Arkansas Gov. Signs Law Banning Transgender People From Using Bathrooms Matching Their Gender Identity In Public Schools

Topline Arkansas Governor Sarah Huckabee Sanders (R) signed a law on Tuesday that bans transgender people from using bathrooms that match their gender identity in public schools, the latest in ... Read more »

TikTok's Restaurant Butter Hack Makes Spreading So Much Easier

Plate of bread and butter Dining out can be a special experience on its own. After all, you get to don your finest attire, spend quality time with family and ... Read more »

Christian who escaped Chinese persecution warns US descending into 'communist-style of governance'

The leader of a watchdog group that monitors Christian persecution in China said he’s seeing echoes of the Chinese Community Party “playbook” in the U.S., and he’s worried it’ll get ... Read more »

Lollapalooza 2023: How to get tickets to the Chicago music festival

Billie Eilish and Kendrick Lamar Lollapalooza has unveiled its 2023 lineup, teasing some big acts. Headlining this year’s Chicago music festival are Billie Eilish, Kendrick Lamar, Red Hot Chili Peppers, ... Read more »

Fury vs Usyk talks break down, fight will not happen April 29

Talks for Tyson Fury vs Oleksandr Usyk have reportedly broken down Tyson Fury and Oleksandr Usyk will not be fighting, at least not on April 29, as talks have reportedly ... Read more »

Cameron Diaz's Comeback Film Halted As Cops Investigate Costar Jamie Foxx Being Targeted In Alleged Money-Grabbing Scheme

Mega Production on Cameron Diaz’s comeback film has reportedly come to a screeching halt after her costar Jamie Foxx was targeted in an alleged money-grabbing scheme, RadarOnline.com has learned. Mega ... Read more »

Why Men Fall Out Of Love (Hint: It Has Nothing To Do With Their Partners)

man and woman on date at night By Marisa Donnelly I wish love was perfect. I wish, when we fell for another person, everything just stayed the way it was ... Read more »

Insulin Price Cap Doesn't Apply to All Iowans Who Need It

Some 37.3 million Americans, or about one in 10 people, have diabetes. About one in five don’t know they have it, according to the Centers for Disease Control and Prevention. ... Read more »
Kênh kiến thức kỹ năng, phát triển bản thân, hướng nghiệp, blog nhân sự