Attempts to regulate AI’s hidden hand in Americans’ lives flounder in US statehouses

Amazon

Attempts to regulate AI’s hidden hand in Americans’ lives flounder in US statehouses

State lawmakers first attempts at regulating discrimination from artificial intelligence have floundered in states across the country

ByJESSE BEDAYN /REPORT FOR AMERICA Associated Press

May 23, 2024, 12:33 AM

    DENVER -- The first attempts to regulate artificial intelligence programs that play a hidden role in hiring, housing and medical decisions for millions of Americans are facing pressure from all sides and floundering in statehouses nationwide.

    Only one of seven bills aimed at preventing AI’s penchant to discriminate when making consequential decisions — including who gets hired, money for a home or medical care — has passed. Colorado Gov. Jared Polis hesitantly signed the bill on Friday.

    Colorado’s bill and those that faltered in Washington, Connecticut and elsewhere faced battles on many fronts, including between civil rights groups and the tech industry, and lawmakers wary of wading into a technology few yet understand and governors worried about being the odd-state-out and spooking AI startups.

    Polis signed Colorado’s bill “with reservations,” saying in an statement he was wary of regulations dousing AI innovation. The bill has a two-year runway and can be altered before it becomes law.

    “I encourage (lawmakers) to significantly improve on this before it takes effect,” Polis wrote.

    Colorado’s proposal, along with six sister bills, are complex, but will broadly require companies to assess the risk of discrimination from their AI and inform customers when AI was used to help make a consequential decision for them.

    The bills are separate from more than 400 AI-related bills that have been debated this year. Most are aimed at slices of AI, such as the use of deepfakes in elections or to make pornography.

    The seven bills are more ambitious, applying across major industries and targeting discrimination, one of the technology’s most perverse and complex problems.

    “We actually have no visibility into the algorithms that are used, whether they work or they don’t, or whether we’re discriminated against,” said Rumman Chowdhury, AI envoy for the U.S. Department of State who previously led Twitter’s AI ethics team.

    While anti-discrimination laws are already on the books, those who study AI discrimination say it’s a different beast, which the U.S. is already behind in regulating.

    “The computers are making biased decisions at scale,” said Christine Webber, a civil rights attorney who has worked on class action lawsuits over discrimination including against Boeing and Tyson Foods. Now, Webber is nearing final approval on one of the first-in-the-nation settlements in a class action over AI discrimination.

    “Not, I should say, that the old systems were perfectly free from bias either,” said Webber. But “any one person could only look at so many resumes in the day. So you could only make so many biased decisions in one day and the computer can do it rapidly across large numbers of people.”

    When you apply for a job, an apartment or a home loan, there’s a good chance AI is assessing your application: sending it up the line, assigning it a score or filtering it out. It’s estimated as many as 83% of employers use algorithms to help in hiring, according to the Equal Employment Opportunity Commission.

    AI itself doesn’t know what to look for in a job application, so it’s taught based on past resumes. The historical data that is used to train algorithms can smuggle in bias.

    Amazon, for example, worked on a hiring algorithm that was trained on old resumes: largely male applicants. When assessing new applicants, it downgraded resumes with the word “women’s” or that listed women’s colleges because they were not represented in the historical data — the resumes — it had learned from. The project was scuttled.

    Webber’s class action lawsuit alleges that an AI system that scores rental applications disproportionately assigned lower scores to Black or Hispanic applicants. A study found that an AI system built to assess medical needs passed over Black patients for special care.

    Studies and lawsuits have allowed a glimpse under the hood of AI systems, but most algorithms remain veiled. Americans are largely unaware that these tools are being used, polling from Pew Research shows. Companies generally aren’t required to explicitly disclose that an AI was used.

    “Just pulling back the curtain so that we can see who’s really doing the assessing and what tool is being used is a huge, huge first step,” said Webber. “The existing laws don’t work if we can’t get at least some basic information.”

    That’s what Colorado’s bill, along with another surviving bill in California, are trying to change. The bills, including a flagship proposal in Connecticut that was killed under opposition from the governor, are largely similar.

    Colorado’s bill will require companies using AI to help make consequential decisions for Americans to annually assess their AI for potential bias; implement an oversight program within the company; tell the state attorney general if discrimination was found; and inform to customers when an AI was used to help make a decision for them, including an option to appeal.

    Labor unions and academics fear that a reliance on companies overseeing themselves means it'll be hard to proactively address discrimination in an AI system before it's done damage. Companies are fearful that forced transparency could reveal trade secrets, including in potential litigation, in this hyper-competitive new field.

    AI companies also pushed for, and generally received, a provision that only allows the attorney general, not citizens, to file lawsuits under the new law. Enforcement details have been left up to the attorney general.

    While larger AI companies have more or less been on board with these proposals, a group of smaller Colorado-based AI companies said the requirements might be manageable by behemoth AI companies, but not by budding startups.

    “We are in a brand new era of primordial soup,” said Logan Cerkovnik, founder of Thumper.ai, referring to the field of AI. “Having overly restrictive legislation that forces us into definitions and restricts our use of technology while this is forming is just going to be detrimental to innovation.”

    All agreed, along with many AI companies, that what’s formally called “algorithmic discrimination” is critical to tackle. But they said the bill as written falls short of that goal. Instead, they proposed beefing up existing anti-discrimination laws.

    Chowdhury worries that lawsuits are too costly and time consuming to be an effective enforcement tool, and laws should instead go beyond what even Colorado is proposing. Instead, Chowdhury and academics have proposed accredited, independent organization that can explicitly test for potential bias in an AI algorithm.

    “You can understand and deal with a single person who is discriminatory or biased,” said Chowdhury. “What do we do when it’s embedded into the entire institution?”

    ___

    Bedayn is a corps member for the Associated Press/Report for America Statehouse News Initiative. Report for America is a nonprofit national service program that places journalists in local newsrooms to report on undercovered issues.

    OTHER NEWS

    22 minutes ago

    After Maharashtra setback, how BJP is planning to regroup, bridge gap with MVA

    22 minutes ago

    Insiders predict Rust Belt Republican, possible Trump VP pick, could flip Biden votes in key swing states

    22 minutes ago

    For Ukrainians in Canada, new conscription rules increase pressure to fight

    22 minutes ago

    ‘Wear a helmet’: Gordon Ramsay shows off full torso bruise after bike accident

    22 minutes ago

    Putin's nuclear submarine detected off UK coast

    22 minutes ago

    Trump challenges Biden to take cognitive test - only to get name of his own doctor wrong

    22 minutes ago

    T20 World Cup: England qualify for Super 8s after rain and Australia fumbles make for nervous group finale

    22 minutes ago

    How to reverse austerity? Scrap some of the tax-relief schemes worth £204bn

    22 minutes ago

    Italy's swift response secures victory after record breaking Albania start

    22 minutes ago

    NRL Highlights: Knights v Panthers - Round 15

    22 minutes ago

    Down 50%, this FTSE dividend stock looks like a steal to me

    22 minutes ago

    Australia's record population surge is being driven by Indian migration: Here's why so many of them are moving here - and what they really think about life Down Under

    22 minutes ago

    Video: Terrifying moment 7ft shark swims at speed towards Gran Canaria shore - with beach forced to close to bathing after sparking fear among tourists and locals

    22 minutes ago

    Video: Former MI6 agent rates the best and worst spy devices available on Amazon including a lie detector test and rearview sunglasses - and reveals why crisps are the 'best intruder detection system ever invented'

    25 minutes ago

    ‘Dangerous conditions’: Damaging surf warnings in place for parts of the east coast

    27 minutes ago

    Tories and Labour clash on tax as General Election battles intensify

    27 minutes ago

    The Andy Griffith Show's Ron Howard Reveals Jokes Killed by Andy Griffith

    27 minutes ago

    Mbappé wants to erase bad memory of decisive penalty miss and leave Euro 2024 as a champion

    27 minutes ago

    Gig for Gaza event in Canberra raises funds for Australian doctors working in Palestine

    27 minutes ago

    Scientists sound alarm after making disturbing discovery in the Amazon: 'We have all this information; now let's act on it'

    27 minutes ago

    Luai stars as Panthers survive Knights scare

    27 minutes ago

    Serbia XI vs England: Predicted lineup, confirmed Euro 2024 team news and injuries today

    27 minutes ago

    Transit expert highlights issues with popular design trend in truck and SUV models: 'It honestly infuriates me'

    27 minutes ago

    Revealed: The ultimate dad jokes this Father's Day, according to AI - so, would they make you laugh?

    27 minutes ago

    UK's 'tallest rollercoaster' Hyperia at Thorpe Park 'breaks down' - with thrill-seekers stuck on ride at 236ft for an HOUR just days after reopening

    27 minutes ago

    Hundreds of Majorcans take over tiny picture postcard cove made famous by Instagram 'influencers' and unfurl banners reading 'SOS Residents' amid Spanish island's anti-tourism backlash against UK holidaymakers

    27 minutes ago

    Woman claims she was fined £200 for littering after seagulls ate a few McDonald's chips she accidentally dropped on the floor

    27 minutes ago

    Can I take legal action if I buy a house with invasive bamboo? And do I need to tell buyers if my home's infested? MailOnline answers your questions about 'Japanese knotweed 2.0'

    27 minutes ago

    Gordon Ramsay is flooded with well wishes from daughter Holly and celebrity pals after chef suffered a horrific cycling accident

    30 minutes ago

    Harry Kane says England start Euro 2024 with ‘the most in-form squad we’ve had’

    30 minutes ago

    How the Euros could change the result of the election

    32 minutes ago

    Sheffield DocFest Confronts Challenges Facing Nonfiction Film Industry, In Midst Of Turbulent Political, Economic Environment

    32 minutes ago

    When you can hear every word, thank the sound mixers

    32 minutes ago

    U.S. Open Complaints Grow After Paywall Frustrations: 'Atrocious' Sound & Graphics Issues Anger Golf World

    32 minutes ago

    Zain Davids, Shilton van Wyk bolster Blitzboks in last-ditch bid for Paris Olympics

    33 minutes ago

    Star Wars Outlaws: Ubisoft reveals details and gameplay of anticipated game

    33 minutes ago

    New poll suggests less than half of Americans plan to buy an EV for their next vehicle — here’s why

    33 minutes ago

    ATP Halle draw: Jannik Sinner finds out first opponent as world No 1 as he lands tricky draw

    33 minutes ago

    Corey Heim notches best Xfinity Series finish at Iowa Speedway

    33 minutes ago

    Biden, Trump step up outreach to Black men