But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.
A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.
The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.
That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.
This story is from the November 01, 2024 edition of AppleMagazine.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the November 01, 2024 edition of AppleMagazine.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
BANNING CELLPHONES IN SCHOOLS GAINS POPULARITY IN RED AND BLUE STATES
Arkansas’ Republican Gov. Sarah Huckabee Sanders and California's Democratic Gov. Gavin Newsom have little in common ideologically, but the two have both been vocal supporters of an idea that’s been rapidly gaining bipartisan ground in the states: Students’ cellphones need to be banned during the school day.
HOW TIKTOK GREW FROM A FUN APP FOR TEENS INTO A POTENTIAL NATIONAL SECURITY THREAT
If it feels like TikTok has been around forever, that's probably because it has, at least if you're measuring via internet time. What's now in question is whether it will be around much longer and, if so, in what form?
TRUMP, A POPULIST PRESIDENT, IS FLANKED BY TECH BILLIONAIRES AT HIS INAUGURATION
Some of the most exclusive seats at President Donald Trump's inauguration on Monday were reserved for powerful tech CEOs who also happen to be among the world's richest men.
TRUMP RESCINDS BIDEN'S EXECUTIVE ORDER ON AI SAFETY IN ATTEMPT TO DIVERGE FROM HIS PREDECESSOR
Hours after returning to the White House, President Donald Trump made a symbolic mark on the future of artificial intelligence by repealing former President Joe Biden's guardrails for the fast-developing technology.But what comes next from Trump and how it will diverge from how his predecessor sought to safeguard Al technology remains unclear. The new administration didn't respond to requests for comment about the repealed Biden policy and even some of Trump's most enthusiastic tech industry supporters aren't so sure.
WHAT'S NEXT FOR EVS UNDER PRESIDENT TRUMP?
President Donald Trump signed an executive order promising to eliminate what he incorrectly labels “the electric vehicle mandate” imposed under former President Joe Biden. His order on Monday is consistent with pledges Trump made on the campaign trail to end what he calls a “preposterous” focus on EVs by Biden and other Democrats.
'ONCE IN A LIFETIME' SNOW HITS PARTS OF THE U.S. SOUTH
A winter storm sweeping through the U.S. South on Tuesday was dumping snow at levels millions of residents haven't seen before.
GOVERNOR PROPOSES BANNING CELLPHONES IN SCHOOLS THROUGHOUT NEW YORK STATE STARTING NEXT FALL
Students throughout New York state might have to give up their cellphones during school hours starting next fall under a proposal announced Tuesday by Gov. Kathy Hochul.
NETFLIX'S BET ON LIVE EVENTS HELPED REEL IN 19 MILLION MORE SUBSCRIBERS IN HOLIDAY-SEASON QUARTER US
Netflix added nearly 19 million subscribers during the holiday-season quarter to help propel its earnings beyond analysts’ projections, capping the video streaming service’s best year yet in a sign that its expansion into live programming is paying off.
AI EXPERIMENT IN HALFPIPE JUDGING AT X GAMES WILL GIVE SNOWBOARDERS A GLIMPSE INTO THE FUTURE
The X Games will experiment judging halfpipe runs this week in Aspen using artificial intelligence, the cutting-edge technology that could someday play a role in the way subjectively judged sports are scored.
YOUR MONEY: 5 IDEAS FOR AVOIDING AN OVEREMPHASIS ON SHORT-TERM RESULTS
Recency bias is the tendency to place too much weight on the latest performance trends while giving short shrift to other factors, such as fundamentals, valuation, or long-term market averages.Market news, by definition, focuses on recent events rather than long-term trends. As a result, recent events are top of mind, easier to remember, and often play an outsize role in investment decision-making.But there are steps investors can take to guard against these tendencies:
