That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-yearold intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
This story is from the March 29, 2024 edition of AppleMagazine.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the March 29, 2024 edition of AppleMagazine.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
AUSTRALIA SHOULD DELAY SOCIAL MEDIA BAN FOR CHILDREN UNDER 16, BIG TECH SAYS
An advocate for major social media platforms told an Australian Senate committee that laws to ban children younger than 16 from the sites should be delayed until next year at least instead of being rushed through the Parliament.
APPLE AND GOOGLE FACE UK INVESTIGATION INTO MOBILE BROWSER DOMINANCE
Apple and Google aren’t giving consumers a genuine choice of mobile web browsers, a British watchdog said in a report that recommends they face an investigation under new U.K. digital rules taking effect next year.
THE PSYCHOLOGY OF RETIREMENT INCOME: FROM SAVING TO SPENDING
The narrative of a miserly, Scrooge-like figure hoarding his wealth for years instead of enjoying his retirement might seem unbelievable—but unfortunately, it isn’t relegated only to fiction. It’s a cold reality for many retirees.
'BUY NOW, PAY LATER' IS MORE POPULAR THAN EVER. IT CAN COST MORE THAN YOU THINK
More shoppers than ever are on track to use ‘buy now, pay later’ plans this holiday season, as the ability to spread out payments looks attractive at a time when Americans still feel the lingering effect of inflation and already have record-high credit card debt.
DIRECTV CALLS OFF ACQUISITION OF RIVAL DISH.POSSIBLY ENDING A YEARSLONG PURSUIT
DirecTV is calling off its planned acquisition of rival Dish after the offer was rejected by bond holders at that company.
IS 'GLICKED' THE NEW 'BARBENHEIMER'? 'WICKED' AND 'GLADIATOR II' COLLIDE IN THEATERS
“Barbenheimer” was a phenomenon impossible to manufacture. But, more than a year later, that hasn’t stopped people from trying to make “Glicked” — or even “Babyratu” — happen.
WHAT YOU NEED TO KNOW ABOUT THE PROPOSED MEASURES DESIGNED TO CURB GOOGLE'S SEARCH MONOPOLY
U.S. regulators are proposing aggressive measures to restore competition to the online search market after a federal judge ruled Google maintained an illegal monopoly for the last decade.
ELECTRIC CAR SALES ARE SLOWING IN THE US AND EUROPE AS BOTH FANS AND SKEPTICS SHARE CONCERNS
While sales of electric vehicles surge in China, adoption of more environmentally friendly vehicles is stumbling in the United States and Europe as carmakers and governments struggle to meet years-old promises about affordability and charging stations.
IT'S ALMOST TIME FOR SPOTIFY WRAPPED.WHEN CAN YOU EXPECT YOUR 2024 RECAP?
It’s almost that time of year: Spotify is gearing up to release its annual Wrapped, personalized recaps of users’ listening habits and year in audio.
RANSOMWARE ATTACK ON SOFTWARE SUPPLIER DISRUPTS OPERATIONS FOR STARBUCKS AND OTHER RETAILERS
A ransomware attack that hit a major software provider last week caused disruptions for a handful of companies over recent days, from Starbucks to U.K. grocery giant Morrisons.
