Some news publishers say the AI-generated summaries that now top many Google search results are resulting in less people actually reading the news — and experts are still flagging concerns about the summaries’ accuracy.
When Google rolled out its AI Overview feature last year, its mistakes — including one suggestion to use glue to make pizza toppings stick better — made headlines. One expert warns concerns about the accuracy of the feature’s output won’t necessarily go away as the technology improves.
“It’s one of those very sweeping technological changes that has changed the way we … search, and therefore live our lives, without really much of a big public discussion,” said Jessica Johnson, a senior fellow at McGill University’s Centre for Media, Technology and Democracy.
“As a journalist and as a researcher, I have concerns about the accuracy.”
While users have flagged mistakes in the AI-powered summaries, there is no academic research yet defining the extent of the problem. A report released by the BBC earlier this year examining AI chatbots from Google, Microsoft, OpenAI and Perplexity found “significant inaccuracies” in their summaries of news stories, although it didn’t look at Google AI Overviews specifically.
In small font at the bottom of its AI summaries, Google warns users that “AI responses may include mistakes.”
The company maintains the accuracy of the AI summaries is on par with other search features, like those that provide featured snippets, and said in a statement that it’s continuing to “make improvements to both the helpfulness and quality of responses.”
Leon Mar, director of media relations and issue management at CBC, said the public broadcaster “has not seen a significant change in search referral traffic to its news services’ digital properties that can be attributed to AI summaries.”
But he warned that users should be “mindful” of the varying accuracy of these summaries.
AI has ‘fundamental problem’
Chirag Shah, a professor at the University of Washington’s information school specializing in AI and online search, said the error rate is due to how AI systems work.
Generative AI can’t think or understand concepts the way people do. Instead, it makes predictions based on massive amounts of training data. Shah said that “no checking” takes place after the systems retrieve the information from documents and before results are generated.
“What if those documents are flawed?” he said. “What if some of them have wrong information, outdated information, satire, sarcasm?”
A human being would know that someone who suggests adding glue to a pizza is telling a joke, Shah said. But an artificial intelligence system would not.
It’s a “fundamental problem” that can’t be solved by “more computation and more data and more time,” he said.
AI changing how we search
As Google integrates AI into its popular search function, other AI companies’ generative AI systems, such as OpenAI’s ChatGPT, are increasingly being used as search engines themselves, despite their flaws.
Search engines were originally designed to help users find their way around the internet, Shah said. Now, the goal of those who design online platforms and services is to get the user to stay in the same system.
“If that gets consolidated, that’s essentially the end of the free web,” he said. “I think this is a fundamental and a very significant shift in the way not just search but the web, the internet, operates. And that should concern us all.”
OpenAI and other big tech companies are starting to roll out the next wave of artificial intelligence, designed to operate with more autonomy. CBC’s Nora Young breaks down how agentic AI works and why some think it will change how you use the internet.
A study by the Pew Research Center from earlier this year found users were less likely to click on a link when their search resulted in an AI summary. While users clicked on a link 15 per cent of the time in response to a traditional search result, they only clicked on a link eight per cent of the time if an AI summary was included.
That’s cause for alarm for news publishers, both in Canada and abroad.
“Zero clicks is zero revenue for the publisher,” said Paul Deegan, CEO of News Media Canada, which represents Canadian news publishers.
Last month, a group of independent publishers submitted a complaint to the U.K.’s Competition and Markets Authority saying that AI overviews are causing them significant harm.
Alfred Hermida, a professor at the University of British Columbia’s journalism school, said Google used to be a major source of traffic for news outlets by providing users with a list of news articles relevant to their search queries to click on.
But Hermida said, “when you have most people who are casual news consumers, that AI summary may be enough.”
Keldon Bester, executive director of the Canadian Anti-Monopoly Project, said there is a competition issue at play and there could “potentially” be a case under Canadian law.
Front BurnerThe internet sucks now, and it happened on purpose
It’s not you — the internet really does suck. Novelist, blogger and noted internet commentator Cory Doctorow explains what happened to the internet and why you’re tormented by ads, bots, algorithms, AI slop and so many pop-ups. Spoiler alert: it wasn’t an accident.
In Understood: Who Broke the Internet, Doctorow gets into the decisions made by powerful people that got us here, and most importantly, how we fix it. More episodes of Who Broke the Internet are available at: https://link.mgln.ai/DkvHgc [https://link.mgln.ai/DkvHgc]
He noted Google has been hit with competition cases in the past, including one that saw the company lose an antitrust suit brought forward by the U.S. Department of Justice over its dominance in search.
In a post last week, Google’s head of search, Liz Reid, said “organic click volume” from searches to websites has been “relatively stable year-over-year,” and claimed this contradicts “third-party reports that inaccurately suggest dramatic declines in aggregate traffic — often based on flawed methodologies, isolated examples, or traffic changes that occurred prior to the roll out of AI features in Search.”
‘One-two punch’
Clifton van der Linden, an associate professor and director of the Digital Society Lab at McMaster University in Hamilton, noted that if users bypass a link to a news site due to an AI-generated summary, that “compounds an existing problem” in Canadian media, which is dealing with a ban on news links on Facebook and Instagram.
The Liberal government under Justin Trudeau passed the Online News Act in 2023 to require Meta and Google to compensate news publishers for the use of their content. In response, Meta blocked news content from its platforms in Canada, while Google has started making payments under the legislation.
The future of that legislation seems uncertain. Prime Minister Mark Carney indicated last week he is open to repealing it.
Between Meta pulling news links and the emergence of AI search engines, Johnson says Canadian media has experienced a “one-two punch.”
“The point is, and other publishers have raised this, what’s the point of me producing this work if no one’s going to pay for it, and they might not even see it?”