Exclusive: Multiple AI companies bypassing web standard to scrape publisher sites, licensing firm says
Media Industry,Artificial Intelligence,AI,Journalism,Technology,News
From the Center
AllSides Media Bias Rating: Center
June 21 (Reuters) - Multiple artificial intelligence companies are circumventing a common web standard used by publishers to block the scraping of their content for use in generative AI systems, content licensing startup TollBit has told publishers.
A letter to publishers seen by Reuters on Friday, which does not name the AI companies or the publishers affected, comes amid a public dispute between AI search startup Perplexity and media outlet Forbes involving the same web standard and a broader debate between tech and media firms over the value of content in the age of generative AI.
Check for Bias
The AI-powered AllSides Bias Checker instantly reveals the bias of a news article. Tap the button to use.
Related Coverage
AllSides Picks
News
Mass Kidnappings, Covid Contingencies, ICE Controversies: Stories You May Have Missed
Malayna J. Bizier
June 18th, 2026