Google joins OpenAI and Anthropic in promising new scraping controls
Engadget ·
Summary: Google, OpenAI, Anthropic and Microsoft pledge to support a new common signal for robots.txt that blocks scraping for AI training.
Read the full story on EngadgetExplore more: Today in AI · Research papers · AI tools · Learn AI
Related stories
- Wix · 19 Dec 2026 · updateHow to start a personal blog in 7 steps, plus real examples
A guide to starting a personal blog, plus beautiful examples to inspire your own.
- Wired AI · 31 Oct 2026Spooky New Infostealer Malware Uses AI to ‘Autodox’ Victims
Named “Volta-Autodoxer,” the recently uncovered malware uses AI tools to collect troves of data about victims, from login credentials and credit card numbers to Discord sessions and UberEats receipts.
- Unite.AI · 31 Oct 2026What Is Flow Matching? A Faster Path for Generative AI
Flow matching trains a continuous velocity field that transports samples from a simple distribution to a data distribution along defined probability paths. This guide explains the mechanism, trade-offs, evaluation, and controls that matter in practice.
- Fortune · 31 Oct 2026Our AI agent experience: we scrapped $60,000 marketing jobs and hired one person for far more
- BigGo Finance · 31 Oct 2026Figure AI Sets Course for Next Leg: Figure 04 Design Frozen, $3.5 Billion Compute Bet on a "Robot Version of the Scaling Law"
- Unite.AI · 31 Oct 2026Google Plans Support for Shared Robots.txt AI Training Control
Google announced on October 30, 2026 that it plans to support a shared AI training control in robots.txt, giving website owners a single way to express training preferences across multiple AI providers. The commitment arrived alongside same-day announcements from Microsoft and Op
Where is this story from?
This is a summary of a story first published by Engadget on 31 Oct 2026. Read the full article at the source link.
How does Deekoya AI choose news?
We track approved, reputable sources daily and link every item to its original publisher.