OpenAI to Honor Shared Robots.txt Signal for AI Training Preferences
· unite.ai · popularity 21/100 · 0 similar stories today · AI & Data Science (Artificial Intelligence)
Read the original at unite.ai →
Summary
OpenAI announced on October 30, 2026 that it will honor a shared signal in robots.txt, the file websites use to express preferences about how their content is used, so that site operators can communicate a single AI training preference to multiple participating providers at once. A Voluntary Signal Shared Across Providers In its announcement, OpenAI described the effort as voluntary and said it addresses an existing burden: until now, website operators had to identify individual crawlers and…
Found in: Unite.AI. Rating basis: single outlet; outlet tier 2 (unlisted); 1 feeds; feed position 1.