Archives for November 2026

Is AI developing a secret, unreadable language beyond human comprehension? In this episode, we unpack the origins, popular myths, and technical realities surrounding “neuralese”—the continuous vector communications and latent reasoning spaces used by neural networks.

Starting with its humble academic origin in a 2017 paper on inter-agent vector exchange, we examine how the concept evolved into viral internet panic. We systematically deconstruct viral “secret AI language” headlines—from Google’s zero-shot translation interlingua and Facebook’s negotiation bots to Gibberlink and Fable 5 rumor chains—showing that every incident stems from mundane causes like reward hacking, tokenization noise, or human-designed protocols. #embeddedAI #podcast

In this episode we explore why frontier large language models frequently prioritize popular consensus and plausible-sounding explanations over objective truth. Built primarily on massive web crawls—where high-authority sources like encyclopedias, patents, and peer-reviewed journals represent only 2% to 5% of training data—today’s models are trained to mirror popular web content and conversational style rather than verify factual accuracy.

We break down the underlying mechanics and economics driving this phenomenon. From next-token prediction training that rewards the most frequent continuation to preference tuning that incentivizes sycophancy and user agreement, AI training naturally converges on the modal answer. Meanwhile, human verification remains priced in costly expert hours ($50–$150/hr), creating a staggering 500,000-to-1 economic gap against exponentially cheaper model text generation. 

Finally, we examine where AI does succeed—such as verifiable domains like code, mathematics, and supplied contexts—and draw insights from evolutionary biology on why real truth is expensive and requires active inspection. #embeddedAI #podcast