Chronological feed of everything captured from Dwarkesh Patel.
paper / dwarkesh / Jun 14
Evoflux demonstrates that inference-time evolutionary search over executable tool workflows outperforms supervised fine-tuning (SFT) and DPO for compact language model agents when teacher trace budgets are scarce. Rather than distilling recovery behavior from few hundred traces—which rarely covers the repair space needed for failed plans over changing tool catalogs—Evoflux evolves typed workflow graphs through structured edits, execution feedback, and diversity pruning. On MCP-Bench with 250 tools across live servers, it raises execution feasibility from ~3% to 17-24% for small planners, while SFT and DPO match, underperform, or collapse below zero-shot performance, and ReAct achieves higher peaks at higher variance and token cost.
ai-agentstool-useinference-optimizationworkflow-evolutioncompact-modelsmcpai-research
“Inference-time evolutionary search for tool workflow repair outperforms distillation (SFT and SFT+DPO) under scarce teacher-trace budgets for compact LMs.”
paper / dwarkesh / Jun 9
Standard indirect prompt injection (IPI) attacks succeed roughly one-third of the time against frontier models. VATS introduces a systematic mutation framework that evolves adversarial payloads across seven structural and linguistic dimensions, targeting the error-handling loop newly exposed by the Model Context Protocol (MCP). The core finding is that tool error messages carry implicit authority — models enter a corrective reasoning mode when processing errors, which bypasses standard safety heuristics. Sandwiching adversarial instructions within error context triples IPI success rates, achieving up to 100% compliance in controlled evaluations across Gemini 3.1 Pro, GPT-5.5, GLM-5.1, and Qwen3-Coder.
ai-securityllm-vulnerabilitiesprompt-injectionautonomous-agentserror-handlingmutation-testing
“Error-path injection triples the success rate of standard indirect prompt injection (IPI).”
paper / dwarkesh / Jun 9
LogNEO is a log anomaly detection system that leverages a 1.3B parameter GPT-Neo model fine-tuned using Proximal Policy Optimisation (PPO) with a novel reward scheme. This scheme incorporates partial credit and exponential decay, with a position-aware component to manage prediction difficulty. The system achieves state-of-the-art results on multiple benchmarks, including improved recall over LogGPT, and offers low-latency, high-throughput performance in a production microservice deployment.
ai-detectionlog-analysistime-series-forecastinganomaly-detectiondeep-learningreinforcement-learning
“LogNEO, a novel log anomaly detection framework, utilizes GPT-Neo (1.3B parameters) for accurate real-time detection.”
paper / dwarkesh / Jun 9
This work presents a risk-aware control strategy for nonlinear systems, overcoming the limitations of traditional methods by incorporating a more nuanced understanding of uncertainty. The proposed approach utilizes an analytical, suboptimal controller tailored for systems with cone-bounded nonlinearities, addressing a gap in existing control methodologies. Numerical examples underscore the advantages of this novel characterization for managing risk in nonlinear control systems.
risk-aware-controlnonlinear-systemscontrol-theoryoptimization-controlsystems-control
“A new method for risk-aware control of nonlinear systems is proposed, addressing the limitations of classical control methods that simplify uncertainty to average or worst-case scenarios.”
paper / dwarkesh / Jun 9
This research empirically compares LLM-generated and human-written unit tests for fault detection on real Python bugs. LLM-generated tests, augmented with retrieval-based bug context, demonstrate significantly higher fault detection rates (69%) than general human-written tests (17.2%), while achieving comparable code coverage. This suggests that retrieval context is critical for LLM effectiveness and that code coverage alone is an insufficient metric for evaluating test quality.
llm-testingautomated-testingfault-detectionsoftware-engineeringai-evalsunit-testsretrieval-augmented-generation
“LLM-generated unit tests with retrieval-augmented context outperform general-purpose human-written tests in fault detection.”
paper / dwarkesh / Jun 5 / failed
paper / dwarkesh / Jun 5 / failed
paper / dwarkesh / Jun 3 / failed
paper / dwarkesh / Jun 3 / failed
paper / dwarkesh / Jun 3 / failed
paper / dwarkesh / May 29 / failed
paper / dwarkesh / May 29 / failed
paper / dwarkesh / May 26 / failed
paper / dwarkesh / May 26 / failed
paper / dwarkesh / May 26 / failed
paper / dwarkesh / May 26 / failed
paper / dwarkesh / May 21 / failed
paper / dwarkesh / May 21 / failed
paper / dwarkesh / May 19 / failed
paper / dwarkesh / May 15 / failed
paper / dwarkesh / May 15 / failed
paper / dwarkesh / May 15 / failed
paper / dwarkesh / May 15 / failed
paper / dwarkesh / May 6 / failed
paper / dwarkesh / May 6 / failed
paper / dwarkesh / May 6 / failed
paper / dwarkesh / May 6 / failed
paper / dwarkesh / May 3 / failed
paper / dwarkesh / May 3 / failed
paper / dwarkesh / May 3 / failed
youtube / dwarkesh / May 2 / failed
paper / dwarkesh / Apr 27
LHCb reports the first measurement of forward-backward asymmetry A_FB and flat term F_H in the angular distribution of B+ → π+ μ+ μ- decays using 9 fb^{-1} of pp collision data from 2011-2018. Measurements are performed in two q^2 intervals: one below and one above the J/ψ and ψ(2S) charmonium resonances. SM predictions fall within the 68% CL interval in the high-q^2 region and 99% CL in the low-q^2 region.
lhcb-collaborationb-meson-decayangular-analysisforward-backward-asymmetrydimuon-decayparticle-physics-experiment
“This is the first measurement of A_FB and F_H for B+ → π+ μ+ μ- decay.”
paper / dwarkesh / Apr 27
Memanto introduces a typed semantic memory layer for long-horizon agents using 13 predefined categories, automated conflict resolution, and temporal versioning, powered by Moorcheh's information-theoretic search engine for sub-90ms deterministic retrieval without indexing or ingestion delays. It outperforms hybrid graph and vector systems on LongMemEval (89.8%) and LoCoMoMo (87.1%) benchmarks using single-query retrieval and lower complexity. A five-stage ablation validates each component's impact, enabling scalable agentic deployments.
semantic-memoryagentic-aiinformation-theoretic-retrievallong-horizon-agentsmemory-systemsno-indexing-database
“Memanto achieves 89.8% accuracy on LongMemEval”
paper / dwarkesh / Apr 27
This study evaluates open-source image simulation tools for generating synthetic lunar images using real DEM and terrain data from Chandrayaan-2 OHRC and NASA WAC/NAC instruments. It focuses on the impact of camera models and illumination conditions on image quality to support planetary mission planning, hazard detection, and navigation validation. The work aims to enhance reliability of synthetic imagery for autonomous systems in lunar exploration.
image-simulationsynthetic-imageslunar-environmentcomputer-visionplanetary-missionsdem-terraincamera-models
“Synthetic image generation is crucial for planetary missions to visualize missions, test imaging systems, and plan exploration in virtual environments”
paper / dwarkesh / Apr 26
A graph-theoretic approach maps fermion mass terms in latticized theory-space models to bipartite graphs, with fields as vertices and mass terms as edges. The number of massless fermion modes equals the cardinality of the graph's maximum matching. Wave-function support of these modes is confined to fields reachable via even-length maximum-matching-alternating paths from unmatched vertices, per Dulmage-Mendelsohn decomposition. Results rely solely on theory-space topology, enabling parameter-independent model design with specified massless mode counts and localizations.
graph-theorybipartite-graphsfermion-mass-spectralatticized-theory-spacedimensional-deconstructionmassless-modeshep-ph
“The number of massless fermion modes equals the cardinality of the maximum matching in the associated bipartite graph.”
paper / dwarkesh / Apr 26
Researchers identified 86 platforms hosting scientific posters, but only 43 allow counting, revealing just 150k posters shared as of 2024—a low volume relative to scholarly output. Platforms like Zenodo and Figshare often lack structured metadata support for discovery (e.g., conference details), and researchers rarely provide it when available. While posters garner views and downloads, citations are uncommon, hindering FAIR compliance and reuse; guidelines are recommended to promote sharing.
scientific-postersfair-principlesdigital-librariesscholarly-communicationmetadataposter-reusearxiv-paper
“86 platforms host scientific posters.”
paper / dwarkesh / Apr 26
DigitsOnTurbo (DoT) overcomes SIMD adoption barriers in large-number arithmetic by restructuring computations into independent data-parallel operations, bypassing dependencies in conventional algorithms. It delivers 1.85x speedups for addition/subtraction and 2.3x for multiplication versus prior SIMD methods. Library integration yields up to 4x gains for add/sub, 2x for multiplication, boosting scientific throughput by 19.3% and cryptographic latency/throughput by 7.9%/5.9%.
simd-optimizationlarge-number-arithmeticparallel-computingcpu-accelerationcryptography-performancescientific-computinghardware-architecture
“DoT achieves up to 1.85x speedups for addition and subtraction over prior SIMD implementations”
youtube / dwarkesh / Apr 23 / failed
youtube / dwarkesh / Apr 15 / failed
youtube / dwarkesh / Apr 12 / failed
youtube / dwarkesh / Apr 10
Current AI development, heavily reliant on pre-training and supervised learning with extensive human input, struggles with genuine on-the-job learning and generalization. The economic impact remains limited because models lack the continuous, self-directed learning capabilities inherent in human intelligence, which is crucial for navigating real-world complexities and diverse job requirements. Achieving true AGI necessitates a breakthrough in continual learning, allowing AI to acquire and adapt skills efficiently across various and evolving contexts.
agi-timelinesllm-capabilitiescontinual-learningai-diffusionai-economicsmodel-competitionreinforcement-learning
“The current approach of scaling reinforcement learning on top of LLMs with extensive pre-baking of skills is fundamentally flawed if AGI is imminent.”
youtube / dwarkesh / Apr 10
This content explores how the brain's learning and steering subsystems operate, hypothesizing that evolution hardwired specific, complex loss functions into the steering subsystem to guide learning in the cortex. It contrasts this with current LLMs, which primarily use simple next-token prediction, and introduces the concept of omnidirectional inference as a more generalized learning capability present in the brain. The discussion also touches on the potential for AI to leverage similar architectural and algorithmic principles for more advanced and sample-efficient learning.
neuroscience-researchai-capabilitiesbrain-computer-interfacesmachine-learning-algorithmsai-safetyformal-verificationscientific-funding
“The brain's learning efficacy stems from evolutionarily developed, varied loss functions within the 'Steering Subsystem.'”
youtube / dwarkesh / Apr 10 / failed
youtube / dwarkesh / Apr 10
The Renaissance period, particularly in Italy, witnessed a profound transformation in intellectual thought and societal structures, moving from an initial phase of seeking to restore Roman virtues to a more critical and empirical approach to knowledge. This evolution, spurred by figures like Petrarch and Machiavelli, coupled with the advent of the printing press and the changing political landscape of city-states like Florence, ultimately created a fertile environment for the Scientific Revolution. The persistent, though often self-serving, drive for knowledge and its dissemination, along with unintended consequences of technological and political shifts, were key catalysts.
renaissance-historyprinting-presscensorshipflorencemachiavelliscientific-revolutionintellectual-history
“The Italian city-republics, like Venice and Florence, emerged as self-governing entities after the dissolution of the Roman Empire due to the necessity of self-sustainment and the availability of rich agricultural land.”
youtube / dwarkesh / Apr 10
The US Department of Defense
ai-ethicsgovernment-regulationai-policynational-securitymass-surveillanceanthropicdual-use-ai
“The US Department of War (DoD) is exerting undue pressure on AI companies like Anthropic, threatening their business for refusing to comply with requests for AI use in mass surveillance and autonomous weapons.”
youtube / dwarkesh / Apr 10
The scalability of AI compute faces significant bottlenecks, shifting from power and data centers to semiconductor manufacturing, specifically EUV tools and memory. The lead times for building new fabs and the specialized nature of ASML's supply chain limit rapid expansion. This scarcity drives up memory prices and reshapes investment strategies in the tech industry, favoring early commitment to compute and larger models.
ai-infrastructuresemiconductorscompute-allocationgpu-supply-chainai-market-dynamicsdata-center-expansionai-power-consumption
“The primary bottleneck for scaling AI compute will shift to the semiconductor supply chain, specifically EUV tools and memory, by the end of the decade.”
youtube / dwarkesh / Apr 10
AI is fundamentally reshaping the scientific method by lowering the cost of idea generation, shifting the bottleneck from hypothesis formulation to rigorous verification and validation. This enables a vast exploration of potential solutions ("breadth") in contrast to traditional human-driven "depth." While current AI excels at automating established techniques and identifying "low-hanging fruit" in problem-solving, its true impact lies in complementing human ingenuity by rapidly mapping out new fields and providing data-driven insights, necessitating a re-evaluation of scientific workflows and the very definition of progress.
ai-for-sciencemathematicsscientific-methodai-researchhuman-ai-collaborationformal-verification
“AI significantly reduces the cost of idea generation in scientific research.”
youtube / dwarkesh / Apr 10
Scientific progress transcends simplistic verification loops and falsification, evident in historical scientific revolutions. Major shifts, like the adoption of special relativity over Lorentz's ether theory, often predate definitive experimental proof, reflecting a complex interplay of aesthetic preferences, theoretical parsimony, and the gradual accumulation of varied evidence. Consequently, the advancement of science requires fostering diverse research programs and accepting that fundamental breakthroughs may not always emerge from direct, linear problem-solving approaches.
science-of-scienceepistemologyscientific-progressai-impact-on-sciencephysics-historyquantum-computinghistory-of-science
“The Michelson-Morley experiment, contrary to popular belief, did not definitively disprove the existence of the ether for many contemporary scientists, including Michelson himself.”