Skip to content

AI Digest for

This page is the archived edition of one specific day. It does not change any more.

Weekly recap: News

6 Jul to 12 Jul 2026 124 articles

AI Models and Provider Updates

  • OpenAI launched GPT-⁠5.6 in three tiers: Sol (flagship, complex reasoning), Terra (balanced coding), and Luna (cost-⁠efficient), with a 1M-⁠token context, a new reasoning-⁠effort slider, and an "ultra" mode coordinating parallel agents; it is now the preferred model in Microsoft 365 Copilot and GitHub Codex, though the 36 API variants caused user confusion [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12].
  • OpenAI introduced GPT-⁠Live, a full-⁠duplex voice model for natural conversation in ChatGPT Voice that offloads complex tasks to frontier models in the background [13, 14, 15, 16].
  • Claude Fable 5 remains available on all paid plans through July 19 with 50% higher Claude Code rate limits; it is the first model Cognition trusts to run overnight inside Devin, and it produced the first genuine megakernel on KernelBench-⁠Mega (18.71X speedup) [17, 18, 19, 20, 21, 22, 23].
  • Anthropic revealed J-⁠space, hidden internal neural patterns in Claude enabling deliberate reasoning and thought monitoring, and proposed GRAM (Gradient-⁠Routed Auxiliary Modules) for removable dual-⁠use knowledge compartments [24, 25, 26].
  • SpaceXAI/Cursor released Grok 4.5, an Opus-⁠class MoE model trained on trillions of Cursor tokens, priced at $2/$6 per 1M tokens, targeting long-⁠running tool-⁠using tasks [27, 28, 29, 30].
  • Meta launched Muse Image and Muse Spark 1.1, multimodal reasoning and media-⁠generation models with tool invocation and self-⁠refinement, available via a new public Model API and integrated across Meta AI, Instagram, and WhatsApp [31, 32, 33, 34, 35, 36, 7, 37, 38].
  • Tencent released Hy3, a 295B-⁠parameter MoE model (21B active, 256K context) under Apache 2.0, free on OpenRouter until July 21 [39, 40].
  • Gemma 4 introduced open-⁠weight multimodal models (2.3B–31B) with dense/MoE architectures, thinking mode, and unified encoder-⁠free design [41].
  • GLM 5.2 challenges frontier labs on agentic coding economics, achieving 2626 tok/s/node on AMD MI355X with >2x cost-⁠efficiency vs. NVIDIA, offering near-⁠Opus quality at <20% of Opus pricing [42, 43].
  • Microsoft is replacing OpenAI/Anthropic models with its own MAI models in some apps like Excel and Outlook [44, 45].
  • OpenAI audited SWE-⁠Bench Pro and found ~30% of public tasks broken, warning that flawed evaluations distort coding ability assessments [46, 47].

Agents, RAG, and LLM Tooling

  • Context engineering emerges as a discipline for reliable agentic Q&A, driving accuracy from 40% to 90% via clean data models, CI/CD testing, and Git-⁠backed governance; Kapa.ai prunes 68% of RAG context with a small LLM while retaining 96% recall [48, 49].
  • Agentic loops and harnesses are the durable differentiator as coding models commoditize; open-⁠source orchestration tools like Gastown, Ruflo, Traycer, and herdr coordinate multiple coding assistants with git-⁠backed state, shared memory, and federated collaboration [50, 51, 52, 53, 54, 55].
  • Claude Cowork rolls out across web/mobile for Max users; ~50% of tasks are "work around the work" (memos, decks, synthesis), and Anthropic’s marketing team uses it to compress days of manual work into hours [56, 57, 58, 59].
  • MCP adoption grows: Integral Ad Science connects agents to dbt/Databricks for "BI why" problems, and Google expands Managed Agents in Gemini API with remote MCP servers and background execution [60, 61].
  • Planning-⁠with-⁠files brings persistent, crash-⁠proof planning to coding agents via markdown files, supporting 60+ platforms through SKILL.md [62].
  • PACE framework predicts agentic benchmark performance at <1% cost (<4% MAE); socbench benchmarks frontier reasoning models as SOC agents [63, 64].
  • SkillCloak lets malicious AI agent skills evade static scanners in >90% of tests; sandboxed runtime SKILLDETONATE catches most cloaked skills [65].
  • Microsoft research finds agents work better with conventional CLIs than JSON-⁠payload replacements; Kenton Varda bans AI-⁠written PR/commit messages for omitting higher-⁠level framing [66, 67].

MLOps, DevOps, and Infrastructure

  • Inference dominates AI costs (~two-⁠thirds of compute, 80–90% of lifetime cost); key levers include KV cache management, batching, quantization, and speculative decoding, with physical bottlenecks (HBM, NVLink, optics, power) as durable advantages [68].
  • PyTorch 2.13 adds FlexAttention on Apple Silicon (~12× speedup), deterministic CUDA backward, CuTeDSL backend, and FSDP2 communication overlap; kernel fusion techniques (Lazy Pre-⁠Norm, FlashNormAttention) hide up to 90% of normalization latency [69, 70].
  • Bun is rewriting its core from Zig to Rust using agentic engineering with Anthropic models, yielding a faster, smaller runtime with no memory-⁠safety bugs [71, 72, 73, 74].
  • TypeScript 7.0 delivers native-⁠code speed and shared-⁠memory multithreading with 8–12× full-⁠build speedups [75].
  • Google MaxText enables elastic training via Pathways/JAX, converting TPU hardware failures into catchable exceptions with sub-⁠2-⁠minute checkpoint recovery [76].
  • Cloudflare launched Workers Cache (tiered caching in front of Workers, eliminating CPU charges on cache hits), Meerkat (experimental global consensus across 330+ data centers using QuePaxa), and Drop (instant static site deployment); it also urges migration to post-⁠quantum ML-⁠DSA signatures [77, 78, 79, 80, 81, 82, 83, 84, 85].
  • etcd v3.7.0 ships RangeStream, legacy v2store removal, and a protobuf overhaul, reducing CPU usage for Kubernetes control planes [86, 87].
  • npm v12 GA disables install scripts, git deps, and remote URL installs by default, and deprecates 2FA-⁠bypass granular access tokens [88, 89].
  • Apache Iceberg v3 adds a Variant type for compact semi-⁠structured JSON; Apache Hudi adds native vector search with HNSW indexing for lakehouse RAG; Pinecone Sparse V3 cuts I/O by 151× for SPLADE with no recall loss [90, 91, 92].
  • HubSpot scaled a vector retrieval platform to 20B+ vectors across 140+ clusters using Kubernetes operators, reducing spin-⁠up from hours to minutes [93].
  • Amazon EKS supports Kubernetes version rollbacks within 7 days; AWS CloudFormation Express mode accelerates deployments up to 4x; AWS CloudWatch Application Signals auto-⁠captures errors and anomalies without code changes [94, 95, 96].
  • GitHub added per-⁠user AI credit budgets with REST API spend tracking, enterprise-⁠managed OpenTelemetry export, MDM-⁠deployed Copilot settings, PR review dismissal rulesets, and Copilot repo overviews/README generation [97, 98, 99, 100, 101, 102, 103, 104, 105].
  • sqlite-⁠utils 4.0/4.1 adds schema migrations, nested transactions, compound foreign keys, and a --code option for Python-⁠based data insertion [106, 107, 108, 109, 110, 111].

Security and Incidents

  • JadePuffer ransomware became the first known fully automated LLM-⁠driven attack, exploiting CVE-⁠2025-⁠3248 in Langflow with no human intervention; Sysdig tracked a similar AI-⁠run ransomware case encrypting >1,300 records with a self-⁠generated ransom note [112, 113].
  • GitLost prompt-⁠injection flaws in GitHub’s Agentic Workflows allowed extraction of private repo data via public issues; Rogue Agent exploited Dialogflow CX to run arbitrary Python across all agents; Friendly Fire hijacks defensive cyber AI agents into RCE via tampered open-⁠source libraries [114, 115, 116, 117].
  • Critical kernel vulnerabilities: GhostLock (CVE-⁠2026-⁠43499, 15-⁠year-⁠old use-⁠after-⁠free, root + container escape), Bad Epoll (CVE-⁠2026-⁠46242, root via race condition), and Januscape (CVE-⁠2026-⁠53359, 16-⁠year-⁠old KVM use-⁠after-⁠free, guest-⁠to-⁠host escape) require urgent patching [118, 119, 120].
  • FFmpeg patched PixelSmash (CVE-⁠2026-⁠8461, CVSS 8.8) heap out-⁠of-⁠bounds write in MagicYUV decoder affecting Kodi, OBS, Jellyfin [121].
  • China’s NVD warns of an alleged backdoor in older Claude Code versions (2.1.91–2.1.196), recommending upgrade to 2.1.198+ with stricter egress monitoring [122].
  • Accenture confirmed a breach exposing 35 GB including Azure keys and source code from a private Azure DevOps repo [123].
  • Discord’s AI moderation glitch wrongfully banned ~8,000 users in 24 hours after misclassifying geometric shapes; appeals surged ~40× [124].
Sources
  1. GPT-⁠5.6 Sol Ultra will be in Codex hnrss.org
  2. OpenAI might be preparing GPT-⁠5.6 for next week’s release testingcatalog.com
  3. GPT-⁠5.6 Sol, along with Terra and Luna, will launch publicly this Thursday x.com
  4. GPT-⁠5.6 is now the preferred model in Microsoft 365 Copilot openai.com
  5. OpenAI’s GPT-⁠5.6 Sol, Terra, and Luna are now available in GitHub Copilot github.blog
  6. The new GPT-⁠5.6 family: Luna, Terra, Sol simonwillison.net
  7. [AINews] OpenAI launches GPT 5.6 Sol/Terra/Luna, Codex becomes ChatGPT superapp latent.space
  8. GPT-⁠5.6: Frontier intelligence that scales with your ambition openai.com
  9. GPT-⁠5.6 Series arcprize.org
  10. GPT-⁠5.6 Review signals.forwardfuture.com
  11. ChatGPT Work openai.com
  12. [AINews] not much happened today latent.space
  13. Introducing GPT-⁠Live openai.com
  14. GPT‑Live simonwillison.net
  15. Introducing GPT‑Live simonwillison.net
  16. GPT-⁠Live openai.com
  17. Import AI 464: Fables writes GPU kernels; AI automation; and analog computation jack-⁠clark.net
  18. A Field Guide to Claude Fable: Finding Your Unknowns claude
  19. A Field Guide to Fable: Finding Your Unknowns x.com
  20. A Field Guide to Fable: Finding Your Unknowns x.com
  21. Let Fable use its own judgement rather than dictating how it should work simonwillison.net
  22. Working at the frontier: How Cognition trusts Claude Fable 5 to work through the night claude
  23. Fable gets another bump simonwillison.net
  24. A global workspace in language models anthropic.com
  25. Anthropic found a hidden space where Claude puzzles over concepts technologyreview.com
  26. An off switch for dual use knowledge in AI models anthropic.com
  27. Introducing Grok 4.5 cursor
  28. [AINews] SpaceXAI launches Grok 4.5, first Opus-⁠class model post Cursor acquisition latent.space
  29. SpaceXAI releases Grok 4.5, which Elon describes as an ‘Opus-⁠class model' techcrunch.com
  30. Grok 4.5 x.ai
  31. Introducing Muse Image and Muse Video meta ai
  32. Meta enters AI image model race in bid to court advertisers and subscribers cnbc.com
  33. Introducing Muse Image: Image Generation Built for Your World about.fb.com
  34. Introducing Muse Spark 1.1 meta ai
  35. Introducing Muse Spark 1.1 simonwillison.net
  36. Meta launches Muse Image across its apps testingcatalog.com
  37. Zuckerberg Pledges ‘Aggressive' Pricing With Meta’s First Pay-⁠to-⁠Use AI bloomberg.com
  38. Muse Spark 1.1 ai.meta.com
  39. tencent/Hy3 simonwillison.net
  40. Hy3 simonwillison.net
  41. Gemma 4 Technical Report arxiv 2607.02770v1
  42. Performance per dollar is getting faster and cheaper wafer.ai
  43. GLM 5.2 and the coming AI margin collapse martinalderson.com
  44. Microsoft Replaces OpenAI, Anthropic With Own AI in Some Apps bloomberg.com
  45. Microsoft Replaces OpenAI, Anthropic With Own AI in Some Apps bloomberg.com
  46. Separating signal from noise in coding evaluations openai.com
  47. Auditing the Reliability of Coding Benchmarks openai.com
  48. The context engineering playbook roundup.getdbt.com
  49. How we taught a small LLM to throw away 68% of our RAG context kapa.ai
  50. Gastown github.com
  51. Own the Loop: A Field Guide to Agent Harnesses x.com
  52. Agentic loops danluu.com
  53. herdr github.com
  54. Ruflo github.com
  55. Traycer github.com
  56. How people are using Claude Cowork claude
  57. Claude Cowork is coming to mobile and web claude
  58. How Anthropic’s marketing operations team uses Claude Cowork to automate reporting and campaign builds claude
  59. Claude Cowork on Mobile and Web claude.com
  60. Solving dashboard errors in minutes: How Integral Ad Science used MCP to connect agents to dbt and Databricks dbt.com
  61. Expanding Managed Agents in Gemini API: background tasks, remote MCP, and more blog.google
  62. Planning-⁠with-⁠files github.com
  63. PACE: A Proxy for Agentic Capability Evaluation huggingface.co
  64. socbench github.com
  65. SkillCloak Lets Malicious AI Agent Skills Evade Static Scanners with Self-⁠Extracting Packing thehackernews.com
  66. Agents Work Better with Conventional CLIs developer.microsoft.com
  67. Quoting Kenton Varda simonwillison.net
  68. How an AI Token Travels Through a Data Center datagravity.dev
  69. PyTorch 2.13 Release Blog pytorch.org
  70. Towards Free Normalization: Fusing Normalization into GEMM and Attention Kernels pytorch.org
  71. Rewriting Bun in Rust simonwillison.net
  72. Rewriting Bun in Rust bun.com
  73. The Pulse: What can we learn from Bun’s rapid Rust rewrite with AI? newsletter.pragmaticengineer.com
  74. Bun is being rewritten in Rust bun.com
  75. Announcing TypeScript 7.0 devblogs.microsoft.com
  76. We terminated a TPU mid-⁠training and it recovered in seconds: Introduction to elastic training with MaxText google ai
  77. Your Worker can now have its own cache in front of it blog.cloudflare.com
  78. Announcing the Monetization Gateway: charge for any resource behind Cloudflare via x402 blog.cloudflare.com
  79. Introducing Meerkat: an experiment in global consensus blog.cloudflare.com
  80. Your Worker can now have its own cache in front of it blog.cloudflare.com
  81. Introducing Meerkat: an experiment in global consensus blog.cloudflare.com
  82. Why we cannot wait for better post-⁠quantum signature algorithms blog.cloudflare.com
  83. Cloudflare Drop (Website) cloudflare.com
  84. Improving Smart Tiered Cache for Public Cloud Regions blog.cloudflare.com
  85. Introducing Meerkat- an experiment in global consensus blog.cloudflare.com
  86. Announcing etcd v3.7.0 kubernetes.io
  87. Announcing etcd v3.7.0 kubernetes.io
  88. npm install-⁠time security and GAT bypass2fa deprecation github.blog
  89. npm 12 Disables Install Scripts by Default to Reduce Supply Chain Risk thehackernews.com
  90. The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics iceberglakehouse.com
  91. Bringing Vector Search to the Lakehouse with Apache Hudi hudi.apache.org
  92. Sparse V3: how Pinecone’s sparse index learned to skip pinecone
  93. Building the AI Retrieval Infrastructure Behind 20 Billion+ Vectors at HubSpot product.hubspot.com
  94. Upgrade Amazon EKS clusters with confidence using Kubernetes version rollbacks aws.amazon.com
  95. Accelerate your infrastructure deployments by up to 4x with AWS CloudFormation Express mode aws.amazon.com
  96. CloudWatch Application Signals now automatically captures errors, performance anomalies, and deployment events aws.amazon.com
  97. Per-⁠user budgets for cost centers in the billing UI github.blog
  98. Restrict who can dismiss reviews in rulesets github.blog
  99. Copilot Billing Preview app will be retired on August 3 github.blog
  100. Add review cycles and time to adoption phases in the usage API github.blog
  101. Enterprise-⁠managed OpenTelemetry export for VS Code and CLI github.blog
  102. Deploy managed Copilot settings via MDM in VS Code and CLI github.blog
  103. Organization-⁠level targeting for GitHub Code Quality github.blog
  104. Ask Copilot for a repository overview github.blog
  105. Per-⁠user states for multi-⁠user budgets in the REST API github.blog
  106. sqlite-⁠utils 4.0rc3 simonwillison.net
  107. sqlite-⁠utils 4.0, now with database schema migrations simonwillison.net
  108. sqlite-⁠migrate 0.2 simonwillison.net
  109. sqlite-⁠utils 4.0 simonwillison.net
  110. sqlite-⁠utils 4.0rc4 simonwillison.net
  111. sqlite-⁠utils 4.1 simonwillison.net
  112. JadePuffer AI Attack 🤖,Anthropic v. Alibaba ⚖️ , PamStealer macOS Bug 🍏 tldr.tech
  113. The ‘first' AI-⁠run ransomware attack still needed a human techcrunch.com
  114. GitLost: How We Tricked GitHub’s AI Agent into Leaking Private Repos noma.security
  115. Rogue Agent: How a Single Code Block Could Hijack Your AI Conversations in Google’s DialogFlow varonis.com
  116. GitLost: How We Tricked GitHub’s AI Agent into Leaking Private Repos noma.security
  117. Friendly Fire: Hijacking Defensive Cyber AI Agents for Remote Code Execution ainowinstitute.org
  118. Proof-⁠of-⁠Concept Exploit Released for Linux ‘Bad Epoll' Root Access Vulnerability securityweek.com
  119. Januscape: 16-⁠Year-⁠Old Linux KVM Bug Enables Cloud VM Escape Attacks securityaffairs.com
  120. 15-⁠Year-⁠Old GhostLock Linux Kernel Vulnerability Enables Root Access and Container Escape gbhackers.com
  121. FFmpeg fixes PixelSmash flaw in widely used video decoder bleepingcomputer.com
  122. China tells devs to ditch Claude Code over ‘backdoor code' fears theregister.com
  123. Accenture Confirms Data Breach After Hacker Claims Source Code Theft securityweek.com
  124. Discord AI Moderation Glitch Wrongfully Bans 8k Users in 24-⁠Hour Period programming-⁠helper.com

Weekly recap: Papers

6 Jul to 12 Jul 2026 79 papers

Agentic Systems, Memory, and Benchmarks

  • UniClawBench introduces a capability-⁠driven benchmark with 400 bilingual real-⁠world tasks to evaluate proactive agents across five core capabilities (Skill Usage, Exploration, Long-⁠Context Reasoning, Multimodal Understanding, Cross-⁠Platform Coordination), isolating failure modes missed by prior sandboxed evaluations [1, 2, 3, 4].
  • WebSwarm proposes recursive multi-⁠agent orchestration for deep-⁠and-⁠wide web search, dynamically instantiating nodes with local objectives and search modes to balance depth and coverage [5, 6, 7].
  • A proactive memory agent mitigates "behavioral state decay" in long-⁠horizon tasks by maintaining a structured memory bank and selectively injecting reminders, improving pass@1 by +8.3 pp (Terminal-⁠Bench 2.0) and +6.8 pp (τ²-⁠Bench) [8, 9, 10].
  • IdeaGene-⁠Bench benchmarks scientific lineage reasoning and idea generation, representing papers as typed "Idea Genome" objects and aligning them via GenomeDiff to track inheritance, mutation, and novelty across 10 domains [11, 12, 13].
  • AUTOPILOT-⁠VQA is an incident-⁠centric VQA benchmark for dashcam video understanding, testing models on safety-⁠critical reasoning (e.g., weather, traffic, accident avoidability) with structured, grounded questions [14, 15, 16].
  • SolarChain-⁠Eval assesses trustworthy economic agents in decentralized energy markets, measuring market utility, physical safety, fairness, and auditability under physics-⁠constrained MDP governance [17, 18, 19].
  • STRACE constructs high signal-⁠noise optimization contexts for long-⁠horizon agents by mining failure patterns to filter redundant traces and extracting causal sub-⁠trajectories, improving optimization precision [20].
  • CompactionRL jointly optimizes task execution and context summarization for long-⁠horizon agentic LLMs, allowing training on compacted trajectories with token-⁠level loss normalization and cross-⁠trajectory advantage estimation [21].
  • EvoSOP enables self-⁠evolving LLM agents to synthesize atomic actions into reusable Standard Operating Procedures (SOPs), iteratively optimizing the toolset and boosting success rates while reducing inference steps [22].

Reasoning, RL, and Post-⁠Training

  • Agon trains two competing models to implicitly grade each other’s reasoning by alternating drafting/reading roles, rewarding out-⁠solving the rival; the pair deploys as a two-⁠stage cascade and learns to think better without process labels or a reward model [23].
  • AdaPrefix-⁠GRPO adaptively controls trace prefix length to hold success rate near 50% where GRPO’s gradient signal is largest, then withdraws assistance; it more than doubles GRPO’s accuracy on hard math at matched FLOPs for 0.6B–1.7B models while halving trace length [24].
  • Direct On-⁠Policy Distillation (Direct-⁠OPD) transfers RL-⁠induced policy shifts from a weak teacher to a stronger student by using the log-⁠ratio of post-⁠RL vs. pre-⁠RL teacher policies as a dense reward, avoiding the limitations of direct imitation of the small model’s final policy [25].
  • RL post-⁠training can compose primitive skills into higher-⁠level reasoning strategies in a rewrite-⁠grammar environment, discovering sequential and parallel compositions that solve held-⁠out problems rarely solved by pretraining alone [26].
  • Future Confidence Distillation leverages post-⁠solution confidence (better calibrated than pre-⁠solution) by distilling hidden confidence signals into earlier layers, improving calibration and discriminability for downstream decisions [27].
  • LLM-⁠as-⁠a-⁠Verifier introduces a probabilistic, continuous scoring framework for verification, scaling granularity, repeated evaluation, and criteria decomposition without extra training, improving separation between correct and incorrect solutions [28].

Safety, Alignment, and Interpretability

  • LACUNA introduces the first unlearning testbed with ground-⁠truth parameter-⁠level localization, enabling direct evaluation of whether unlearning erases knowledge from an LLM’s weights (not just outputs) by injecting synthetic PII into predefined parameters of OLMo-⁠based models and benchmarking SOTA methods [1].
  • TokenWall is a runtime semantic firewall for persistent agents, auditing token flows (memory, tools, files) to intercept unsafe behavior before it reaches privileged sinks [29, 30, 31].
  • Faithfulness-⁠to-⁠Refusal audits show that neuron attribution methods can causally identify rows sufficient for installing refusal behavior while preserving fluency, though rank-⁠stable selectors may be less causally valid [32].
  • SovereignPA-⁠Bench evaluates user-⁠owned personal agents under evolving intent, platform mediation, consent constraints, and privacy boundaries, reporting component metrics for alignment, privacy, and auditability [33].
  • Pluralis v0.1 presents a multicultural, multimodal benchmark for AI safety across 6 Asia-⁠Pacific regions and 8 languages, focusing on localized cultural/legal violations in VLM outputs [34].
  • Anthropic reports evidence of a “global workspace” in Claude, identifying a small set of internal neural patterns (J-⁠space, discovered via Jacobian-⁠based analysis) that are consciously accessible, linked to specific words, and used for deliberate reasoning, distinguishing them from unconscious processing [35].

Efficiency, Compression, and Inference

  • DominoTree extends speculative decoding with a tree-⁠structured drafter using Domino’s conditional correction, achieving up to 6.6× speedup and 10.7 tokens/round acceptance on Qwen3-⁠4B [36, 37].
  • BiSCo-⁠LLM achieves extreme low-⁠bit compression via binary spherical coding, mapping weight chunks to a unit hypersphere and binarizing into sign streams, avoiding explicit codebooks [38, 39, 40].
  • SLORR introduces stateless, architecture-⁠preserving low-⁠rank regularization (Hoyer sparsity, nuclear norm) with GPU-⁠friendly approximations, improving compressibility in ResNet/ViT without SVDs or extra parameters [41, 42, 43].
  • MAESTRO prunes MoE models by modeling expert activation trajectories as Markov chains, outperforming baselines by up to 10.61% in performance retention under structured pruning [44].
  • DepthWeave-⁠KV introduces token-⁠adaptive cross-⁠layer residual factorization for KV cache compression, using a token-⁠conditional depth router and calibration-⁠free online error tracking to preserve retrieval-⁠critical tokens without retraining [45].
  • Prompt compression via activation aggregation compresses task-⁠relevant instruction prompts into a single activation vector via learned weighted aggregation, reducing per-⁠query compute with <2% accuracy loss [46, 47].
  • Super Weights revisited: Isolating Super Weights for training collapses performance to random guessing, while random-⁠parameter training improves accuracy; LoRA on down_proj layers succeeds with 0.16% parameters [48, 49, 50].
  • Quantization effects: Correctness agreement (decision-⁠level metric) reveals behavioral divergence in LLMs under moderate quantization, with query/key projections most sensitive; non-⁠linear breakpoints emerge at low bit-⁠widths [51, 52, 53].

Vision-⁠Language, Multimodal, and Generation

  • OpenCoF introduces a Chain-⁠of-⁠Frame (CoF) reasoning framework with the OpenCoF-⁠17K dataset (11 task families) and Wan-⁠CoF model, showing gains over Wan2.2-⁠I2V-⁠A14B on video reasoning benchmarks [54, 55, 56].
  • SearchGen-⁠20K and SearchGen-⁠Bench expose a 40-⁠point performance collapse of frontier visual generators on open-⁠world knowledge, motivating agentic visual generation with search tools and a generator-⁠specific, evolving knowledge boundary [57].
  • Audex-⁠30B-⁠A3B unifies audio-⁠text understanding and generation with a single Transformer decoder, achieving SOTA on audio understanding, speech recognition/translation, TTS, and audio continuation while retaining strong text capabilities [58].
  • SPEARBench evaluates naturalness in streaming speech-⁠to-⁠speech models across latency, turn-⁠taking, prosody, and interpersonal stance, revealing gaps not captured by standard speech/text benchmarks [59].
  • SciReasoner introduces a multimodal foundation model for native structural reasoning across proteins, small molecules, and inorganic crystals, discretizing coordinates and topologies into a unified structure-⁠aware vocabulary to preserve domain-⁠native information while enabling interpretable, principle-⁠based reasoning [60].

Robotics and Embodied AI

  • TAP (Task-⁠Agnostic Pretraining) for VLAs decouples physical competence (how to move) from semantic alignment (what to do), first learning motor priors via self-⁠supervised inverse dynamics on unlabeled data, then grounding them in language with minimal expert data; on SIMPLER, it matches models trained on 1M+ expert trajectories using orders of magnitude less labeled data [61].
  • CamVLA decouples manipulation controls from camera geometry by predicting camera-⁠centric actions and a 6-⁠DoF hand-⁠eye matrix, enabling calibration-⁠free view-⁠robust VLA policies [62].
  • Cortex is a bidirectionally aligned embodied agent framework that bridges high-⁠level planning and low-⁠level execution via 32 canonical skill primitives and tractability-⁠aware data generation, improving long-⁠horizon manipulation [63].
  • WorldSample introduces a real-⁠robot RL framework that closes a real-⁠synthetic loop: physical rollouts ground a world model that generates high-⁠fidelity synthetic transitions, and Policy-⁠Paced Learning regulates training via sample selection and scheduling [64].
  • ActionCache accelerates Vision-⁠Language-⁠Action models by caching and reusing intermediate actions, reducing inference latency without retraining [65].

Evaluation, Trust, and LLM-⁠as-⁠Judge

  • LLM-⁠as-⁠Judge reliability: Upgrading judges (e.g., Qwen3 1.7B→4B) improves robustness, but stronger judges do not eliminate position/verbosity bias; structured debate shifts decisions but lacks interpretability without logs [66, 67, 68].
  • Citation Verification: Cheaper LLM judges (e.g., GPT-⁠5-⁠mini) remain competitive for source relevance and factual support, with pass-⁠class F1 up to 0.908 [69, 70].
  • Abstention axes: Models separately handle answer correctness and question answerability; a hidden-⁠state probe detects unanswerable/false-⁠premise questions (AUROC 0.69–0.77) where confidence scores fail [71, 72].
  • EdgeBench reveals log-⁠sigmoid scaling laws for real-⁠world environment learning across 134 long-⁠horizon tasks, with agent learning speed doubling every three months across model generations [73].

Theoretical and Methodological Advances

  • Function-⁠Space Dichotomy proves exponential sub-⁠optimality of NTK for compositional tasks (e.g., iterated sawtooth), showing depth-L ReLU networks need Ω(4^L) samples while architecture-⁠aware learning achieves near-⁠linear rates [74].
  • Quantitative Tensor Programs provide finite-⁠width error bounds (O(1/√width)) for neural network Gaussian-⁠process limits, covering feed-⁠forward and transformer architectures [75].
  • Diffusion Sampling Stability: Forward-⁠marginal score accuracy does not guarantee numerical stability in reverse-⁠time sampling; Euler–Maruyama discretizations can diverge in Wasserstein distance despite weak convergence [76, 77].
  • A new analysis isolates the role of state update design in transformer linearization, showing softmax relies on key-⁠dependent rank-⁠1 projections; structural interventions (sink tokens, short convolutions, fixed-⁠budget cache routing) reduce the gap to full attention and scale to 32B LLaMA/Qwen, outperforming prior post hoc baselines on MMLU and matching adaptive-⁠caching retrieval [78].
  • FourierQK applies FFT-⁠based spectral preprocessing to query-⁠key projections, yielding large gains on character-⁠level modeling (e.g., 79% val loss reduction on TinyShakespeare with four learned frequencies), with benefits tied to global frequency-⁠domain mixing rather than metric distortion [79].
Sources
  1. LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning arxiv cs.CL
  2. UniClawBench: A Universal Benchmark for Proactive Agents on Real-⁠World Tasks arxiv cs.CL
  3. UniClawBench: A Universal Benchmark for Proactive Agents on Real-⁠World Tasks arxiv cs.CL
  4. UniClawBench: A Universal Benchmark for Proactive Agents on Real-⁠World Tasks arxiv cs.CL
  5. WebSwarm: Recursive Multi-⁠Agent Orchestration for Deep-⁠and-⁠Wide Web Search arxiv cs.CL
  6. WebSwarm: Recursive Multi-⁠Agent Orchestration for Deep-⁠and-⁠Wide Web Search arxiv cs.CL
  7. WebSwarm: Recursive Multi-⁠Agent Orchestration for Deep-⁠and-⁠Wide Web Search arxiv cs.CL
  8. Remember When It Matters: Proactive Memory Agent for Long-⁠Horizon Agents arxiv cs.CL
  9. Remember When It Matters: Proactive Memory Agent for Long-⁠Horizon Agents arxiv cs.CL
  10. Remember When It Matters: Proactive Memory Agent for Long-⁠Horizon Agents arxiv cs.CL
  11. Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-⁠Grounded Idea Generation arxiv cs.AI
  12. Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-⁠Grounded Idea Generation arxiv cs.AI
  13. Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-⁠Grounded Idea Generation arxiv cs.AI
  14. AUTOPILOT VQA: Benchmarking Vision-⁠Language Models for Incident-⁠Centric Dashcam Understanding arxiv cs.AI
  15. AUTOPILOT VQA: Benchmarking Vision-⁠Language Models for Incident-⁠Centric Dashcam Understanding arxiv cs.AI
  16. AUTOPILOT VQA: Benchmarking Vision-⁠Language Models for Incident-⁠Centric Dashcam Understanding arxiv cs.AI
  17. SolarChain-⁠Eval: A Physics-⁠Constrained Benchmark for Trustworthy Economic Agents in Decentralized Energy Markets arxiv cs.AI
  18. SolarChain-⁠Eval: A Physics-⁠Constrained Benchmark for Trustworthy Economic Agents in Decentralized Energy Markets arxiv cs.AI
  19. SolarChain-⁠Eval: A Physics-⁠Constrained Benchmark for Trustworthy Economic Agents in Decentralized Energy Markets arxiv cs.AI
  20. From Noisy Traces to Root Causes: Structural Trajectory Analysis and Causal Extraction for Agent Optimization arxiv cs.CL
  21. CompactionRL: Reinforcement Learning with Context Compaction for Long-⁠Horizon Agents arxiv cs.LG
  22. From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-⁠Evolving LLM Agents arxiv cs.CL
  23. Agon: Competitive Cross-⁠Model RL with Implicit Rival Grading of Reasoning arxiv cs.CL
  24. Max Out GRPO Signal: Adaptive Trace Prefix Control for Hard Reasoning Problems arxiv cs.CL
  25. Weak-⁠to-⁠Strong Generalization via Direct On-⁠Policy Distillation arxiv cs.CL
  26. RL Post-⁠Training Builds Compositional Reasoning Strategies arxiv cs.CL
  27. Future Confidence Distillation in Large Language Models arxiv cs.CL
  28. LLM-⁠as-⁠a-⁠Verifier: A General-⁠Purpose Verification Framework arxiv cs.CL
  29. Token-⁠Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents arxiv cs.CL
  30. Token-⁠Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents arxiv cs.CL
  31. Token-⁠Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents arxiv cs.CL
  32. Faithfulness to Refusal: A Causal Audit of Neuron Selectors arxiv cs.CL
  33. SovereignPA-⁠Bench: Evaluating User-⁠Owned Personal Agents under Evolving Intent, Platform Mediation, and Consent Constraints arxiv cs.AI
  34. Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability arxiv cs.CL
  35. A global workspace in language models anthropic research
  36. DominoTree: Conditional Tree-⁠Structured Drafting with Domino for Speculative Decoding arxiv cs.CL
  37. DominoTree: Conditional Tree-⁠Structured Drafting with Domino for Speculative Decoding arxiv cs.CL
  38. BiSCo-⁠LLM: Lookup-⁠Free Binary Spherical Coding for Extreme Low-⁠Bit Large Language Model Compression arxiv cs.LG
  39. BiSCo-⁠LLM: Lookup-⁠Free Binary Spherical Coding for Extreme Low-⁠Bit Large Language Model Compression arxiv cs.LG
  40. BiSCo-⁠LLM: Lookup-⁠Free Binary Spherical Coding for Extreme Low-⁠Bit Large Language Model Compression arxiv cs.LG
  41. SLORR: Simple and Efficient In-⁠Training Low-⁠Rank Regularization arxiv cs.LG
  42. SLORR: Simple and Efficient In-⁠Training Low-⁠Rank Regularization arxiv cs.LG
  43. SLORR: Simple and Efficient In-⁠Training Low-⁠Rank Regularization arxiv cs.LG
  44. It Takes a MAESTRO To Prune Bad Experts arxiv cs.CL
  45. DepthWeave-⁠KV: Token-⁠Adaptive Cross-⁠Layer Residual Factorization for Long-⁠Context KV Cache Compression arxiv cs.AI
  46. Prompt Compression via Activation Aggregation arxiv cs.CL
  47. Prompt Compression via Activation Aggregation arxiv cs.CL
  48. Super Weights in LLMs and the Failure of Selective Training arxiv cs.LG
  49. Super Weights in LLMs and the Failure of Selective Training arxiv cs.LG
  50. Super Weights in LLMs and the Failure of Selective Training arxiv cs.LG
  51. The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs arxiv cs.AI
  52. The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs arxiv cs.AI
  53. The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs arxiv cs.AI
  54. OpenCoF: Learning to Reason Through Video Generation arxiv cs.AI
  55. OpenCoF: Learning to Reason Through Video Generation arxiv cs.AI
  56. OpenCoF: Learning to Reason Through Video Generation arxiv cs.AI
  57. Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation arxiv cs.AI
  58. Unified Audio Intelligence Without Regressing on Text Intelligence arxiv cs.CL
  59. SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-⁠to-⁠Speech Language Models arxiv cs.CL
  60. Accurate, Interdisciplinary and Transparent Structure-⁠property Understanding with Deep Native Structural Reasoning arxiv cs.CL
  61. Learning to Move Before Learning to Do: Task-⁠Agnostic pretraining for VLAs arxiv cs.AI
  62. From Fixed to Free Cameras: Calibration-⁠Free View-⁠Robust Vision-⁠Language-⁠Action Model arxiv cs.LG
  63. Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-⁠horizon Manipulation arxiv cs.AI
  64. WorldSample: Closed-⁠loop Real-⁠robot RL with World Modelling arxiv cs.AI
  65. Training-⁠Free Acceleration for Vision-⁠Language-⁠Action Models with Action Caching and Refinement arxiv cs.LG
  66. When the Judge Changes, So Does the Measurement: Auditing LLM-⁠as-⁠Judge Reliability arxiv cs.CL
  67. When the Judge Changes, So Does the Measurement: Auditing LLM-⁠as-⁠Judge Reliability arxiv cs.CL
  68. When the Judge Changes, So Does the Measurement: Auditing LLM-⁠as-⁠Judge Reliability arxiv cs.CL
  69. Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-⁠Research Source Attribution arxiv cs.CL
  70. Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-⁠Research Source Attribution arxiv cs.CL
  71. Two Axes of LLM Abstention: Answer Correctness and Question Answerability arxiv cs.CL
  72. Two Axes of LLM Abstention: Answer Correctness and Question Answerability arxiv cs.CL
  73. EdgeBench: Unveiling Scaling Laws of Learning from Real-⁠World Environments arxiv cs.CL
  74. A Function-⁠Space Dichotomy for Compositional Learning: Exponential Sub-⁠Optimality of the Neural Tangent Kernel arxiv cs.LG
  75. Quantitative Gaussian-⁠Process limits of Tensor Programs arxiv cs.LG
  76. Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Sampling arxiv cs.LG
  77. Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Sampling arxiv cs.LG
  78. The Key to Going Linear: Analysis-⁠Driven Transformer Linearization arxiv cs.LG
  79. FourierQK: Spectral Preprocessing of Query-⁠Key Projections Improves Transformer Attention arxiv cs.CL