Latent Space · 10h ago · 7 · new model tool api update agent inference

Grok 4.5, a new frontier model from xAI trained specifically for coding and agents, launched with Cursor partnership offering Opus-class performance at better speed, cost efficiency, and token efficiency. The model is positioned for practical engineering workflows rather than benchmark supremacy, with immediate availability across Cursor, Grok API, OpenRouter, and agent frameworks like Hermes.

Simon Willison · 16h ago · 8 · agent workflow benchmark

Jarred Sumner describes how AI agents (Claude/Fable) enabled a major rewrite of Bun from Zig to Rust by automating code translation guided by a TypeScript test suite, demonstrating practical agentic engineering patterns like dynamic workflows, adversarial review, and automated loop correction. This case study highlights how frontier LLMs are changing software engineering workflows by making large-scale rewrites feasible through automated code generation validated by conformance testing.

Anthropic Research · 17h ago · 8 · research fine tuning deployment

Anthropic and AE Studio introduce GRAM (Gradient-Routed Auxiliary Modules), a novel technique for isolating dual-use knowledge (cybersecurity, virology, CBRN) into removable neural compartments within a single model, enabling cost-effective deployment of multiple capability-filtered versions without retraining separate models. This addresses a critical challenge in AI safety by making dangerous knowledge modular and controllable while preserving general model performance.

Simon Willison · 17h ago · 8 · new model api update workflow

OpenAI upgraded ChatGPT's voice mode with GPT-Live, a new model that intelligently delegates complex tasks (web search, reasoning) to GPT-5.5 while maintaining conversational flow. The upgrade significantly improves voice mode's usefulness as a brainstorming tool, moving beyond the outdated GPT-4o model previously in use.

TLDR AI · 17h ago · 8 · agent api update tool workflow

MiniMax Code offers a practical AI platform for building multi-step agents with 1M token context window, native vision capabilities, and competitive pricing ($500/year for 5.1B tokens). Enables developers to create reasoning agents, visual document processing, and codebase analysis workflows without external vision models.

Latent Space · 17h ago · 7 · deployment inference tool agent

Modal raised $355M Series C and is positioning itself as an "agent cloud" platform optimized for AI workloads rather than traditional web applications, with features like serverless functions, elastic inference, GPU snapshotting, sandboxes, and multi-node training. The podcast episode with Modal's CTO covers why traditional cloud infrastructure (Kubernetes) wasn't designed for bursty AI compute, why agents need tighter infrastructure abstractions, and Modal's technical stack including speculative decoding, Auto Endpoints, and capacity pooling across 17 cloud providers.

Simon Willison · 20h ago · 6 · workflow prompt engineering

A technical leader shares practical experience with AI-generated commit messages and PR descriptions, finding them ineffective because they describe low-level code details rather than high-level intent. This highlights a real workflow problem when using AI for documentation tasks and the importance of understanding context in code review practices.

r/MachineLearning · 22h ago · 8 · research agent fine tuning tool prompt engineering

Research demonstrates a critical gap in LLM safety alignment: current text-classification-based guardrails fail against adversarial prompts that encode attacks in tool-call sequences rather than linguistic markers. The study evaluates multiple safety approaches (DPO, SafeDPO, training-free methods) against CVE-based attacks on MCP-enabled agents, showing current SOTA methods only block ~48% of attacks while training-free approaches achieve 3x baseline refusal rates without fine-tuning.

r/MachineLearning · 22h ago · 7 · new model open source research rl training inference

LingBot-Video combines diffusion transformers with DeepSeek-V3-style sparse MoE (128 experts, top-8 routing) and multi-reward RL post-training for action-conditioned video generation, with open weights/code in Diffusers/SGLang. Key technical tensions: using VLMs as physics validators may enable reward hacking despite negative examples, and unclear separation between video generation and true world modeling without closed-loop robot validation.

HuggingFace Blog · 23h ago · 7 · tool open source agent benchmark

NVIDIA released Nemotron Post-Training v3 Prompt Atlas, an interactive tool for exploring millions of synthetic post-training samples across diverse domains. The resource addresses a critical gap for AI engineers building agents: understanding the data composition and training recipes behind model behavior, with emphasis on how synthetic data enables agent reproducibility and inspectability without exposing proprietary datasets.

r/MachineLearning · 1d ago · 6 · research benchmark inference

A developer shares empirical results comparing vision encoders (SigLIP2, CLIP ViT-L, DINOv2) for fine-grained car classification via k-NN retrieval, observing a 50-point accuracy gap between SigLIP2 (92%) and DINOv2 (41%). The post explores whether this is due to embedding space design differences and questions whether DINOv2 needs supervised fine-tuning to be effective for retrieval tasks on small datasets.

OpenAI Research · 1d ago · 7 · benchmark research

OpenAI's analysis identifies methodological flaws in SWE-Bench Pro, a widely-used benchmark for evaluating AI coding capabilities, which could impact how developers assess model performance for software engineering tasks. This is important for engineers relying on benchmark results to choose models and measure progress on code generation workflows.

r/LocalLLaMA · 1d ago · 7 · inference open source tool

DSpark is a speculative decoding implementation for Kimi-K2.6 that accelerates inference through lightweight draft heads (Markov logit-bias and confidence prediction), achieving 0.816 acceptance rate at position 1. The approach uses vLLM's speculative decoding and shows good cross-model transfer to K2.7-Code with only ~11% degradation in accepted length.

Latent Space · 1d ago · 7 · agent research workflow tutorial

Lilian Weng's research recap on harness engineering and its relationship to recursive self-improvement (RSI) provides practical design patterns and optimization literature overview for building agent systems. Multiple platforms (Anthropic, Google, LangChain) are converging around harness-centric agent architectures as the proven approach for long-running workflows, moving away from direct model weight modification.

HuggingFace Blog · 1d ago · 8 · inference tool library deployment open source

The transformers library's vLLM integration now uses torch.fx graph analysis and AST-based code rewriting to dynamically optimize model inference at runtime, matching native vLLM performance without custom implementations. This enables single-flag deployment of Hugging Face models with optimized inference (continuous batching, fused kernels) through --model-impl transformers, with benchmark comparisons showing performance parity across Qwen3 variants.

OpenAI Blog · 1d ago · 8 · new model tool api update

OpenAI released advanced voice models that enable natural speech-based interaction with ChatGPT, supporting real-time conversation with improved naturalness and responsiveness. This represents a significant tool update for AI engineers building voice-enabled applications and multimodal interfaces.

r/MachineLearning · 1d ago · 8 · tutorial research inference

A theoretical tutorial series on FlashAttention using modern algebraic formalism (associative reductions, twisted monoids) that enables GPU scheduling optimizations—more powerful than the original framing. Covers safe softmax, Welford's variance, numerical stability bounds, and provides first-principles derivations of constants in FA-2 and Triton kernels.

r/LocalLLaMA · 1d ago · 8 · new model inference tool deployment

Practical guide for running DeepSeek-V4-Flash GGUF quantized model across multiple inference frameworks (llama.cpp, Ollama, llama-cpp-python, etc.), including critical bug fix for llama.cpp PR #25402 that resolves gibberish output after turn 2 and improved chat template handling.