r/LocalLLaMA · 11h ago · 9 · new model open source agent deployment benchmark

MiniMax-M2.7 is a new open-source model with strong programming and agent capabilities, featuring self-evolving optimization during training and native multi-agent collaboration support. The model demonstrates exceptional performance on code tasks (SWE-Pro 56.22%, Terminal Bench 57.0%), system-level reasoning for SRE work, and achieves competitive benchmarks against GPT-5.3 and Claude variants while supporting deployment via SGLang, vLLM, and Transformers.

Latent Space · 1d ago · 7 · new model agent workflow inference

GLM-5.1 reaches top-tier coding performance (#3 on Code Arena), while the 'cheap executor + expensive advisor' pattern emerges as a standard orchestration approach for reducing inference costs. Key implementations include Anthropic's API-level advisor tools, Berkeley's research, and new features in Qwen Code (v0.14.x) with agent engineering primitives like model routing and sub-agent selection.

HuggingFace Blog · 3d ago · 8 · new model inference open source

Waypoint-1.5 is Overworld's improved real-time video world model now optimized for consumer hardware, running up to 720p/60fps on RTX 3090+ and 360p on broader gaming laptops/Apple Silicon. The model was trained on 100x more data than v1 with more efficient video modeling techniques, prioritizing interactive responsiveness and local deployment over pure visual fidelity.

Simon Willison · 3d ago · 8 · new model api update agent tool benchmark

Meta released Muse Spark, a new hosted AI model with Instant and Thinking modes, accessible via meta.ai with a private API preview. The model includes integrated tools for web search, image generation, code execution, and Meta content search, making it relevant for understanding multi-tool agent systems and comparing reasoning capabilities against current SOTA models like GPT-5.4 and Gemini 3.1.

Simon Willison · 4d ago · 7 · new model open source benchmark

GLM-5.1, a 754B parameter open-weights model from Z.ai, demonstrates strong capabilities in multimodal generation and instruction-following, particularly for SVG/HTML creation tasks. The model can self-correct technical issues (CSS animations breaking SVG positioning) and generate well-structured code with detailed comments, making it worth testing for creative code generation workflows.

Simon Willison · 4d ago · 9 · new model research benchmark deployment

Anthropic released Claude Mythos Preview under restricted access through Project Glasswing, a model with dramatically enhanced cybersecurity research capabilities that can autonomously develop complex multi-vulnerability exploits and ROP chains—achieving 181/210 success rate on exploit development vs near-0% for Claude Opus 4.6. This represents a significant capability jump in AI-assisted vulnerability research with direct implications for how engineers must approach security testing and deployment of foundational systems.

Latent Space · 5d ago · 7 · new model deployment inference open source tool

Gemma 4 is gaining traction as a practical edge-inference model with strong on-device performance (40 tok/s on iPhone 17 Pro via MLX), achieving 2M downloads in its first week and becoming the top trending model on Hugging Face. The release demonstrates mature ecosystem support across llama.cpp, Ollama, vLLM, and other deployment tools, positioning it as a reference point for local-first development and reducing reliance on paid cloud APIs.

Latent Space · 8d ago · 8 · new model open source inference benchmark deployment

Gemma 4 launched under Apache 2.0 with strong day-0 ecosystem support across vLLM, llama.cpp, Ollama, and major inference platforms. Key technical highlights include MoE architecture, multimodal capabilities, impressive local inference benchmarks (162 tok/s on RTX 4090, runs on M4 MacBooks and iPhones), and ecosystem-wide quantization/optimization support within hours of release.

Latent Space · 9d ago · 9 · new model open source agent inference api update

Google DeepMind released Gemma 4, a family of open-weight models (31B dense, 26B MoE, edge variants) under Apache 2.0 license with native multimodal support (text/image/video/audio), 256K context, and function calling—positioning it as a top-tier open model for reasoning, agents, and edge deployment. The 31B variant achieves competitive performance with significantly fewer parameters than rivals, with strong benchmarks on GPQA and AIME, and rapid ecosystem adoption already underway.

DeepMind Blog · 9d ago · 9 · new model open source inference fine tuning

Google released Gemma 4, a family of open-source models (2B to 31B parameters) built on Gemini 3 technology, ranked #3 and #6 on Arena AI leaderboard for their sizes. The models are optimized for on-device deployment, agentic workflows, and fine-tuning across hardware from mobile to datacenter, with Apache 2.0 licensing enabling direct integration into engineering workflows.

Latent Space · 10d ago · 7 · new model open source agent benchmark deployment

Multiple open-weight model releases including Arcee's 400B Trinity-Large-Thinking (Apache 2.0, strong agentic benchmarks), Z.ai's GLM-5V-Turbo (native multimodal vision-coding), and TII's Falcon Perception with efficient OCR. Also covers a Claude Code source leak analysis and competitive landscape updates relevant to developers building agents and deploying models.

HuggingFace Blog · 10d ago · 9 · new model open source benchmark deployment

Google releases Gemma 4, a new family of open-source multimodal models (4 sizes, up to 31B dense and 26B MoE) with Apache 2 licenses, strong arena benchmark scores, and support for image/audio/text inputs. The models feature novel architecture improvements like Per-Layer Embeddings and variable aspect ratio image encoding, with broad framework support (transformers, llama.cpp, MLX, WebGPU, Rust) for on-device and server deployment.

HuggingFace Blog · 10d ago · 7 · new model agent benchmark open source inference

Holo3 is a new 10B-parameter agent model achieving 78.85% on OSWorld benchmark for autonomous desktop task execution, with weights openly available on Hugging Face under Apache2 license. The model is production-ready and trained via a specialized flywheel combining synthetic navigation data, out-of-domain augmentation, and curated reinforcement learning for computer use tasks across enterprise applications.

HuggingFace Blog · 11d ago · 7 · new model open source research

TII releases Falcon OCR, a 0.3B parameter model achieving 80.3/88.6 on olmOCR/OmniDocBench benchmarks with the highest throughput among open-source OCR models. The post details their unified early-fusion Transformer architecture that combines vision and language modeling in a single backbone with hybrid attention masks and structured Chain-of-Perception decoding for dense object detection and segmentation.

HuggingFace Blog · 11d ago · 8 · new model open source fine tuning research

IBM releases Granite 4.0 3B Vision, a modular vision-language model optimized for chart and document understanding, delivered as a LoRA adapter on Granite 4.0 Micro with a novel DeepStack architecture for multi-layer visual feature injection. The release includes ChartNet, a 1.7M-sample synthetic dataset for chart interpretation with code-guided augmentation, addressing a key VLM weakness in structured data reasoning.

DeepMind Blog · 16d ago · 8 · new model api update agent

Google released Gemini 3.1 Flash Live, an improved real-time audio model with better precision, lower latency, and enhanced tonal understanding for voice-first applications. Available via Gemini Live API, it achieves 90.8% on ComplexFuncBench Audio and 36.1% on Scale AI's Audio MultiChallenge, enabling developers to build voice agents that handle complex tasks with natural dialogue in noisy environments.

DeepMind Blog · 17d ago · 7 · new model api update tool

Google released Lyria 3 Pro, an advanced music generation model supporting 3-minute tracks with structural awareness (verses, choruses, bridges). The model is available across multiple platforms including Vertex AI, Gemini API, Google AI Studio, and consumer apps, enabling developers to integrate custom music generation at scale.

DeepMind Blog · 39d ago · 9 · new model api update inference

Google released Gemini 3.1 Flash-Lite, a new lightweight model optimized for high-volume production workloads at $0.25/1M input tokens and $1.50/1M output tokens. It delivers 2.5X faster time-to-first-token and 45% faster output speeds than 2.5 Flash while maintaining quality, making it ideal for real-time applications like translation, content moderation, UI generation, and agentic workflows at scale.

DeepMind Blog · 44d ago · 7 · new model api update inference

Google DeepMind released Nano Banana 2 (Gemini 3.1 Flash Image), a new image generation model combining advanced reasoning and world knowledge with Flash-speed inference. The model is now available across Google products (Gemini app, Search) and offers improved subject consistency, photorealism, and instruction-following capabilities with reduced latency compared to the Pro version.

Ahead of AI · 45d ago · 8 · new model research benchmark

Comprehensive technical comparison of 10+ major open-weight LLM releases from January-March 2026, analyzing architectural innovations like mixture-of-experts, sliding window attention, QK-norm, and gating mechanisms across models from Arcee, Moonshot, Qwen, and others. Serves as a practical reference for understanding current design patterns and trade-offs in large model architecture.