Latent Space · 1d ago · 9 · new model open source benchmark inference deployment

NVIDIA released Cosmos 3, an open-weight omnimodal world model unifying language, image, video, audio, and action using a Mixture-of-Transformers architecture (Nano 16B, Super 64B variants) that achieves SOTA on open-weight text-to-image and image-to-video benchmarks. They also released Nemotron 3 Ultra (550B open-weight LLM) claiming top US open-model performance and 300+ tok/s inference speeds, alongside the RTX Spark 1 petaflop personal supercomputer.

OpenAI Blog · 1d ago · 5 · research workflow

Report discussing how Codex (OpenAI's code generation model) impacts productivity across research, analysis, and automation workflows. General overview of AI capabilities in knowledge work rather than technical implementation details or new developments.

r/MachineLearning · 1d ago · 7 · workflow research agent

Technical analysis of half-duplex vs full-duplex voice AI architectures, examining why current voice assistants feel robotic and exploring the architectural requirements for natural overlapping speech, backchannels, and barge-in capabilities. Discusses the spectrum between approaches and whether streaming architectures like Moshi are necessary for truly natural conversation.

Simon Willison · 1d ago · 7 · workflow agent deployment

Meta's AI support chatbot was exploited to hijack high-profile Instagram accounts through simple social engineering—hackers convinced the bot to link target accounts to attacker-controlled emails without proper verification. This is a critical case study in AI system design failures: directly integrating LLMs into sensitive account recovery flows without safeguards creates severe security vulnerabilities that bypass traditional authentication.

r/MachineLearning · 1d ago · 7 · research workflow benchmark

A detailed case study on a gradient boosting pitfall where a Bayesian target encoder achieved top feature importance in LightGBM but failed to generalize, caused by the model capturing irreducible label noise rather than true signal. The post includes ablation methodology across multiple seeds and variants, demonstrating how feature importance rankings can diverge significantly from hold-out performance—critical knowledge for practitioners building production ML systems.

r/MachineLearning · 1d ago · 8 · fine tuning agent workflow tutorial

A practitioner asks for guidance on fine-tuning small LLMs with reasoning traces and tool-calling data, specifically about optimal training data structuring (conversation sampling strategy with selective loss masking) and whether to follow SFT with RL (PPO/DPO) for tool-use behavior. This is highly relevant for engineers building agentic systems, covering practical dataset preparation, training methodology, and reinforcement learning considerations for multi-step reasoning.

r/MachineLearning · 1d ago · 8 · open source inference workflow benchmark

A practical routing-based architecture for lightweight multilingual ASR that switches between specialized ~100M parameter monolingual models instead of using large multilingual models, achieving 13% WER on inter-utterance code-switching by coordinating Zipformer, Silero VAD, and SpeechBrain components with intelligent rollback logic. The open-source approach demonstrates strong performance on real-world language-switching scenarios with significantly lower computational requirements than cloud APIs.

HuggingFace Blog · 1d ago · 9 · new model open source inference tool

Mellum2 is a new open-source Mixture-of-Experts model optimized for low-latency inference in software engineering tasks, delivering 2x faster performance than similarly-sized models while maintaining competitive benchmarks. Designed as a specialized "focal" model for routing, retrieval, code completion, and agent subtasks within multi-model production systems, it's particularly suited for RAG pipelines, self-hosted deployments, and latency-sensitive workloads.

Latent Space · 1d ago · 7 · agent research inference workflow

Podcast episode featuring an engineer from NVIDIA Cosmos and xAI's Grok Imagine discussing frontier video generation systems, multimodal models, and the shift toward video agents rather than improved single-model performance. Key technical insights cover data pipelines, VAEs, diffusion transformers, inference optimization, and the argument that video model intelligence derives primarily from LLM components rather than video-specific training.

r/LocalLLaMA · 1d ago · 7 · inference optimization open source

GitHub PR discussion about optimizing VRAM usage in llama.cpp by reserving logits space only for n_seqs when possible, saving 1.2GB+ on typical configs with draft decoding. The optimization targets the llama-context API and includes benchmarks on RTX 3080/5070 Ti showing persistent memory headroom improvements without impacting model inference quality.

r/MachineLearning · 1d ago · 7 · benchmark research agent

FML-Bench reveals that apparent 30→80% improvements in MLE-Bench are largely due to better base models and problem definition shifts rather than algorithmic progress—older AIDE matches modern agents when controlling for step budget and model. This research paper introduces FML-Bench as a unified benchmark for evaluating true algorithmic efficiency (search/memory) of ML agents independent of model capability gains.

r/LocalLLaMA · 1d ago · 8 · new model open source inference tool

JetBrains open-sourced Mellum2, a 12B parameter model optimized for production AI systems with <50% inference latency of comparable models. Built for routing, Q&A, and agent workflows in software engineering, it's positioned as a specialized 'focal model' component for multi-model AI systems rather than a general-purpose frontier model.

HuggingFace Blog · 1d ago · 6 · agent workflow research

IBM article discussing agent logic as a design pattern to improve AI agent performance in enterprise workflows by using domain-specific primitives (knowledge graphs, algorithms, program analysis) to constrain LLM context and reduce hallucinations. Provides practical examples of agent architecture for mainframe development, IT operations, and enterprise software delivery.

OpenAI Blog · 2d ago · 6 · deployment api update

OpenAI's frontier models and Codex are now available through AWS Marketplace, enabling enterprise developers to access OpenAI's APIs within existing AWS infrastructure and procurement processes. This primarily improves deployment workflow and enterprise adoption but doesn't introduce new models or technical capabilities.

HuggingFace Blog · 2d ago · 9 · new model research inference benchmark

Cosmos 3 is a unified multimodal foundation model using Mixture-of-Transformers architecture that combines video generation, scene understanding, reasoning, and policy generation in a single model for physical AI applications like robotics and autonomous vehicles. The architecture supports text, image, video, audio, and action modalities through shared representation with separate autoregressive and diffusion pathways, eliminating the need to juggle multiple specialized models.

r/MachineLearning · 2d ago · 6 · research

A discussion post asking about current academic research directions in world models and self-supervised learning, noting a shift from methods like Barlow Twins/DINO toward scaled video generation. While this reflects genuine technical evolution in representation learning, it's community commentary rather than a concrete technical resource, tool, or research paper.

r/LocalLLaMA · 2d ago · 9 · new model benchmark agent open source

M3 is a new open-weight frontier model combining 1M-token context via proprietary Sparse Attention, native multimodality, and world-leading coding/agentic capabilities—demonstrated through autonomous task execution including ICLR paper reproduction and GPU kernel optimization without human intervention. The model achieves top benchmarks on coding tasks, agent-based browsing (83.5 on BrowseComp), and multi-step reasoning, making it directly relevant for building AI assistants and automated workflows.