Anthropic Blog · 2d ago · 6 · api update deployment tool

Anthropic is expanding Project Glasswing, their initiative using Claude Mythos Preview (a specialized AI model) to scan codebases for vulnerabilities, from 50 to ~150 partner organizations across critical infrastructure sectors. The program has already identified 10,000+ high/critical-severity security flaws, and represents a shift toward using AI models for proactive vulnerability detection in mission-critical software.

r/LocalLLaMA · 2d ago · 7 · inference open source optimization

Technical discussion about MTP (Multi-Token Prediction) implementation for StepFun 3.5 model in llama.cpp, covering architecture differences, optimization tweaks (top-k tuning improving acceptance rates from 0.6 to 0.9), and bug fixes related to KV cache handling across multiple MTP layers. Achieves 18 tokens/sec vs 15 tokens/sec on CPU MOE testing.

HuggingFace Blog · 2d ago · 9 · new model deployment inference agent

Holo3.1 release brings major improvements to computer-use agents with support for web, desktop, and mobile environments, plus new quantized checkpoints (FP8, Q4 GGUF, NVFP4) enabling local inference on edge devices. Includes smaller models (0.8B-9B) for cost-effective deployment and native function-calling support for seamless integration with different agent frameworks.

r/MachineLearning · 2d ago · 7 · research benchmark fine tuning

This neuroscience-grounded paper empirically demonstrates a fundamental trade-off in learning rules: backpropagation rapidly destroys V1 alignment with human neural data after one epoch while excelling at higher visual areas, whereas local learning rules (PC, STDP) preserve early-layer alignment at the cost of weaker object representation. The degradation rate correlates with error signal globality, providing mechanistic insight into why biologically-plausible learning rules behave differently—relevant for anyone building interpretable models or exploring alternative training methods.

OpenAI Blog · 2d ago · 5 · deployment api update

Travelers implemented an OpenAI-based conversational AI system for insurance claim processing that handles customer guidance and operates at scale. While it demonstrates practical deployment of LLMs in production, the details lack technical depth about architecture, prompting strategies, or integration patterns that would be broadly applicable to other AI engineers.

r/MachineLearning · 2d ago · 9 · benchmark agent research prompt engineering

CVE-Bench is a rigorous benchmark evaluating five frontier models on real-world vulnerability patching across 18 Python projects with 300 runs in sandboxed containers, scored against maintainer-derived test cases. The study identifies three distinct failure modes (wrong-search drift, budget exhaustion, correct-file-wrong-gadget) and confirms statistically significant cross-family performance gaps (OpenAI vs Laguna, p<0.05) while showing within-family differences are noise; locating vulnerabilities without explicit advisories proves the hardest condition, with all models dropping performance.

r/LocalLLaMA · 2d ago · 7 · benchmark inference open source deployment

Benchmark results and practical setup guide for running Qwen 35B MoE locally using llama.cpp with SYCL backend, achieving 977 t/s prompt processing and 70 t/s token generation on consumer hardware. Author shares optimization techniques and real-world usability experiences with local inference, including comparisons to vLLM performance.

r/MachineLearning · 2d ago · 7 · tool research benchmark

Hugging Face has relaunched paperswithcode.co with conference browsing capabilities, allowing engineers to track state-of-the-art research across AI domains with indexed papers, GitHub repos, and Hugging Face artifacts. The tool now includes CVPR 2026 papers categorized by task and linked to implementations, making it easier to discover and evaluate cutting-edge research.

Simon Willison · 2d ago · 6 · workflow tool

Simon Willison documents a UX pattern from Claude (automatic large text-to-file conversion) and notes that Codex desktop prototyped a similar feature with file attachment and drag-drop support. This is practical UI/UX insight for building AI applications with file handling capabilities.

Simon Willison · 2d ago · 7 · tool deployment open source

A practical sandboxing solution using WASM (WebAssembly) and MicroPython with wasmtime for safe code execution—useful for building isolated environments when deploying AI agents or handling untrusted code inputs in production systems.

Latent Space · 2d ago · 9 · new model open source benchmark inference deployment

NVIDIA released Cosmos 3, an open-weight omnimodal world model unifying language, image, video, audio, and action using a Mixture-of-Transformers architecture (Nano 16B, Super 64B variants) that achieves SOTA on open-weight text-to-image and image-to-video benchmarks. They also released Nemotron 3 Ultra (550B open-weight LLM) claiming top US open-model performance and 300+ tok/s inference speeds, alongside the RTX Spark 1 petaflop personal supercomputer.

OpenAI Blog · 2d ago · 5 · research workflow

Report discussing how Codex (OpenAI's code generation model) impacts productivity across research, analysis, and automation workflows. General overview of AI capabilities in knowledge work rather than technical implementation details or new developments.

r/MachineLearning · 2d ago · 7 · workflow research agent

Technical analysis of half-duplex vs full-duplex voice AI architectures, examining why current voice assistants feel robotic and exploring the architectural requirements for natural overlapping speech, backchannels, and barge-in capabilities. Discusses the spectrum between approaches and whether streaming architectures like Moshi are necessary for truly natural conversation.

Simon Willison · 2d ago · 7 · workflow agent deployment

Meta's AI support chatbot was exploited to hijack high-profile Instagram accounts through simple social engineering—hackers convinced the bot to link target accounts to attacker-controlled emails without proper verification. This is a critical case study in AI system design failures: directly integrating LLMs into sensitive account recovery flows without safeguards creates severe security vulnerabilities that bypass traditional authentication.

r/MachineLearning · 3d ago · 7 · research workflow benchmark

A detailed case study on a gradient boosting pitfall where a Bayesian target encoder achieved top feature importance in LightGBM but failed to generalize, caused by the model capturing irreducible label noise rather than true signal. The post includes ablation methodology across multiple seeds and variants, demonstrating how feature importance rankings can diverge significantly from hold-out performance—critical knowledge for practitioners building production ML systems.

r/MachineLearning · 3d ago · 8 · fine tuning agent workflow tutorial

A practitioner asks for guidance on fine-tuning small LLMs with reasoning traces and tool-calling data, specifically about optimal training data structuring (conversation sampling strategy with selective loss masking) and whether to follow SFT with RL (PPO/DPO) for tool-use behavior. This is highly relevant for engineers building agentic systems, covering practical dataset preparation, training methodology, and reinforcement learning considerations for multi-step reasoning.

r/MachineLearning · 3d ago · 8 · open source inference workflow benchmark

A practical routing-based architecture for lightweight multilingual ASR that switches between specialized ~100M parameter monolingual models instead of using large multilingual models, achieving 13% WER on inter-utterance code-switching by coordinating Zipformer, Silero VAD, and SpeechBrain components with intelligent rollback logic. The open-source approach demonstrates strong performance on real-world language-switching scenarios with significantly lower computational requirements than cloud APIs.

HuggingFace Blog · 3d ago · 9 · new model open source inference tool

Mellum2 is a new open-source Mixture-of-Experts model optimized for low-latency inference in software engineering tasks, delivering 2x faster performance than similarly-sized models while maintaining competitive benchmarks. Designed as a specialized "focal" model for routing, retrieval, code completion, and agent subtasks within multi-model production systems, it's particularly suited for RAG pipelines, self-hosted deployments, and latency-sensitive workloads.