r/MachineLearning · 1d ago · 5 · fine tuning tutorial

A startup question about implementing sentiment analysis for Indian-language political content using muRIL model, seeking guidance on fine-tuning approaches and alternatives without ML expertise. While relevant to AI builders, this is a general advice post rather than a technical resource, tutorial, or new tool announcement.

r/LocalLLaMA · 2d ago · 7 · new model tutorial deployment fine tuning

EpistemeAI/Reasoning-Medical0.1-27B is a 27B parameter model fine-tuned on 100k medical reasoning examples using GRPO training and Unsloth optimization, with native Chain-of-Thought reasoning capabilities. The guide covers practical deployment across multiple inference frameworks (Transformers, vLLM, SGLang, Unsloth Studio) and API integration patterns using OpenAI SDK compatibility.

Anthropic Research · 2d ago · 8 · research fine tuning deployment

Anthropic and AE Studio introduce GRAM (Gradient-Routed Auxiliary Modules), a novel technique for isolating dual-use knowledge (cybersecurity, virology, CBRN) into removable neural compartments within a single model, enabling cost-effective deployment of multiple capability-filtered versions without retraining separate models. This addresses a critical challenge in AI safety by making dangerous knowledge modular and controllable while preserving general model performance.

r/MachineLearning · 2d ago · 8 · research agent fine tuning tool prompt engineering

Research demonstrates a critical gap in LLM safety alignment: current text-classification-based guardrails fail against adversarial prompts that encode attacks in tool-call sequences rather than linguistic markers. The study evaluates multiple safety approaches (DPO, SafeDPO, training-free methods) against CVE-based attacks on MCP-enabled agents, showing current SOTA methods only block ~48% of attacks while training-free approaches achieve 3x baseline refusal rates without fine-tuning.

HuggingFace Blog · 3d ago · 6 · workflow deployment fine tuning tool

AWS SageMaker Studio now integrates one-click model imports from Hugging Face with auto-provisioned domains and pre-configured IAM permissions, eliminating setup friction for fine-tuning and deployment workflows. The integration includes new managed policies for model customization (SFT, DPO, RLVR, RLAIF) and real-time GPU quota visibility to streamline the path from discovery to enterprise deployment.

r/MachineLearning · 3d ago · 8 · research fine tuning open source

Novel defense against fine-tuning poisoning attacks that constrains model adaptation to a trusted subspace learned from clean LoRA adapters, making malicious updates geometrically unreachable. Evaluated on 196 public adapters with strong attack suppression while preserving legitimate adaptation, with open-source code and reproducible experiments available.

r/MachineLearning · 3d ago · 6 · research fine tuning

A researcher exploring RLHF dynamics poses an interesting thought experiment about training models to exhibit bad behavior and whether latent good behavior would emerge, suggesting alignment properties might be baked into pretraining rather than purely learned during fine-tuning. This touches on mechanistic interpretability and the nature of alignment in language models but lacks empirical validation or concrete technical contribution.

r/MachineLearning · 37d ago · 8 · research fine tuning workflow

On-policy distillation (OPD) is an emerging post-training technique used in recent frontier models (Qwen 3.6/3.7, GLM-5.1, DeepSeek-V4) that efficiently teaches models to avoid specific errors by injecting hint tokens into trajectories rather than requiring full rollout regeneration. The technique uses a separate model to identify mistakes in rollouts, then trains the main model via probability matching on the annotated trajectories—a practical efficiency win over naive reinforcement learning approaches.

Latent Space · 37d ago · 8 · new model research training fine tuning benchmark

Microsoft released MAI-Thinking-1 with a detailed 109-page technical report covering training without synthetic data or distillation, achieving strong benchmarks (97% AIME, 53% SWE-Bench Pro). The report includes rare transparency on scaling recipes, MFU numbers, training stack (SGLang, dspy.GEPA), and data mixture composition (50% code, 17.5% STEM/math each). Microsoft also introduced Frontier Tuning for RL-based model adaptation and multiple specialized models (MAI-Image-2.5, MAI-Code-1-Flash) with deployment into products.

r/MachineLearning · 38d ago · 6 · research fine tuning workflow

A software engineer shares detailed diagnostics of an AlphaZero training failure for 6x6 Othello, analyzing hyperparameters (c_puct, Dirichlet noise, temperature) and providing empirical metrics (value loss plateaus, policy entropy, KL-divergence trends) to understand why the model fails against simple baselines despite showing policy learning.

HuggingFace Blog · 38d ago · 8 · new model fine tuning research open source benchmark

DharmaOCR, a specialized structured OCR model, demonstrates that Direct Preference Optimization (DPO) applied as a second training stage after SFT can reduce text degeneration failure modes by 59.4% on average (up to 87.6%), addressing a structural limitation where SFT alone cannot adequately penalize repetition loops. The approach uses binary preference signals from the model's own failure outputs, offering a practical mitigation strategy applicable to objective tasks beyond alignment use cases.

r/MachineLearning · 39d ago · 7 · research benchmark fine tuning

This neuroscience-grounded paper empirically demonstrates a fundamental trade-off in learning rules: backpropagation rapidly destroys V1 alignment with human neural data after one epoch while excelling at higher visual areas, whereas local learning rules (PC, STDP) preserve early-layer alignment at the cost of weaker object representation. The degradation rate correlates with error signal globality, providing mechanistic insight into why biologically-plausible learning rules behave differently—relevant for anyone building interpretable models or exploring alternative training methods.

r/MachineLearning · 40d ago · 8 · fine tuning agent workflow tutorial

A practitioner asks for guidance on fine-tuning small LLMs with reasoning traces and tool-calling data, specifically about optimal training data structuring (conversation sampling strategy with selective loss masking) and whether to follow SFT with RL (PPO/DPO) for tool-use behavior. This is highly relevant for engineers building agentic systems, covering practical dataset preparation, training methodology, and reinforcement learning considerations for multi-step reasoning.

r/LocalLLaMA · 42d ago · 6 · fine tuning research open source

A new fine-tuned model combining Qwen 3.6 27B with reasoning traces for roleplay tasks, experimenting with whether chain-of-thought planning improves character consistency and narrative quality. The model uses DeepSeek-generated thinking traces validated through a judge model, paired with diverse persona training data from the Pantheon series.

r/MachineLearning · 43d ago · 8 · fine tuning research probe targeted open source

Research demonstrating that instruct-tuned LLMs internally distinguish correct from incorrect answers (0.76-0.88 AUROC) despite displaying uniform 99% confidence externally. The authors use LoRA fine-tuning on probe-extracted hidden state targets to align the model's expressed confidence with its internal knowledge, validated through activation patching experiments showing causal relationships (ρ=0.976) across 8 models (7B-70B). Code and pre-registration are publicly available.

r/MachineLearning · 44d ago · 8 · new model open source fine tuning deployment

Wall-OSS-0.5 is a new 4B Vision-Language-Action model using a gradient bridge approach where discrete action-token CE dominates VLM backbone updates while flow matching contributes ~5%, combined with Vision-Aligned RVQ tokenization for semantic grounding of action tokens and DMuon optimizer for distributed training. The release includes strong real-robot evaluations (82% on held-out deformable tasks zero-shot, 60.5% average after fine-tuning across 15 tasks) and open-source code, making it immediately relevant for practitioners building embodied AI systems.

r/LocalLLaMA · 44d ago · 6 · tool benchmark fine tuning inference

This article covers a merged 31B parameter model (Gemma-4-Harmonia) with practical integration guides for Transformers, vLLM, and SGLang, along with MMLU benchmark results showing 84.55% accuracy. While the technical implementation details on model merging and quantization are useful, the content is heavily focused on a niche fine-tuned variant rather than addressing core workflow or breakthrough capabilities.

r/MachineLearning · 44d ago · 7 · open source fine tuning rag dataset

Open-source UK GDPR compliance QA dataset (1K pairs) with SME-focused questions, detailed answers linked to specific articles/ICO guidance, and generation metadata. Generated via Qwen 14B + DeepSeek API, released in JSON/Parquet with MIT license—directly applicable for fine-tuning compliance assistants or building RAG systems for privacy tools.

r/LocalLLaMA · 46d ago · 6 · open source inference deployment fine tuning

Guide for using a fine-tuned Qwen 3.5-35B variant (with reduced content restrictions) across multiple inference frameworks including Transformers, vLLM, and SGLang, with MMLU benchmark results (83.72% accuracy) and multiple quantization options available. Practical for engineers looking to deploy modified open-source models with different inference backends.

r/MachineLearning · 47d ago · 6 · inference fine tuning deployment research

Call for papers for the 2nd Workshop on Efficient Reasoning at COLM 2026, covering practical topics like inference optimization (pruning, compression, KV-cache), efficient training/fine-tuning, and deployment of reasoning systems under resource constraints. Relevant for engineers working on cost-effective LLM inference and on-device reasoning, though this is primarily a conference submission announcement rather than technical content.