all agent alignment api update architecture benchmark dataset deployment embedding fine tuning hype inference infrastructure library model ner new model open source optimization prompt engineering quantization rag research security testing tool training tutorial visualization workflow
Llamafile lets you distribute and run LLMs with a single file
HN AI Stories · 902d ago · 8 · tool open source deployment inference

llamafile 0.10.0 update from Mozilla.ai enables distributing and running open LLMs as single-file executables across platforms with no installation required, now with improved alignment to latest llama.cpp versions and support for more recent models. The tool also includes whisperfile for single-file speech-to-text capabilities, making local LLM deployment significantly more accessible for developers.