r/MachineLearning · 2h ago · 8 · new model open source embedding inference deployment benchmark

Vultr released the VultronRetriever family of open-source embedding models ranking #1 on MTEB leaderboard, with three size variants (8B Prime, 4.5B Core, 0.8B Flash) optimized for inference efficiency and edge deployment including offline iPhone execution. The models demonstrate significant improvements in speed, storage footprint, and performance-per-parameter with the novel Hydra Architecture enabling late interaction retrieval at reduced memory costs.

r/MachineLearning · 63d ago · 7 · rag embedding open source deployment

A software engineer built a Steam game recommender system using LLM-powered review analysis to extract nuanced game characteristics (vibes, mechanics, focus percentages) into vector embeddings, then implemented retrieval using PostgreSQL and Chroma DB with a React frontend. The project demonstrates practical RAG and embedding techniques for creating explainable recommendations that surface why games are suggested, avoiding collaborative filtering homogeneity.