Tweet fixado
🔥 Releasing BRAG: High-Performance RAG Model Trained In $25
🚀 We’re thrilled to announce the launch of our RAG models, collectively known as BRAG—a series of SLMs (3 SLMs and 1 Ultra SLM) specifically trained for Retrieval Augmented Generation (RAG).
1️⃣ BRAG-Qwen2-7b-v0.1
2️⃣ BRAG-Llama-3.1-8b-v0.1
3️⃣ BRAG-Llama-3-8b-v0.1
4️⃣ BRAG-Qwen2-1.5b-v0.1
🌟 Our models outperform Cohere’s Command R+, Qwen2, Llama3.1, and Llama3 Instruct models and closely matched the performance of GPT-4-Turbo and Nvidia’s ChatQA-1.5-8B on ChatRAG-Bench.
💵 Each model was trained in less than $25.
🔍 More interesting details on datasets and training procedure in our release technical report: shorturl.at/IrCE1
🙌 A huge thank you to @HamelHusain, @dan_s_becker, and @charles_irl for the credits on @modal_labs via the LLM Fine-tuning course.
This work is done in collaboration with @nlpguy_ under maximalists.ai
English
