Akshint0407/Nano-R1

This project demonstrates the process of fine-tuning the Qwen2.5-3B-Instruct model using GRPO (Generalized Reward Policy Optimization) on the GSM8K dataset.

语言：Jupyter Notebook · GitHub 星标：18 · Fork：2

话题：adapters · grpo · huggingface · python · qwen2-5 · safetensors · text-generation-inference · transformer

在 GitHub 上查看原仓库