benitomartin/grumpy-chef-finetuning-dpo

Fine-tuning of LiquidAI/LFM2.5-1.2B-Base to behave as a grumpy Italian chef, using Supervised Fine-Tuning (SFT) followed by Direct Preference Optimization (DPO)

语言：Jupyter Notebook · GitHub 星标：9 · Fork：0

在 GitHub 上查看原仓库