home/categories/machine-learning/vuralserhat86-antigravity-agentic-skills-skills-model-finetuning-skill-md
machine-learningdata-ai

model-finetuning

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

vuralserhat86
maintainer
vuralserhat86
Updated 1/3/2026
Stars
18
Forks
8
quick start

Installation and usage

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use model-finetuning