Feat(mlx): GRPO support for MLX#832

Open

BardiaKoopah wants to merge 9 commits into

unslothai:mainfrom

BardiaKoopah:feat/mlx-grpo

Commits on Jun 24, 2026

Add ORPO (loss_type='orpo') for text models to MLXTrainer
BardiaKoopah
committed
Add DPO (loss_type='dpo') with live LoRA-disable reference; share preference collator with ORPO
BardiaKoopah
committed

Commits on Jun 25, 2026

Add MLXDPOTrainer/MLXORPOTrainer + configs (TRL-style API) over loss_type; flag kept for back-compat
BardiaKoopah
committed

Commits on Jul 1, 2026