Feat(mlx): Add ORPO (loss_type='orpo') for text models to MLXTrainer#830

Open

BardiaKoopah wants to merge 7 commits into

unslothai:mainfrom

BardiaKoopah:feat/mlx-orpo

Commits on Jun 24, 2026

Add ORPO (loss_type='orpo') for text models to MLXTrainer
BardiaKoopah
committed
Add DPO (loss_type='dpo') with live LoRA-disable reference; share preference collator with ORPO
BardiaKoopah
committed

Commits on Jun 25, 2026

Add MLXDPOTrainer/MLXORPOTrainer + configs (TRL-style API) over loss_type; flag kept for back-compat
BardiaKoopah
committed

Commits on Jul 1, 2026

fix(mlx): ORPO SFT/NLL term over prompt+response to match TRL
BardiaKoopah
committed

Commits on Jul 2, 2026