Anchored SFT KL Divergence Fine Tuning: Unifying DFT and Trust Regions
Master anchored sft kl divergence fine tuning, combining probability-weighted loss with trust region sft lora and kl regularized supervised fine tuning.
Master anchored sft kl divergence fine tuning, combining probability-weighted loss with trust region sft lora and kl regularized supervised fine tuning.