RLHF Alternatives: Requisite Variety in Agent Training

RLHF alternatives through Ashby's law of requisite variety: why a rich environment lets a simple update rule replace a reward model, and when RLVR wins.