Explore-Exploit Tradeoff Inside Online SFT Loops

Why online SFT turns every trajectory into an explore-exploit tradeoff: the value decomposition behind instrumental strategies in self-training agents.