When a Predictive Feature Becomes a Policy: A Causal Failure Mode in RLHF
Published:
One subtle failure mode in RLHF starts before reinforcement learning even begins.
Published:
One subtle failure mode in RLHF starts before reinforcement learning even begins.