All Things RLHF: How We Actually Teach AI to Care What Humans Think"ChatGPT feels different." I heard that phrase about a hundred times in late 2022. Everyone was groping for why it felt qualitatively better than GPT-3, which by parameter count and pre-training data
