If you were impressed with GPT-4, take a look at Zephyr 7B.
A new language model Zephyr 7B, it’s performing better than Chat GPT in some tests.
Designed to be a helpful assistant.
Uses DPO. A way of fine tuning language models based on human preferences, rather than labels or rewards. To get better based on what humans like.
