7_2024_april_ultrainteract_preprint

Check out our newly released paper, introducing a SOTA reasoning generalist Eurus model and UltraInteract (data)! UltraInteract collects trees (We love trees 🌲!) of multi-turn interactions with preference pairs that support both SFT and preference learning for challenging reasoning problems!