Post-Training

AutoAlign: Automated Alignment for Large Language Models
An open-source toolkit for automated alignment of Large Language Models with human intentions and values.
Xinyu Lu, Dong Xu, Chunkang Zhang, Xinyan Guan, Junxiang Wang, Qingyu Zhang, Pengbo Wang, Yingzhi Mao, Hao Xiang, Xueru Wen, Zichao Li, Yaojie Lu, Hongyu Lin, Le Sun, Xianpei Han
PDF Cite Code
AutoAlign: Automated Alignment for Large Language Models
AutoAlign - Automated Alignment Toolkit for LLMs
An open-source toolkit for automated alignment of Large Language Models. I was responsible for adapting and optimizing SFT/DPO algorithms for the Megatron framework.
Paper Code
AutoAlign - Automated Alignment Toolkit for LLMs