409 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Frank Lee	da9b00e808	added dataset processing scripts (#8) ... * added dataset processing scripts * added dataset processing scripts	2024-02-23 11:26:28 +08:00
Hongxin Liu	603b193d38	[feature] apply padding mask to loss (#7)	2024-02-23 10:56:17 +08:00
Hongxin Liu	6f30a56d52	[feature] add cross attn and support grad checkpoint (#6) ... * [feature] support cross attn * [feature] support grad checkpoint * rename method	2024-02-22 14:15:48 +08:00
Frank Lee	9eaf57fdf8	added pre-commit (#5) ... * added pre-commit * polish	2024-02-22 10:54:40 +08:00
Hongxin Liu	37a296ad5b	[faeture] update modeling (#4)	2024-02-21 19:06:49 +08:00
Hongxin Liu	e33d4c0b8c	[feature] refactor training script (#3) ... * [feature] add data utils and patch emb * [feature] refactor training script	2024-02-21 17:55:36 +08:00
Hongxin Liu	2561963140	[feature] add data process script (#2) ... * [misc] update gitignore * [feature] add data process script	2024-02-21 11:33:36 +08:00
Frank Lee	01e5da88b5	[init] migrate dit repo (#1)	2024-02-20 11:19:59 +08:00
Frank Lee	f00daaf62d	Initial commit	2024-02-20 11:01:34 +08:00