Hongxin Liu
97c089daec
[feature] impl ulysses-style seq parallel ( #20 )
...
* [feature] add ulysses style sp attn
* [test] add sp attn test
* [feature] add zero sp plugin
* [hotfix] fix sp backward
* [test] add test for dit model
2024-03-01 14:42:06 +08:00
Frank Lee
3bea560af3
fixed training script ( #19 )
2024-02-29 16:07:34 +08:00
Frank Lee
c1767416bf
added missing function call ( #18 )
2024-02-29 14:27:25 +08:00
Hongxin Liu
56cabd8e5e
[feature] add benchmark script ( #17 )
...
* [hotfix] fix vae video compressor
* [feature] add benchmark script
2024-02-29 14:27:17 +08:00
Hongxin Liu
0e60f3375f
[feature] support normal sample without cfg ( #16 )
...
* [hotfix] fix drop sample
* [feature] support lr scheduler
* [feature] support normal sample without cfg
* [feature] support multi video compressor
* [feature] support multi video compressor
2024-02-29 10:28:30 +08:00
Hongxin Liu
e02f6286de
[hotfix] fix sample and update training script ( #15 )
...
* [hotfix] fix sample
* [hotfix] fix sample
2024-02-28 15:01:53 +08:00
Hongxin Liu
14db4566e1
[feature] support ada ln modulation, token concat and cfg ( #14 )
...
* [feature] support ada ln modulation
* [feature] token concat
* [feature] support cfg
2024-02-27 16:55:11 +08:00
Frank Lee
0c05cd2e9d
refactored code into a package ( #13 )
2024-02-27 11:58:22 +08:00
Frank Lee
a33c656c80
added training scripts and readme ( #12 )
...
* added training scripts and readme
* polish
2024-02-26 17:47:19 +08:00
Hongxin Liu
9644774813
[feature] support grad accumulation and tensorboard ( #11 )
...
* [feature] support grad accumulation
* [feature] support tensorboard
* [feature] support lr config
2024-02-26 17:06:06 +08:00
Hongxin Liu
adba00f151
[feature] update diffusion pipeline and sample script ( #10 )
...
* [feature] diffusion natively support video format
* [feature] add timestamp embedding
* [feature] support learn from raw video
* [feature] update sample script
2024-02-26 11:23:09 +08:00
Hongxin Liu
6f887f453b
[hotfix] fix vqvae output process ( #9 )
2024-02-23 13:11:24 +08:00
Frank Lee
da9b00e808
added dataset processing scripts ( #8 )
...
* added dataset processing scripts
* added dataset processing scripts
2024-02-23 11:26:28 +08:00
Hongxin Liu
603b193d38
[feature] apply padding mask to loss ( #7 )
2024-02-23 10:56:17 +08:00
Hongxin Liu
6f30a56d52
[feature] add cross attn and support grad checkpoint ( #6 )
...
* [feature] support cross attn
* [feature] support grad checkpoint
* rename method
2024-02-22 14:15:48 +08:00
Frank Lee
9eaf57fdf8
added pre-commit ( #5 )
...
* added pre-commit
* polish
2024-02-22 10:54:40 +08:00
Hongxin Liu
37a296ad5b
[faeture] update modeling ( #4 )
2024-02-21 19:06:49 +08:00
Hongxin Liu
e33d4c0b8c
[feature] refactor training script ( #3 )
...
* [feature] add data utils and patch emb
* [feature] refactor training script
2024-02-21 17:55:36 +08:00
Hongxin Liu
2561963140
[feature] add data process script ( #2 )
...
* [misc] update gitignore
* [feature] add data process script
2024-02-21 11:33:36 +08:00
Frank Lee
01e5da88b5
[init] migrate dit repo ( #1 )
2024-02-20 11:19:59 +08:00
Frank Lee
f00daaf62d
Initial commit
2024-02-20 11:01:34 +08:00
