Hongxin Liu
a05e2a3d68
[hotfix] update benchmark for ddp ( #23 )
2024-03-04 14:31:41 +08:00
Frank Lee
9648d53d4d
added latte sampling ( #22 )
...
* added latte sampling
* polish
2024-03-04 10:43:22 +08:00
Hongxin Liu
91275b2b5e
[feature] impl fastseq-style seq parallel ( #21 )
...
* [feature] add fastseq-style sp attn
* [feature] add overlap fastseq
* [test] add test for self attn
* [feature] update dit model to fit fastseq
* [polish] refactor attn
* [feature] update train & benchmark script
* [polish] update benchmark script
* [polish] update benchmark script
2024-03-01 17:31:59 +08:00
Hongxin Liu
97c089daec
[feature] impl ulysses-style seq parallel ( #20 )
...
* [feature] add ulysses style sp attn
* [test] add sp attn test
* [feature] add zero sp plugin
* [hotfix] fix sp backward
* [test] add test for dit model
2024-03-01 14:42:06 +08:00
Hongxin Liu
56cabd8e5e
[feature] add benchmark script ( #17 )
...
* [hotfix] fix vae video compressor
* [feature] add benchmark script
2024-02-29 14:27:17 +08:00
Hongxin Liu
0e60f3375f
[feature] support normal sample without cfg ( #16 )
...
* [hotfix] fix drop sample
* [feature] support lr scheduler
* [feature] support normal sample without cfg
* [feature] support multi video compressor
* [feature] support multi video compressor
2024-02-29 10:28:30 +08:00
Hongxin Liu
14db4566e1
[feature] support ada ln modulation, token concat and cfg ( #14 )
...
* [feature] support ada ln modulation
* [feature] token concat
* [feature] support cfg
2024-02-27 16:55:11 +08:00
Frank Lee
0c05cd2e9d
refactored code into a package ( #13 )
2024-02-27 11:58:22 +08:00
