nicolabs/Open-Sora
1
0
Fork 0
mirror of https://github.com/hpcaitech/Open-Sora.git synced 2026-04-25 01:48:45 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
Open-Sora/tests
History
Hongxin Liu 91275b2b5e
[feature] impl fastseq-style seq parallel (#21) 
* [feature] add fastseq-style sp attn

* [feature] add overlap fastseq

* [test] add test for self attn

* [feature] update dit model to fit fastseq

* [polish] refactor attn

* [feature] update train & benchmark script

* [polish] update benchmark script

* [polish] update benchmark script
2024-03-01 17:31:59 +08:00
..
test_model.py [feature] impl fastseq-style seq parallel (#21) 2024-03-01 17:31:59 +08:00
test_sp_attn.py [feature] impl fastseq-style seq parallel (#21) 2024-03-01 17:31:59 +08:00