nicolabs/Open-Sora
1
0
Fork 0
mirror of https://github.com/hpcaitech/Open-Sora.git synced 2026-04-17 22:56:10 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
Open-Sora/open_sora/utils
History
Hongxin Liu 97c089daec
[feature] impl ulysses-style seq parallel (#20) 
* [feature] add ulysses style sp attn

* [test] add sp attn test

* [feature] add zero sp plugin

* [hotfix] fix sp backward

* [test] add test for dit model
2024-03-01 14:42:06 +08:00
..
__init__.py
comm.py [feature] impl ulysses-style seq parallel (#20) 2024-03-01 14:42:06 +08:00
data.py [feature] impl ulysses-style seq parallel (#20) 2024-03-01 14:42:06 +08:00
plugin.py [feature] impl ulysses-style seq parallel (#20) 2024-03-01 14:42:06 +08:00