Commit graph

701 commits

Author SHA1 Message Date
pxy
f756aa30e0 update readme 2024-03-16 15:52:29 +08:00
pxy
e33599cc2d modify notations 2024-03-16 15:51:50 +08:00
pxy
bb844d911f update config 2024-03-16 15:47:23 +08:00
pxy
54d5579a0d modify notations 2024-03-16 15:39:47 +08:00
xyupeng
87fbf1619c Merge pull request #72 from hpcaitech/docs/readme
update docs
2024-03-16 15:37:45 +08:00
Zangwei Zheng
78bdaec8f6 update docs 2024-03-16 15:32:08 +08:00
Zangwei Zheng
0a3a3d4e10 modify readme 2024-03-15 22:24:57 +08:00
Zheng Zangwei (Alex Zheng)
d851a85535 format (#69) 2024-03-15 22:16:20 +08:00
Zheng Zangwei (Alex Zheng)
0ba56f5309 first commit (#67) 2024-03-15 22:06:36 +08:00
xyupeng
9aab3ad343 added open_sora package (#66) 2024-03-15 22:00:46 +08:00
Frank Lee
ddbb130fe7 added configs and tests (#65) 2024-03-15 21:53:49 +08:00
Frank Lee
c4c5d64e49 migrate some new files (#64) 2024-03-15 21:49:38 +08:00
Frank Lee
2f87a9af75
removed old files (#63) 2024-03-15 21:48:36 +08:00
Hongxin Liu
0a4a09185e
[doc] update img link.md (#52) 2024-03-08 17:01:56 +08:00
Ikko Eltociear Ashimine
fa5b8d2a22
[hotfix] update latte_t2v.py (#44)
alrady -> already
2024-03-08 12:19:48 +08:00
ver217
8cc26d3d9c [doc] update readme 2024-03-07 20:10:07 +08:00
ver217
0106e62555 [feature] impl adaln model arch 2024-03-07 20:04:57 +08:00
Hongxin Liu
0afa188eeb
[hotfix] fix ema model init (#43) 2024-03-07 17:26:53 +08:00
Hongxin Liu
fed3bcba94
[misc] update requirements (#42) 2024-03-07 16:36:24 +08:00
Ganesh Krishnan
c33cd38b32
[doc] update required third-party library (#38)
timm is also required
2024-03-07 16:10:19 +08:00
Hongxin Liu
1706e16359
[doc] add acknowledge (#30) 2024-03-05 13:42:33 +08:00
fastalgo
126896afcb
Update README.md 2024-03-04 21:46:25 +08:00
Sze-qq
a5f3ceefa7
Merge pull request #26 from hpcaitech/binmakeswell-patch-1
[doc] add news
2024-03-04 20:12:13 +08:00
binmakeswell
b9d33e9633
[doc] add news 2024-03-04 18:14:42 +08:00
binmakeswell
321722d016
[doc] add inference guide
[doc] add inference guide
2024-03-04 16:29:52 +08:00
ver217
10f1ecb1c6 [doc] add inference guide 2024-03-04 16:09:26 +08:00
binmakeswell
901f43726c
[doc] add summary and benchmark (#24) 2024-03-04 15:51:04 +08:00
Hongxin Liu
a05e2a3d68
[hotfix] update benchmark for ddp (#23) 2024-03-04 14:31:41 +08:00
Frank Lee
9648d53d4d
added latte sampling (#22)
* added latte sampling

* polish
2024-03-04 10:43:22 +08:00
Hongxin Liu
91275b2b5e
[feature] impl fastseq-style seq parallel (#21)
* [feature] add fastseq-style sp attn

* [feature] add overlap fastseq

* [test] add test for self attn

* [feature] update dit model to fit fastseq

* [polish] refactor attn

* [feature] update train & benchmark script

* [polish] update benchmark script

* [polish] update benchmark script
2024-03-01 17:31:59 +08:00
Hongxin Liu
97c089daec
[feature] impl ulysses-style seq parallel (#20)
* [feature] add ulysses style sp attn

* [test] add sp attn test

* [feature] add zero sp plugin

* [hotfix] fix sp backward

* [test] add test for dit model
2024-03-01 14:42:06 +08:00
Frank Lee
3bea560af3
fixed training script (#19) 2024-02-29 16:07:34 +08:00
Frank Lee
c1767416bf
added missing function call (#18) 2024-02-29 14:27:25 +08:00
Hongxin Liu
56cabd8e5e
[feature] add benchmark script (#17)
* [hotfix] fix vae video compressor

* [feature] add benchmark script
2024-02-29 14:27:17 +08:00
Hongxin Liu
0e60f3375f
[feature] support normal sample without cfg (#16)
* [hotfix] fix drop sample

* [feature] support lr scheduler

* [feature] support normal sample without cfg

* [feature] support multi video compressor

* [feature] support multi video compressor
2024-02-29 10:28:30 +08:00
Hongxin Liu
e02f6286de
[hotfix] fix sample and update training script (#15)
* [hotfix] fix sample

* [hotfix] fix sample
2024-02-28 15:01:53 +08:00
Hongxin Liu
14db4566e1
[feature] support ada ln modulation, token concat and cfg (#14)
* [feature] support ada ln modulation

* [feature] token concat

* [feature] support cfg
2024-02-27 16:55:11 +08:00
Frank Lee
0c05cd2e9d
refactored code into a package (#13) 2024-02-27 11:58:22 +08:00
Frank Lee
a33c656c80
added training scripts and readme (#12)
* added training scripts and readme

* polish
2024-02-26 17:47:19 +08:00
Hongxin Liu
9644774813
[feature] support grad accumulation and tensorboard (#11)
* [feature] support grad accumulation

* [feature] support tensorboard

* [feature] support lr config
2024-02-26 17:06:06 +08:00
Hongxin Liu
adba00f151
[feature] update diffusion pipeline and sample script (#10)
* [feature] diffusion natively support video format

* [feature] add timestamp embedding

* [feature] support learn from raw video

* [feature] update sample script
2024-02-26 11:23:09 +08:00
Hongxin Liu
6f887f453b
[hotfix] fix vqvae output process (#9) 2024-02-23 13:11:24 +08:00
Frank Lee
da9b00e808
added dataset processing scripts (#8)
* added dataset processing scripts

* added dataset processing scripts
2024-02-23 11:26:28 +08:00
Hongxin Liu
603b193d38
[feature] apply padding mask to loss (#7) 2024-02-23 10:56:17 +08:00
Hongxin Liu
6f30a56d52
[feature] add cross attn and support grad checkpoint (#6)
* [feature] support cross attn

* [feature] support grad checkpoint

* rename method
2024-02-22 14:15:48 +08:00
Frank Lee
9eaf57fdf8
added pre-commit (#5)
* added pre-commit

* polish
2024-02-22 10:54:40 +08:00
Hongxin Liu
37a296ad5b
[faeture] update modeling (#4) 2024-02-21 19:06:49 +08:00
Hongxin Liu
e33d4c0b8c
[feature] refactor training script (#3)
* [feature] add data utils and patch emb

* [feature] refactor training script
2024-02-21 17:55:36 +08:00
Hongxin Liu
2561963140
[feature] add data process script (#2)
* [misc] update gitignore

* [feature] add data process script
2024-02-21 11:33:36 +08:00
Frank Lee
01e5da88b5
[init] migrate dit repo (#1) 2024-02-20 11:19:59 +08:00