nicolabs/Open-Sora
1
0
Fork 0
mirror of https://github.com/hpcaitech/Open-Sora.git synced 2026-05-21 11:59:01 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
1308 commits 8 branches 4 tags 504 MiB
Commit graph

460 commits

Author SHA1 Message Date
zhengzangw
3a01cb440d [feat] inference for rf 2024-05-13 11:39:16 +00:00
zhengzangw
ff34f2bdaf Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-13 06:33:23 +00:00
zhengzangw
6194da6504 [fix] update inference and datautil 2024-05-13 06:33:12 +00:00
Shen Chenhui
b8d99d7a8b fixed (#98) 
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
 2024-05-13 11:58:06 +08:00
zhengzangw
11faae8db6 [fix] exception handling for dataset 2024-05-12 14:08:37 +00:00
zhengzangw
74dfaa879c [fix] ema ckpt save 2024-05-12 05:15:06 +00:00
Zheng Zangwei (Alex Zheng)
3893af0a62 update stdit dtype (#392) 2024-05-11 15:23:39 +08:00
Zheng Zangwei (Alex Zheng)
a6a0325b47 change flashattn to flash_attn (#387) 2024-05-10 14:36:31 +08:00
zhengzangw
e870139f8f Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-10 03:19:48 +00:00
zhengzangw
1db24970d5 updated 2024-05-10 03:19:38 +00:00
Zangwei Zheng
4f27cb51fc Merge branch 'main' into dev/v1.2 2024-05-09 16:49:24 +08:00
zhengzangw
2a55d672a7 [feat] update logging and bucket 2024-05-09 08:07:56 +00:00
Shen Chenhui
89a90e6b3d Hotfix/latent size calc std (#96) 
* save progress

* format

* clean config

---------

Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
 2024-05-09 14:12:29 +08:00
zhengzangw
e9db7b3af1 update training script 2024-05-09 05:53:19 +00:00
zhengzangw
31228fe9c8 [refactor] fix train warnings 2024-05-09 03:10:26 +00:00
zhengzangw
322e566aed update 2024-05-09 03:10:26 +00:00
Zangwei Zheng
eb5ff82fc5 quick update 2024-05-09 11:09:52 +08:00
zhangyongshun
2ec756a240 fix ar defination inconsistency (#375) 2024-05-08 19:48:56 +08:00
Shen Chenhui
dc7b7fd64a fix bug (#95) 
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
 2024-05-08 17:39:21 +08:00
ChangeFWorld
338bd83f24 mask added, no test due to occupation of gpus (#90) 
* mask added, no test due to occupation of gpus

* mask fix

---------

Co-authored-by: ChangeFWorld <aicfw.li@gmail.com>
 2024-05-08 16:32:36 +08:00
Zheng Zangwei (Alex Zheng)
f047d5786a [refactor] clean train.py code (#94) 2024-05-08 16:07:57 +08:00
Frank Lee
82f15b30f9 fixed checkpoint (#92) 2024-05-07 18:34:22 +08:00
Frank Lee
fe19568a49 fixed race condition in exp workspace (#91) 2024-05-07 17:17:43 +08:00
Zangwei Zheng
fea2541c70 [docs] update readme 2024-05-07 16:27:21 +08:00
Zangwei Zheng
8564074229 [exp] 2024-05-07 15:41:52 +08:00
Frank Lee
06693a8187 fixed v3 train config (#89) 2024-05-07 15:13:20 +08:00
Zangwei Zheng
917643d5bd [wip] 2024-05-07 14:51:11 +08:00
Shen-Chenhui
8e37e7d76e Merge branch 'vae-clean-new' into dev/v1.2 2024-05-07 06:39:57 +00:00
FrankLeeeee
ec88d2d54e resolved conflicts 2024-05-07 03:08:41 +00:00
Frank Lee
d599fd75b3 adapted pretrained model to training (#371) 2024-05-07 10:37:06 +08:00
Zangwei Zheng
10657621ef [fix] random mask may have nothing to learn 2024-05-06 17:34:08 +08:00
Zangwei Zheng
c863c1d5e9 [exp] complete config 2024-05-06 16:56:46 +08:00
Shen-Chenhui
1522f683b8 fix padding 2024-05-06 07:49:56 +00:00
Shen-Chenhui
041b14f138 fix padding error;add chunck inference script 2024-05-06 07:47:12 +00:00
Zangwei Zheng
eefb351333 [exp] update config bucket 2024-05-06 14:32:28 +08:00
Frank Lee
19911b99b8 converted model to hf format (#366) 2024-05-06 14:15:04 +08:00
Zangwei Zheng
5f6c9bfceb [exp] update config 2024-05-06 10:29:21 +08:00
zhengzangw
f77370fff6 [feat] vae micro frame 2024-05-05 15:25:17 +00:00
Zangwei Zheng
c4f17b41fc [exp] update config 2024-05-05 20:26:26 +08:00
Zheng Zangwei (Alex Zheng)
f941fa95dc Merge branch 'dev/v1.2' into vae-clean-new 2024-05-04 20:26:42 +08:00
Zangwei Zheng
d07003b0cd [fix] rf inference scale 2024-05-04 20:23:32 +08:00
zhengzangw
4543bc217c [feat] image generation 2024-05-04 10:10:54 +00:00
Zangwei Zheng
b26beabeb7 [exp] 2024-05-04 17:44:04 +08:00
Zangwei Zheng
c23fe85a70 [exp] 2024-05-04 16:16:06 +08:00
Zangwei Zheng
fd24a8c4f9 update adaptation 2024-05-04 11:51:31 +08:00
Zangwei Zheng
2b6b5fe767 Merge branch 'dev/v1.2' into dev/v1.2-exp 2024-05-03 14:37:31 +08:00
ChangeFWorld
683c0f74b7 Merge pull request #83 from hpcaitech/dev/Rflow 
Dev/rflow
 2024-05-03 14:14:00 +08:00
Tianyi
659e054e3a assert remove 2024-05-03 05:54:03 +00:00
Tianyi
fb4aede778 mask and weight support for rf training 2024-05-03 05:48:14 +00:00
Shen-Chenhui
d8fab103f4 added disc 2024-05-02 09:48:30 +00:00
Shen-Chenhui
bcb997502e enable disc 2024-05-02 17:28:45 +08:00
Shen-Chenhui
b35b933841 add disc 2024-05-02 16:32:19 +08:00
Zangwei Zheng
00e21e9fed [wip] adapt multi-res 2024-05-02 15:27:03 +08:00
zhengzangw
02904b4f29 updated 2024-05-02 03:46:01 +00:00
zhengzangw
f7a4fcfc3f updated 2024-04-30 09:46:27 +00:00
zhengzangw
b89c072eb5 [fix] micro batch size not for training 2024-04-30 09:20:08 +00:00
zhengzangw
ace37cf7c7 refactor 2024-04-30 08:13:20 +00:00
zhengzangw
41e276f5ef updated 2024-04-30 06:19:40 +00:00
周钰坤
bf633f3e68 Update pixart.py 2024-04-30 13:53:17 +08:00
周钰坤
34711b7bd2 update 2024-04-30 13:37:25 +08:00
周钰坤
59591d8afc update 2024-04-30 13:36:41 +08:00
zhengzangw
b2f302b379 [wip] try vae 2024-04-29 17:02:22 +00:00
Shen-Chenhui
e3b84247c1 disable t-conv for t=1 2024-04-29 20:06:18 +08:00
Shen-Chenhui
c59b499085 Merge branch 'vae-clean-new' of https://github.com/hpcaitech/Open-Sora-dev into vae-clean-new 2024-04-29 18:10:03 +08:00
Shen-Chenhui
c631358bbf add z nll loss 2024-04-29 18:09:42 +08:00
zhengzangw
9632b5bcf8 merged 2024-04-29 10:07:09 +00:00
zhengzangw
5c8139521a update 2024-04-29 10:02:42 +00:00
Shen-Chenhui
b78b469420 fix merge 2024-04-29 17:58:59 +08:00
Shen-Chenhui
f81d8648cf move out losses to different file 2024-04-29 17:53:03 +08:00
zhengzangw
a2dc903863 update 2024-04-29 09:41:39 +00:00
Shen-Chenhui
4d69671663 clean up code 2024-04-29 17:18:45 +08:00
zhengzangw
1171e5b6f9 update config 2024-04-29 07:27:15 +00:00
Shen-Chenhui
98de78910d config 2024-04-29 15:21:54 +08:00
Shen-Chenhui
7811b8e99a add Nlayer 3D discriminator 2024-04-29 14:18:57 +08:00
Shen-Chenhui
069ffcc4e3 use 3 layer disc 2024-04-29 14:03:18 +08:00
zhengzangw
f3dcb4d6fb complete 3b backbone 2024-04-29 06:00:14 +00:00
Shen-Chenhui
8b465b04c5 add vae subfolder support 2024-04-29 11:32:39 +08:00
Tianyi
07cbe11cb6 Merge branch 'main' of https://github.com/hpcaitech/Open-Sora-dev into dev/Rflow 2024-04-28 05:59:20 +00:00
zhengzangw
84465c0e44 add config for PixArt 1.6B 2024-04-27 13:41:21 +00:00
zhengzangw
7b08fb289c [fix] pixart-sigma 2024-04-27 13:19:00 +00:00
zhengzangw
d6a16a858e [wip] multiple resolution 2024-04-27 11:43:15 +00:00
zhengzangw
f551321e49 Merge branch 'main' into dev/v1.2 2024-04-27 11:40:56 +00:00
Shen-Chenhui
6fb4e3cd22 debug 2024-04-27 17:18:19 +08:00
Shen-Chenhui
c9785342c2 add evals 2024-04-27 16:14:11 +08:00
Zheng Zangwei (Alex Zheng)
8f109b7117 fix qknorm bug (#80) 2024-04-27 15:52:17 +08:00
YuKun Zhou
fddd08243b Update ckpt_utils.py (#79) 
* Update ckpt_utils.py

* update

* Update 1x256x256.py

* update

* update

* Update blocks.py

* update

* Update 1x2048x2048.py
 2024-04-27 15:43:50 +08:00
Shen-Chenhui
38c46ac721 fix bug 2024-04-27 15:25:03 +08:00
Shen Chenhui
b5a3334caf fix dataset loading 2024-04-27 14:52:52 +08:00
Shen Chenhui
3e7ba9a46d use modulelist 2024-04-27 14:02:20 +08:00
zhengzangw
478b585024 [wip] debug vae 2024-04-26 07:27:26 +00:00
zhengzangw
a4652a8aef Merge branch 'main' into vae 2024-04-26 06:56:22 +00:00
zhengzangw
7fcf0c6bfd fix qknorm bug 2024-04-26 03:59:50 +00:00
Shen-Chenhui
576b44d98e add lecam storage support 2024-04-26 10:34:00 +08:00
Tianyi
006ab8f35a Merge branch 'main' of https://github.com/hpcaitech/Open-Sora-dev into dev/Rflow 2024-04-25 03:16:54 +00:00
Frank Lee
367ae02e7c updated gradio app (#74) 2024-04-24 22:30:36 +08:00
zhengzangw
44e618bbbc a bunch of update 2024-04-24 09:23:24 +00:00
Shen-Chenhui
9683ec66c7 inference script update 2024-04-24 17:04:53 +08:00
Shen-Chenhui
0138be6e21 grad penalty expr 2024-04-24 14:52:47 +08:00
zhengzangw
9e0b314dab update config 2024-04-24 02:33:27 +00:00
Shen-Chenhui
988bc3bb65 config lc gp 2024-04-24 10:03:58 +08:00
Zangwei Zheng
e009e89e1a add start from scratch 2024-04-23 19:24:22 +08:00
Shen-Chenhui
48e3a84ba6 enable r1 gradient penalty 2024-04-23 17:51:50 +08:00
zhengzangw
cf95f41002 update docs 2024-04-23 09:26:10 +00:00
Shen-Chenhui
d565477680 disable non-master print 2024-04-23 14:43:02 +08:00
Shen-Chenhui
d0d7da36ea silence lpips 2024-04-23 11:44:33 +08:00
Shen-Chenhui
2ac952bb71 8 GPU training config 2024-04-23 11:30:40 +08:00
Shen-Chenhui
486593f137 LeCam Loss working 2024-04-23 10:58:09 +08:00
Shen-Chenhui
16b0149fc4 lecam config 2024-04-23 09:59:12 +08:00
Shen-Chenhui
f4fe9b5eca add lecam 2024-04-23 09:22:05 +08:00
Zangwei Zheng
3944e93065 update training config 2024-04-22 12:05:59 +08:00
zhengzangw
8931efccd7 update config 2024-04-22 03:43:31 +00:00
Zangwei Zheng
fea6aba655 hotfix config args 2024-04-21 19:50:51 +08:00
zhengzangw
da345719c7 use qk-norm 2024-04-21 11:40:20 +00:00
zhengzangw
2b42ca82d8 [wip] prompt with json 2024-04-21 11:07:59 +00:00
zhengzangw
6073af6444 merge video edit 2024-04-20 15:47:48 +00:00
Zheng Zangwei (Alex Zheng)
341b12f9bf Dev/v1.0.1 (#58) 
* update (#57)

* update

* update datautil

* add VBench prompt

* update eval

* update eval

* update intepolation

* add vbench eval

* Dev/sdedit implementation (#56)

* Update utils.py

* update

* update

* update

---------

Co-authored-by: YuKun Zhou <90625606+1zeryu@users.noreply.github.com>
 2024-04-20 21:23:10 +08:00
zhengzangw
d262f14a24 update 2024-04-20 02:43:38 +00:00
Zangwei Zheng
74aade586a [exp] update 2024-04-19 17:56:02 +08:00
Shen-Chenhui
96a42e08db config 2024-04-19 17:49:50 +08:00
Zangwei Zheng
15f9d702ed [exp] update 2024-04-19 17:43:44 +08:00
Zangwei Zheng
1877a14abc load ema strict=False 2024-04-19 16:55:03 +08:00
Zangwei Zheng
8bf34f4418 add local_files_only 2024-04-19 16:47:26 +08:00
Shen-Chenhui
4c46972b64 debug 2024-04-19 15:59:21 +08:00
Shen-Chenhui
19187b70f5 allow specifying outputs in command line 2024-04-19 15:56:04 +08:00
Zangwei Zheng
dce2ef4a1c [exp] new config 2024-04-19 15:21:00 +08:00
Shen-Chenhui
78caeea999 add support and config for z channel 4 2024-04-19 15:14:53 +08:00
Shen-Chenhui
b16001e5e3 debug 2024-04-19 14:28:53 +08:00
Shen-Chenhui
89a58b8e15 debug 2024-04-19 14:23:57 +08:00
Shen-Chenhui
1c3e910fc6 allow loading of discriminator in inference 2024-04-19 14:19:29 +08:00
Shen-Chenhui
6581556997 pipeline config 2024-04-19 13:36:47 +08:00
Zheng Zangwei (Alex Zheng)
d2a782efac Dev/fps (#55) 
* support fps

* update fps
 2024-04-19 13:18:52 +08:00
Zangwei Zheng
0e6c15d50b Merge branch 'main' into dev/v1.0.1 2024-04-19 12:48:22 +08:00
Zheng Zangwei (Alex Zheng)
069ea0d687 Feat/fast bucket (#54) 
* [wip] bucket

* [bug] not parallel

* update eval

* update sample.sh

* accelerate bucket build with pandarallel
 2024-04-19 11:42:02 +08:00
tianyi
0045d8b7b0 fix 2024-04-19 11:18:29 +08:00
tianyi
0d98c1d02d Merge branch 'dev/v1.0.1' of github.com:hpcaitech/Open-Sora-dev into dev/Rflow 2024-04-19 11:18:01 +08:00
Shen-Chenhui
41a600b61b inference config 2024-04-19 10:47:09 +08:00
Shen-Chenhui
0ad337178a debug 2024-04-19 10:29:25 +08:00
Shen-Chenhui
34be856fdc add disc initialization code 2024-04-19 09:39:23 +08:00
corey-lambda
c0f3c3a9ca Create accleration/shardformer/__init__.py (#250) 2024-04-18 23:34:47 +08:00
7sunarni
d90c049a2f feat(ckpt_utils): support HF_MIRROR (#264) 
Signed-off-by: 7sunarni <710720732@qq.com>
 2024-04-18 23:31:40 +08:00
zhengzangw
2539a610d5 update mask strategy 2024-04-18 08:13:53 +00:00
Zheng Zangwei (Alex Zheng)
1f99b9ba4b complete eval pipeline (#53) 2024-04-18 15:49:14 +08:00
Shen-Chenhui
1b86c24de6 remove breakpoint 2024-04-18 15:22:22 +08:00
Shen-Chenhui
60892cd090 debug 2024-04-18 15:11:25 +08:00
Shen-Chenhui
246eddecdd enable pipeline vae training 2024-04-18 14:13:56 +08:00
Shen-Chenhui
f867ebc819 debug 2024-04-18 13:29:59 +08:00
Shen-Chenhui
8bf4a0fa77 add disable space in vae v2 2024-04-18 12:23:02 +08:00
Shen-Chenhui
e241ecbbe1 use default discriminator 2024-04-18 09:32:17 +08:00
Shen-Chenhui
5084d4e4f9 disc 2024-04-17 18:12:56 +08:00
Zangwei Zheng
ee2e4083e4 [feat] update eval 2024-04-17 17:35:44 +08:00