Commit graph

422 commits

Author SHA1 Message Date
zhengzangw
5aad90acaf [feat] extract feature 2024-05-17 09:53:48 +00:00
zhengzangw
a016325a8e [feat] enable freezing y_embedder 2024-05-17 06:40:44 +00:00
zhengzangw
9fd4554f55 [fix] vae dtype 2024-05-16 08:50:24 +00:00
zhengzangw
137d0ac223 [fix] t5 dtype 2024-05-16 08:33:01 +00:00
zhengzangw
0592723022 [feat] update bs search and loss eval 2024-05-15 13:05:53 +00:00
zhengzangw
bb3c23577c [wip] eval loss and search bs 2024-05-15 12:21:07 +00:00
ChangeFWorld
811ac1055b Add Eval loss (#99)
* evaluation half complete

* eval loss finish

* refine config

---------

Co-authored-by: Tianyi <aicfw.li@gmail.com>
2024-05-15 16:17:19 +08:00
zhengzangw
f489cb0915 [feat] accelerate search batch size 2024-05-15 08:07:49 +00:00
zhengzangw
9188b75bc5 Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-14 07:25:07 +00:00
zhengzangw
a36f80f847 [feat] notebook for inference 2024-05-14 07:24:56 +00:00
Frank Lee
d1b73a7c9f handled erroneous data (#101) 2024-05-14 14:27:46 +08:00
zhengzangw
e1e379d898 [feat] update inference config 2024-05-14 05:40:17 +00:00
zhengzangw
3a01cb440d [feat] inference for rf 2024-05-13 11:39:16 +00:00
zhengzangw
ff34f2bdaf Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-13 06:33:23 +00:00
zhengzangw
6194da6504 [fix] update inference and datautil 2024-05-13 06:33:12 +00:00
Shen Chenhui
b8d99d7a8b fixed (#98)
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-13 11:58:06 +08:00
zhengzangw
11faae8db6 [fix] exception handling for dataset 2024-05-12 14:08:37 +00:00
zhengzangw
74dfaa879c [fix] ema ckpt save 2024-05-12 05:15:06 +00:00
Zheng Zangwei (Alex Zheng)
3893af0a62 update stdit dtype (#392) 2024-05-11 15:23:39 +08:00
Zheng Zangwei (Alex Zheng)
a6a0325b47 change flashattn to flash_attn (#387) 2024-05-10 14:36:31 +08:00
zhengzangw
e870139f8f Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-10 03:19:48 +00:00
zhengzangw
1db24970d5 updated 2024-05-10 03:19:38 +00:00
Zangwei Zheng
4f27cb51fc Merge branch 'main' into dev/v1.2 2024-05-09 16:49:24 +08:00
zhengzangw
2a55d672a7 [feat] update logging and bucket 2024-05-09 08:07:56 +00:00
Shen Chenhui
89a90e6b3d Hotfix/latent size calc std (#96)
* save progress

* format

* clean config

---------

Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-09 14:12:29 +08:00
zhengzangw
e9db7b3af1 update training script 2024-05-09 05:53:19 +00:00
zhengzangw
31228fe9c8 [refactor] fix train warnings 2024-05-09 03:10:26 +00:00
zhengzangw
322e566aed update 2024-05-09 03:10:26 +00:00
Zangwei Zheng
eb5ff82fc5 quick update 2024-05-09 11:09:52 +08:00
zhangyongshun
2ec756a240 fix ar defination inconsistency (#375) 2024-05-08 19:48:56 +08:00
Shen Chenhui
dc7b7fd64a fix bug (#95)
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-08 17:39:21 +08:00
ChangeFWorld
338bd83f24 mask added, no test due to occupation of gpus (#90)
* mask added, no test due to occupation of gpus

* mask fix

---------

Co-authored-by: ChangeFWorld <aicfw.li@gmail.com>
2024-05-08 16:32:36 +08:00
Zheng Zangwei (Alex Zheng)
f047d5786a [refactor] clean train.py code (#94) 2024-05-08 16:07:57 +08:00
Frank Lee
82f15b30f9 fixed checkpoint (#92) 2024-05-07 18:34:22 +08:00
Frank Lee
fe19568a49 fixed race condition in exp workspace (#91) 2024-05-07 17:17:43 +08:00
Zangwei Zheng
fea2541c70 [docs] update readme 2024-05-07 16:27:21 +08:00
Zangwei Zheng
8564074229 [exp] 2024-05-07 15:41:52 +08:00
Frank Lee
06693a8187 fixed v3 train config (#89) 2024-05-07 15:13:20 +08:00
Zangwei Zheng
917643d5bd [wip] 2024-05-07 14:51:11 +08:00
Shen-Chenhui
8e37e7d76e Merge branch 'vae-clean-new' into dev/v1.2 2024-05-07 06:39:57 +00:00
FrankLeeeee
ec88d2d54e resolved conflicts 2024-05-07 03:08:41 +00:00
Frank Lee
d599fd75b3 adapted pretrained model to training (#371) 2024-05-07 10:37:06 +08:00
Zangwei Zheng
10657621ef [fix] random mask may have nothing to learn 2024-05-06 17:34:08 +08:00
Zangwei Zheng
c863c1d5e9 [exp] complete config 2024-05-06 16:56:46 +08:00
Shen-Chenhui
1522f683b8 fix padding 2024-05-06 07:49:56 +00:00
Shen-Chenhui
041b14f138 fix padding error;add chunck inference script 2024-05-06 07:47:12 +00:00
Zangwei Zheng
eefb351333 [exp] update config bucket 2024-05-06 14:32:28 +08:00
Frank Lee
19911b99b8 converted model to hf format (#366) 2024-05-06 14:15:04 +08:00
Zangwei Zheng
5f6c9bfceb [exp] update config 2024-05-06 10:29:21 +08:00
zhengzangw
f77370fff6 [feat] vae micro frame 2024-05-05 15:25:17 +00:00
Zangwei Zheng
c4f17b41fc [exp] update config 2024-05-05 20:26:26 +08:00
Zheng Zangwei (Alex Zheng)
f941fa95dc Merge branch 'dev/v1.2' into vae-clean-new 2024-05-04 20:26:42 +08:00
Zangwei Zheng
d07003b0cd [fix] rf inference scale 2024-05-04 20:23:32 +08:00
zhengzangw
4543bc217c [feat] image generation 2024-05-04 10:10:54 +00:00
Zangwei Zheng
b26beabeb7 [exp] 2024-05-04 17:44:04 +08:00
Zangwei Zheng
c23fe85a70 [exp] 2024-05-04 16:16:06 +08:00
Zangwei Zheng
fd24a8c4f9 update adaptation 2024-05-04 11:51:31 +08:00
Zangwei Zheng
2b6b5fe767 Merge branch 'dev/v1.2' into dev/v1.2-exp 2024-05-03 14:37:31 +08:00
ChangeFWorld
683c0f74b7 Merge pull request #83 from hpcaitech/dev/Rflow
Dev/rflow
2024-05-03 14:14:00 +08:00
Tianyi
659e054e3a assert remove 2024-05-03 05:54:03 +00:00
Tianyi
fb4aede778 mask and weight support for rf training 2024-05-03 05:48:14 +00:00
Shen-Chenhui
d8fab103f4 added disc 2024-05-02 09:48:30 +00:00
Shen-Chenhui
bcb997502e enable disc 2024-05-02 17:28:45 +08:00
Shen-Chenhui
b35b933841 add disc 2024-05-02 16:32:19 +08:00
Zangwei Zheng
00e21e9fed [wip] adapt multi-res 2024-05-02 15:27:03 +08:00
zhengzangw
02904b4f29 updated 2024-05-02 03:46:01 +00:00
zhengzangw
f7a4fcfc3f updated 2024-04-30 09:46:27 +00:00
zhengzangw
b89c072eb5 [fix] micro batch size not for training 2024-04-30 09:20:08 +00:00
zhengzangw
ace37cf7c7 refactor 2024-04-30 08:13:20 +00:00
zhengzangw
41e276f5ef updated 2024-04-30 06:19:40 +00:00
周钰坤
bf633f3e68 Update pixart.py 2024-04-30 13:53:17 +08:00
周钰坤
34711b7bd2 update 2024-04-30 13:37:25 +08:00
周钰坤
59591d8afc update 2024-04-30 13:36:41 +08:00
zhengzangw
b2f302b379 [wip] try vae 2024-04-29 17:02:22 +00:00
Shen-Chenhui
e3b84247c1 disable t-conv for t=1 2024-04-29 20:06:18 +08:00
Shen-Chenhui
c59b499085 Merge branch 'vae-clean-new' of https://github.com/hpcaitech/Open-Sora-dev into vae-clean-new 2024-04-29 18:10:03 +08:00
Shen-Chenhui
c631358bbf add z nll loss 2024-04-29 18:09:42 +08:00
zhengzangw
9632b5bcf8 merged 2024-04-29 10:07:09 +00:00
zhengzangw
5c8139521a update 2024-04-29 10:02:42 +00:00
Shen-Chenhui
b78b469420 fix merge 2024-04-29 17:58:59 +08:00
Shen-Chenhui
f81d8648cf move out losses to different file 2024-04-29 17:53:03 +08:00
zhengzangw
a2dc903863 update 2024-04-29 09:41:39 +00:00
Shen-Chenhui
4d69671663 clean up code 2024-04-29 17:18:45 +08:00
zhengzangw
1171e5b6f9 update config 2024-04-29 07:27:15 +00:00
Shen-Chenhui
98de78910d config 2024-04-29 15:21:54 +08:00
Shen-Chenhui
7811b8e99a add Nlayer 3D discriminator 2024-04-29 14:18:57 +08:00
Shen-Chenhui
069ffcc4e3 use 3 layer disc 2024-04-29 14:03:18 +08:00
zhengzangw
f3dcb4d6fb complete 3b backbone 2024-04-29 06:00:14 +00:00
Shen-Chenhui
8b465b04c5 add vae subfolder support 2024-04-29 11:32:39 +08:00
Tianyi
07cbe11cb6 Merge branch 'main' of https://github.com/hpcaitech/Open-Sora-dev into dev/Rflow 2024-04-28 05:59:20 +00:00
zhengzangw
84465c0e44 add config for PixArt 1.6B 2024-04-27 13:41:21 +00:00
zhengzangw
7b08fb289c [fix] pixart-sigma 2024-04-27 13:19:00 +00:00
zhengzangw
d6a16a858e [wip] multiple resolution 2024-04-27 11:43:15 +00:00
zhengzangw
f551321e49 Merge branch 'main' into dev/v1.2 2024-04-27 11:40:56 +00:00
Shen-Chenhui
6fb4e3cd22 debug 2024-04-27 17:18:19 +08:00
Shen-Chenhui
c9785342c2 add evals 2024-04-27 16:14:11 +08:00
Zheng Zangwei (Alex Zheng)
8f109b7117 fix qknorm bug (#80) 2024-04-27 15:52:17 +08:00
YuKun Zhou
fddd08243b Update ckpt_utils.py (#79)
* Update ckpt_utils.py

* update

* Update 1x256x256.py

* update

* update

* Update blocks.py

* update

* Update 1x2048x2048.py
2024-04-27 15:43:50 +08:00
Shen-Chenhui
38c46ac721 fix bug 2024-04-27 15:25:03 +08:00
Shen Chenhui
b5a3334caf fix dataset loading 2024-04-27 14:52:52 +08:00