nicolabs/Open-Sora
1
0
Fork 0
mirror of https://github.com/hpcaitech/Open-Sora.git synced 2026-05-21 11:59:01 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
1333 commits 8 branches 4 tags 504 MiB
Commit graph

311 commits

Author SHA1 Message Date
周钰坤
59591d8afc update 2024-04-30 13:36:41 +08:00
zhengzangw
b2f302b379 [wip] try vae 2024-04-29 17:02:22 +00:00
Shen-Chenhui
4d69671663 clean up code 2024-04-29 17:18:45 +08:00
Shen-Chenhui
bd5ca0fbee config ablate lr 2024-04-29 16:59:44 +08:00
zhengzangw
1171e5b6f9 update config 2024-04-29 07:27:15 +00:00
Shen-Chenhui
5de47c3049 change frame interval 2024-04-29 14:40:00 +08:00
Shen-Chenhui
dec9248551 add config image to video 2024-04-29 14:38:19 +08:00
Shen-Chenhui
b028c9c2a1 add image inference pixabay 2024-04-29 14:24:16 +08:00
zhengzangw
f3dcb4d6fb complete 3b backbone 2024-04-29 06:00:14 +00:00
Shen-Chenhui
19477d9af8 train 100 epochs image 2024-04-29 11:41:45 +08:00
Shen-Chenhui
c4318e9cba image train 2024-04-29 11:18:19 +08:00
Shen-Chenhui
73c6b19f0a add image support 2024-04-29 10:22:26 +08:00
Shen-Chenhui
6ea899878a config 2024-04-28 16:21:15 +08:00
Shen-Chenhui
ffc306c4fb latest inference script 2024-04-28 16:07:25 +08:00
Tianyi
07cbe11cb6 Merge branch 'main' of https://github.com/hpcaitech/Open-Sora-dev into dev/Rflow 2024-04-28 05:59:20 +00:00
Shen-Chenhui
8d914707f8 enable end to end loss training 2024-04-27 21:46:09 +08:00
zhengzangw
84465c0e44 add config for PixArt 1.6B 2024-04-27 13:41:21 +00:00
zhengzangw
7b08fb289c [fix] pixart-sigma 2024-04-27 13:19:00 +00:00
Shen-Chenhui
52e869079c debug 2024-04-27 20:57:48 +08:00
zhengzangw
9c042e9dbc update 2024-04-27 12:03:32 +00:00
zhengzangw
d6a16a858e [wip] multiple resolution 2024-04-27 11:43:15 +00:00
Shen-Chenhui
6fb4e3cd22 debug 2024-04-27 17:18:19 +08:00
Shen-Chenhui
7b134d71dc modify inference 2024-04-27 17:02:24 +08:00
Shen-Chenhui
10b5fc7af9 fix config error 2024-04-27 16:47:42 +08:00
YuKun Zhou
fddd08243b Update ckpt_utils.py (#79) 
* Update ckpt_utils.py

* update

* Update 1x256x256.py

* update

* update

* Update blocks.py

* update

* Update 1x2048x2048.py
 2024-04-27 15:43:50 +08:00
Shen-Chenhui
f5499aaf19 change config 2024-04-27 15:28:17 +08:00
Shen-Chenhui
c347f79bde new config 2024-04-27 15:14:01 +08:00
Shen Chenhui
b5a3334caf fix dataset loading 2024-04-27 14:52:52 +08:00
zhengzangw
478b585024 [wip] debug vae 2024-04-26 07:27:26 +00:00
zhengzangw
a4652a8aef Merge branch 'main' into vae 2024-04-26 06:56:22 +00:00
Shen-Chenhui
c7a698e85b fix dist issue 2024-04-26 13:50:56 +08:00
Shen-Chenhui
1d6cee302f add lecam support 2024-04-26 11:27:20 +08:00
Shen-Chenhui
bf1999f9b1 issue opt saving 2024-04-26 10:34:31 +08:00
Zheng Zangwei (Alex Zheng)
74f0af7e69 Docs/v1.1 zangwei (#308) 
* update reference sample

* update docs
 2024-04-25 13:09:26 +08:00
Frank Lee
42aea5470e Release/v1.1 update (#305) 
* Update structure.md

* Update report_v1.md

* Update sample-ref.py (#75)

* Update interpolation.py

* Dev/pxy (#77)

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

* update filter_panda10m

* update readme

* update readme

* update launch.ipynb

* update scene_cut

* update scene_cut

* update readme

* update launch.ipynb

* update readme

* add 1.1 demo

* update readme

* add 1.1 demo

* update readme

* Update README.md

---------

Co-authored-by: Yanjia0 <42895286+Yanjia0@users.noreply.github.com>
Co-authored-by: YuKun Zhou <90625606+1zeryu@users.noreply.github.com>
Co-authored-by: xyupeng <99191637+xyupeng@users.noreply.github.com>
 2024-04-25 12:50:55 +08:00
Tianyi
006ab8f35a Merge branch 'main' of https://github.com/hpcaitech/Open-Sora-dev into dev/Rflow 2024-04-25 03:16:54 +00:00
YuKun Zhou
ac352d6fed Update sample-ref.py (#75) 2024-04-24 23:02:55 +08:00
Shen-Chenhui
d254c02579 config 2024-04-24 10:32:40 +08:00
Shen-Chenhui
c77ffd8648 confgi LCGP 2024-04-24 10:31:33 +08:00
Shen-Chenhui
988bc3bb65 config lc gp 2024-04-24 10:03:58 +08:00
zhengzangw
e58ddb0d9e update training config 2024-04-23 15:40:18 +00:00
zhengzangw
22ad95eb0c bs test 2024-04-23 12:43:02 +00:00
zhengzangw
236d2377c4 bs test 2024-04-23 12:38:27 +00:00
zhengzangw
fddb3f4bf7 update config 2024-04-23 12:15:09 +00:00
Shen-Chenhui
48e3a84ba6 enable r1 gradient penalty 2024-04-23 17:51:50 +08:00
zhengzangw
01d14cb5e2 update structure.md 2024-04-23 07:41:33 +00:00
Shen-Chenhui
d565477680 disable non-master print 2024-04-23 14:43:02 +08:00
Shen-Chenhui
8548b88ca8 config pixabay 2024-04-23 13:45:11 +08:00
zhengzangw
a80808b6c4 update eval api and docs 2024-04-23 03:48:40 +00:00
Shen-Chenhui
2ac952bb71 8 GPU training config 2024-04-23 11:30:40 +08:00
Shen-Chenhui
16b0149fc4 lecam config 2024-04-23 09:59:12 +08:00
Shen-Chenhui
f4fe9b5eca add lecam 2024-04-23 09:22:05 +08:00
Zangwei Zheng
5c485be65a update stage3-hq config 2024-04-22 15:58:25 +08:00
Zangwei Zheng
f9751e7d91 add stage3 config 2024-04-22 15:09:59 +08:00
Zangwei Zheng
590174889e update training config 2024-04-22 12:07:52 +08:00
Zangwei Zheng
91f862363e update training config 2024-04-22 12:07:17 +08:00
Zangwei Zheng
3944e93065 update training config 2024-04-22 12:05:59 +08:00
zhengzangw
8931efccd7 update config 2024-04-22 03:43:31 +00:00
zhengzangw
9686395ade support vbench-i2v 2024-04-21 14:12:58 +00:00
zhengzangw
43485edb69 Merge branch 'dev/v1.1' of github.com:hpcaitech/Open-Sora-dev into dev/v1.1 2024-04-21 12:47:24 +00:00
zhengzangw
65b934857f update eval 2024-04-21 12:47:17 +00:00
Zangwei Zheng
6692c52dac update training config 2024-04-21 20:45:43 +08:00
zhengzangw
da345719c7 use qk-norm 2024-04-21 11:40:20 +00:00
zhengzangw
2b42ca82d8 [wip] prompt with json 2024-04-21 11:07:59 +00:00
Shen-Chenhui
36d63f4100 z=4 2024-04-21 10:42:35 +08:00
Shen-Chenhui
cffde33a99 add inference z4 2024-04-21 10:41:18 +08:00
Shen-Chenhui
48f027f504 longer training config 2024-04-21 10:29:24 +08:00
Shen-Chenhui
679ca934a2 config pipeline 2024-04-21 10:26:30 +08:00
zhengzangw
6073af6444 merge video edit 2024-04-20 15:47:48 +00:00
Zheng Zangwei (Alex Zheng)
341b12f9bf Dev/v1.0.1 (#58) 
* update (#57)

* update

* update datautil

* add VBench prompt

* update eval

* update eval

* update intepolation

* add vbench eval

* Dev/sdedit implementation (#56)

* Update utils.py

* update

* update

* update

---------

Co-authored-by: YuKun Zhou <90625606+1zeryu@users.noreply.github.com>
 2024-04-20 21:23:10 +08:00
Shen-Chenhui
2f8398a4f2 debug 2024-04-19 17:51:51 +08:00
Shen-Chenhui
96a42e08db config 2024-04-19 17:49:50 +08:00
Zangwei Zheng
8bf34f4418 add local_files_only 2024-04-19 16:47:26 +08:00
Shen-Chenhui
19187b70f5 allow specifying outputs in command line 2024-04-19 15:56:04 +08:00
Shen-Chenhui
2983009e57 config 2024-04-19 15:34:37 +08:00
Zangwei Zheng
dce2ef4a1c [exp] new config 2024-04-19 15:21:00 +08:00
Shen-Chenhui
d94abdb877 save old config during trainin 2024-04-19 15:16:14 +08:00
Shen-Chenhui
78caeea999 add support and config for z channel 4 2024-04-19 15:14:53 +08:00
Shen-Chenhui
dde18cd75e debug 2024-04-19 14:34:18 +08:00
Shen-Chenhui
6581556997 pipeline config 2024-04-19 13:36:47 +08:00
Zheng Zangwei (Alex Zheng)
d2a782efac Dev/fps (#55) 
* support fps

* update fps
 2024-04-19 13:18:52 +08:00
zhengzangw
701ce69458 update 2024-04-19 04:44:16 +00:00
Zheng Zangwei (Alex Zheng)
069ea0d687 Feat/fast bucket (#54) 
* [wip] bucket

* [bug] not parallel

* update eval

* update sample.sh

* accelerate bucket build with pandarallel
 2024-04-19 11:42:02 +08:00
Shen-Chenhui
9ce3099f47 config trial data 2024-04-19 11:27:33 +08:00
tianyi
0045d8b7b0 fix 2024-04-19 11:18:29 +08:00
Shen-Chenhui
41a600b61b inference config 2024-04-19 10:47:09 +08:00
Shen-Chenhui
0da15473d0 config 2024-04-19 09:45:47 +08:00
Shen-Chenhui
34be856fdc add disc initialization code 2024-04-19 09:39:23 +08:00
Shen-Chenhui
fde35c77c0 config 2024-04-19 09:28:11 +08:00
Shen-Chenhui
df6c068496 pipeline config 2024-04-19 09:27:11 +08:00
Shen-Chenhui
c28c697a0b config for pipeline discriminator 2024-04-19 09:24:15 +08:00
zhengzangw
2539a610d5 update mask strategy 2024-04-18 08:13:53 +00:00
Zheng Zangwei (Alex Zheng)
1f99b9ba4b complete eval pipeline (#53) 2024-04-18 15:49:14 +08:00
Shen-Chenhui
6ecc858350 pipeline config for trial data 2024-04-18 15:06:28 +08:00
Shen-Chenhui
246eddecdd enable pipeline vae training 2024-04-18 14:13:56 +08:00
Shen-Chenhui
aba1de6eb3 add pipeline 2024-04-18 13:49:54 +08:00
Shen-Chenhui
f867ebc819 debug 2024-04-18 13:29:59 +08:00
Shen-Chenhui
8bf4a0fa77 add disable space in vae v2 2024-04-18 12:23:02 +08:00
Shen-Chenhui
5084d4e4f9 disc 2024-04-17 18:12:56 +08:00
Shen-Chenhui
179bb7b125 debug 2024-04-16 18:21:18 +08:00
Shen-Chenhui
ef18b2e6d8 debug 2024-04-16 18:20:19 +08:00
Shen-Chenhui
dce4edfd44 debug 2024-04-16 18:18:51 +08:00
Shen-Chenhui
1287be4afe debug 2024-04-16 18:17:14 +08:00
Shen-Chenhui
becff9d86f inference v2 2024-04-16 18:15:12 +08:00
Shen-Chenhui
dc45231c8a debug 2024-04-16 17:27:41 +08:00
Shen-Chenhui
235d195dac add logvar 2024-04-16 17:25:48 +08:00
Zheng Zangwei (Alex Zheng)
a72e59610f update extending ynull (#51) 2024-04-16 16:45:06 +08:00
Shen-Chenhui
afd3f823d4 debug 2024-04-16 15:00:31 +08:00
Zangwei Zheng
d53715c0c2 update all old configs 2024-04-15 18:15:28 +08:00
Shen-Chenhui
af1b1e484d reimplement blurpool 2024-04-15 17:47:33 +08:00
Zangwei Zheng
50ad9a1ca5 small update 2024-04-15 17:36:20 +08:00
Zangwei Zheng
63e86f6dd6 hotfix inference 2024-04-15 13:44:30 +08:00
Shen-Chenhui
c71e04daaa add lecam and gradient penalty loss to discriminator 2024-04-15 11:13:39 +08:00
Shen-Chenhui
79bff13099 debug 2024-04-13 10:51:56 +08:00
Shen-Chenhui
fb0f59171c debug 2024-04-13 09:36:39 +08:00
Shen-Chenhui
a818e79134 debug 2024-04-12 18:29:54 +08:00
Shen-Chenhui
58ff8209e2 debug 2024-04-12 18:23:54 +08:00
Shen-Chenhui
5c046c4771 debug 2024-04-12 18:22:35 +08:00
Shen-Chenhui
d53245a98c debug 2024-04-12 18:14:18 +08:00
Shen-Chenhui
17d6b58178 debug 2024-04-12 18:08:42 +08:00
Shen-Chenhui
de9fffacfd gan training 2024-04-12 17:57:35 +08:00
Shen-Chenhui
a97c70fab2 debug 2024-04-12 15:20:50 +08:00
Shen-Chenhui
e004d43f69 gan optimizer 2024-04-12 15:10:19 +08:00
Shen-Chenhui
ab59033f20 gan 2024-04-12 12:42:02 +08:00
Shen-Chenhui
06d5a4a5e9 debug 2024-04-11 17:33:27 +08:00
Zangwei Zheng
4d338419a7 add cache dir 2024-04-11 16:46:57 +08:00
Shen-Chenhui
ccb92cd1ab debug 2024-04-11 15:34:11 +08:00
Shen-Chenhui
9cb8e42622 add kl loss 2024-04-11 15:25:50 +08:00
Shen-Chenhui
63f3737eb0 add simple discriminator 2024-04-11 15:14:16 +08:00
Hongxin Liu
2393c63083 [feature] add batch size search script (#47) 2024-04-11 14:23:13 +08:00
Zangwei Zheng
da1038ca5c a bunch of update 2024-04-11 11:48:06 +08:00
Shen-Chenhui
ca1d5863c3 add perceptual loss 2024-04-11 11:23:40 +08:00
Shen-Chenhui
b4c7de7a3b debug 2024-04-11 10:54:52 +08:00
Shen-Chenhui
ee58ec16b4 add image encoding support 2024-04-11 10:50:23 +08:00
Shen-Chenhui
d8666a73c4 register module 2024-04-09 18:04:08 +08:00
Shen-Chenhui
0fdc6e9935 config 2024-04-09 17:56:42 +08:00
Shen-Chenhui
a4025b0ea7 magvit v2 enc dec arc 2024-04-09 17:49:01 +08:00
Zangwei Zheng
e00f93d111 [exp] update 2024-04-09 13:55:55 +08:00
Zangwei Zheng
71a48c5d27 training config 2024-04-09 10:23:28 +08:00
Shen-Chenhui
ae6bffb8c5 restore train vae script 2024-04-09 09:34:59 +08:00
Shen-Chenhui
d6c0131aab debug 2024-04-08 17:19:48 +08:00
Shen-Chenhui
a634f7327e debug 2024-04-08 17:17:22 +08:00
Shen-Chenhui
a401630e7a debug 2024-04-08 17:03:27 +08:00
Shen-Chenhui
c6181ebdfd debug 2024-04-08 16:36:54 +08:00
Shen-Chenhui
e785961ca5 debug 2024-04-08 16:29:17 +08:00
Shen-Chenhui
11764f2b42 debug 2024-04-08 16:10:08 +08:00
Shen-Chenhui
4b27448a49 debug 2024-04-08 14:22:21 +08:00
Zangwei Zheng
a445927680 misc 2024-04-08 14:12:50 +08:00
Shen-Chenhui
4c3686c7a8 debug 2024-04-08 10:56:12 +08:00
Shen-Chenhui
1b66919091 debug 2024-04-08 10:53:44 +08:00