nicolabs/Open-Sora
1
0
Fork 0
mirror of https://github.com/hpcaitech/Open-Sora.git synced 2026-05-21 11:59:01 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
1333 commits 8 branches 4 tags 504 MiB
Commit graph

311 commits

Author SHA1 Message Date
Shen-Chenhui
ef18b2e6d8 debug 2024-04-16 18:20:19 +08:00
Shen-Chenhui
dce4edfd44 debug 2024-04-16 18:18:51 +08:00
Shen-Chenhui
1287be4afe debug 2024-04-16 18:17:14 +08:00
Shen-Chenhui
becff9d86f inference v2 2024-04-16 18:15:12 +08:00
Shen-Chenhui
dc45231c8a debug 2024-04-16 17:27:41 +08:00
Shen-Chenhui
235d195dac add logvar 2024-04-16 17:25:48 +08:00
Zheng Zangwei (Alex Zheng)
a72e59610f update extending ynull (#51) 2024-04-16 16:45:06 +08:00
Shen-Chenhui
afd3f823d4 debug 2024-04-16 15:00:31 +08:00
Zangwei Zheng
d53715c0c2 update all old configs 2024-04-15 18:15:28 +08:00
Shen-Chenhui
af1b1e484d reimplement blurpool 2024-04-15 17:47:33 +08:00
Zangwei Zheng
50ad9a1ca5 small update 2024-04-15 17:36:20 +08:00
Zangwei Zheng
63e86f6dd6 hotfix inference 2024-04-15 13:44:30 +08:00
Shen-Chenhui
c71e04daaa add lecam and gradient penalty loss to discriminator 2024-04-15 11:13:39 +08:00
Shen-Chenhui
79bff13099 debug 2024-04-13 10:51:56 +08:00
Shen-Chenhui
fb0f59171c debug 2024-04-13 09:36:39 +08:00
Shen-Chenhui
a818e79134 debug 2024-04-12 18:29:54 +08:00
Shen-Chenhui
58ff8209e2 debug 2024-04-12 18:23:54 +08:00
Shen-Chenhui
5c046c4771 debug 2024-04-12 18:22:35 +08:00
Shen-Chenhui
d53245a98c debug 2024-04-12 18:14:18 +08:00
Shen-Chenhui
17d6b58178 debug 2024-04-12 18:08:42 +08:00
Shen-Chenhui
de9fffacfd gan training 2024-04-12 17:57:35 +08:00
Shen-Chenhui
a97c70fab2 debug 2024-04-12 15:20:50 +08:00
Shen-Chenhui
e004d43f69 gan optimizer 2024-04-12 15:10:19 +08:00
Shen-Chenhui
ab59033f20 gan 2024-04-12 12:42:02 +08:00
Shen-Chenhui
06d5a4a5e9 debug 2024-04-11 17:33:27 +08:00
Zangwei Zheng
4d338419a7 add cache dir 2024-04-11 16:46:57 +08:00
Shen-Chenhui
ccb92cd1ab debug 2024-04-11 15:34:11 +08:00
Shen-Chenhui
9cb8e42622 add kl loss 2024-04-11 15:25:50 +08:00
Shen-Chenhui
63f3737eb0 add simple discriminator 2024-04-11 15:14:16 +08:00
Hongxin Liu
2393c63083 [feature] add batch size search script (#47) 2024-04-11 14:23:13 +08:00
Zangwei Zheng
da1038ca5c a bunch of update 2024-04-11 11:48:06 +08:00
Shen-Chenhui
ca1d5863c3 add perceptual loss 2024-04-11 11:23:40 +08:00
Shen-Chenhui
b4c7de7a3b debug 2024-04-11 10:54:52 +08:00
Shen-Chenhui
ee58ec16b4 add image encoding support 2024-04-11 10:50:23 +08:00
Shen-Chenhui
d8666a73c4 register module 2024-04-09 18:04:08 +08:00
Shen-Chenhui
0fdc6e9935 config 2024-04-09 17:56:42 +08:00
Shen-Chenhui
a4025b0ea7 magvit v2 enc dec arc 2024-04-09 17:49:01 +08:00
Zangwei Zheng
e00f93d111 [exp] update 2024-04-09 13:55:55 +08:00
Zangwei Zheng
71a48c5d27 training config 2024-04-09 10:23:28 +08:00
Shen-Chenhui
ae6bffb8c5 restore train vae script 2024-04-09 09:34:59 +08:00
Shen-Chenhui
d6c0131aab debug 2024-04-08 17:19:48 +08:00
Shen-Chenhui
a634f7327e debug 2024-04-08 17:17:22 +08:00
Shen-Chenhui
a401630e7a debug 2024-04-08 17:03:27 +08:00
Shen-Chenhui
c6181ebdfd debug 2024-04-08 16:36:54 +08:00
Shen-Chenhui
e785961ca5 debug 2024-04-08 16:29:17 +08:00
Shen-Chenhui
11764f2b42 debug 2024-04-08 16:10:08 +08:00
Shen-Chenhui
4b27448a49 debug 2024-04-08 14:22:21 +08:00
Zangwei Zheng
a445927680 misc 2024-04-08 14:12:50 +08:00
Shen-Chenhui
4c3686c7a8 debug 2024-04-08 10:56:12 +08:00
Shen-Chenhui
1b66919091 debug 2024-04-08 10:53:44 +08:00
Zangwei Zheng
50c0a35658 [fix] bucket 2024-04-08 02:28:14 +08:00
Zangwei Zheng
02b6335628 fix bucket index 2024-04-07 19:35:30 +08:00
Zangwei Zheng
882225897b fix bucket index 2024-04-07 16:28:44 +08:00
Shen-Chenhui
44b8142b4f add wrapper for pretrained loading 2024-04-05 16:01:24 +08:00
Shen-Chenhui
7624ec6f49 debug 2024-04-04 15:33:39 +08:00
Shen-Chenhui
d08d52ea03 config add is_vae 2024-04-04 15:23:57 +08:00
Shen-Chenhui
e9776584e4 allow vae not to have prompt file 2024-04-04 15:06:36 +08:00
Shen-Chenhui
9dc9afb254 add data path to inference config 2024-04-04 14:39:04 +08:00
Shen-Chenhui
dfdf8db491 add inference config 
add readme
complete inference script
TODO: DEBUG inference
 2024-04-04 14:11:25 +08:00
Zangwei Zheng
6762476261 update mask & config 2024-04-03 17:25:41 +08:00
Zangwei Zheng
12dcbeee8e update csvutil & mask 2024-04-03 15:15:04 +08:00
Shen-Chenhui
b6c39873ee finish discriminator arch 
use einops.rearrange in vae model_utils
add get_latent_size in vae_3d
inference vae_3d WIP
 2024-04-03 10:29:01 +08:00
Zangwei Zheng
b522fc89f1 update config 2024-04-02 21:17:13 +08:00
Zheng Zangwei (Alex Zheng)
7612d22fc6 Exp/image mix (#20) 
* [exp] image mixed training

* [exp] add batch info

* [exp] launch

* update num_step_per_epoch

* [feat] verify image mix training
 2024-04-02 13:35:09 +08:00
Shen-Chenhui
ebb3dc4d59 enable wandb 2024-04-02 11:47:56 +08:00
Shen-Chenhui
6bed1bdd0b working perceptual loss 2024-04-01 16:11:21 +08:00
Zangwei Zheng
c553ee274f better aspect ratio 2024-04-01 14:27:13 +08:00
Shen-Chenhui
3d6d499543 add perceptual loss 2024-04-01 13:57:25 +08:00
Zangwei Zheng
cdd3b5eb74 llava fix and config modification 2024-03-31 23:44:37 +08:00
Zheng Zangwei (Alex Zheng)
f1ee27ba2f [feat] llava support image and text (#13) 
* [feat] llava support image and text

* add resize for image

* update gpt4 caption

* update prompt for llava image captioning
 2024-03-31 20:59:33 +08:00
Zangwei Zheng
d7811a1a0e update config 2024-03-30 17:27:44 +08:00
Zheng Zangwei (Alex Zheng)
f9f539f07e format and some fix (#8) 2024-03-30 13:34:19 +08:00
Shen-Chenhui
d1e57cbfd5 debug 2024-03-29 10:30:56 +08:00
Zangwei Zheng
889788dd49 [wip] image wrong with flashattn 2024-03-28 22:35:07 +08:00
Zangwei Zheng
a01f6da20e [feat] support for stdit2 sampling 2024-03-28 21:35:33 +08:00
Zangwei Zheng
8b778213d1 [feat] complete dynamic pos 2024-03-28 19:27:17 +08:00
Zangwei Zheng
cba02e8a58 [feat] dynamic for video (base_size not completed) 2024-03-28 17:58:36 +08:00
shenchenhui
71b5c6e805 debug 2024-03-28 17:40:48 +08:00
shenchenhui
73ec879f71 debug 2024-03-28 16:13:50 +08:00
shenchenhui
3d9addba17 debug 2024-03-28 16:09:43 +08:00
shenchenhui
a5917c6a3e added vae3d training code 2024-03-28 15:12:20 +08:00
Zangwei Zheng
7392d2e551 [feat] multiple frames with 360p 2024-03-27 00:24:46 +08:00
Zangwei Zheng
3a0b85456c fix 2024-03-26 17:15:59 +08:00
Zangwei Zheng
552b7e8f79 register dataset 2024-03-26 17:02:41 +08:00
Zangwei Zheng
01728dc28a refactor datasets 2024-03-26 16:50:36 +08:00
Zangwei Zheng
f3ace2b341 merge stdit2 2024-03-26 15:46:31 +08:00
Zangwei Zheng
0dcf1ff888 add speediffusion 2024-03-25 22:20:10 +08:00
Zangwei Zheng
621da78e34 Merge branch 'main' into dev/v1.0.1 2024-03-25 13:42:45 +08:00
Zheng Zangwei (Alex Zheng)
1a913cd21b Docs/fix (#213) 
* fix #210

* fix #209

* fix #188
 2024-03-25 13:30:49 +08:00
Zheng Zangwei (Alex Zheng)
b454751f8f Docs/fix (#211) 
* fix #210

* fix #209
 2024-03-25 13:19:11 +08:00
Zangwei Zheng
bf29b9a4e6 add config 2024-03-25 11:16:30 +08:00
Zangwei Zheng
26c583118b [feat] new training scheme for mask 2024-03-24 16:07:18 +08:00
Zangwei Zheng
7d478f5094 complete masked demo 2024-03-24 15:09:42 +08:00
Zangwei Zheng
dcbacb03a6 update config 2024-03-23 23:39:31 +08:00
Zangwei Zheng
81da63e0dd renaming 2024-03-23 22:24:01 +08:00
Zangwei Zheng
4e6e17d800 complete masked training 2024-03-23 22:06:19 +08:00
Zangwei Zheng
9c81cd61bc complete masked inference 2024-03-23 21:12:18 +08:00
Zangwei Zheng
403d21b978 support iddpm inference with mask 2024-03-23 20:46:27 +08:00
Zangwei Zheng
98e62a7c57 update inference z 2024-03-23 20:28:34 +08:00
Zangwei Zheng
7d27f5553e merge mask-related utils 2024-03-23 16:32:51 +08:00
Frank Lee
6b2715e40c Feature/gradio demo (#190) 
* [gradio] added demo app

* polish
 2024-03-22 15:07:04 +08:00
Zangwei Zheng
c7f693a29f update inference memory usage 2024-03-20 02:23:35 +08:00
Frank Lee
14526479fc added sp for inference (#76) 2024-03-17 11:00:23 +08:00
Zheng Zangwei (Alex Zheng)
faefeec53a Docs/readme (#75) 
* update docs

* update docs

* update docs

* update acceleration docs and fix typos

* update docs commands
 2024-03-16 22:17:22 +08:00
Zheng Zangwei (Alex Zheng)
150cf4666a Docs/readme (#74) 
* update docs

* update docs

* update docs

* update acceleration docs and fix typos
 2024-03-16 21:17:16 +08:00
pxy
fc4166e03e update config 2024-03-16 17:29:32 +08:00
pxy
2af0f79f6d update config 2024-03-16 17:26:29 +08:00
Zheng Zangwei (Alex Zheng)
5880d01ee3 Docs/readme (#73) 
* update docs

* update docs
 2024-03-16 17:09:00 +08:00
pxy
bb844d911f update config 2024-03-16 15:47:23 +08:00
Zheng Zangwei (Alex Zheng)
d851a85535 format (#69) 2024-03-15 22:16:20 +08:00
Frank Lee
ddbb130fe7 added configs and tests (#65) 2024-03-15 21:53:49 +08:00