Commit graph

311 commits

Author SHA1 Message Date
Zheng Zangwei (Alex Zheng)
febf3ad4b2
Update Open-Sora 2.0 (#807)
* upload v2.0

* update docs

* [hotfix] fit latest fa3 (#802)

* update readme

* update readme

* update readme

* update train readme

* update readme

* update readme: motion score

* cleaning video dc ae WIP

* update config

* add dependency functions

* undo cleaning

* use latest dcae

* complete high compression training

* update hcae config

* cleaned up vae

* update ae.md

* further cleanup

* update vae & ae paths

* align naming of ae

* [hotfix] fix ring attn bwd for fa3 (#803)

* train ae default without wandb

* update config

* update evaluation results

* added hcae report

* update readme

* update readme demo

* update readme demo

* update readme gif

* display demo directly in readme

* update paper

* delete files

---------

Co-authored-by: Hongxin Liu <lhx0217@gmail.com>
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
Co-authored-by: wuxiwen <wuxiwen.simon@gmail.com>
2025-03-12 13:14:22 +08:00
gxyes
bbc64bcb72 fix typo 2025-03-11 11:32:58 +08:00
Zangwei Zheng
c4983aedb2 remove images 2025-03-05 10:27:32 +08:00
Zheng Zangwei (Alex Zheng)
f1c6b8b88e open-sora v1.3 code upload (#786)
Co-authored-by: gxyes <gxynoz@gmail.com>
2025-02-20 16:50:24 +08:00
Hongxin Liu
70ca63f30b [feature] support async ckpt & pin memory cache (#760)
* [feature] support async ckpt

* [feature] support pin memory cache

* [doc] update readme
2024-12-20 10:30:49 +08:00
zhengzangw
ecebf88865 update readme 2024-06-26 07:45:15 +00:00
zhengzangw
4b2b47b34d [fix] pixart sampling 2024-06-26 07:00:24 +00:00
zhengzangw
491403218d update for pixart 2024-06-24 07:04:08 +00:00
zhengzangw
7115864314 [fix] HF loading 2024-06-22 15:41:32 +00:00
zhengzangw
54f1da7cf1 update 2024-06-22 09:24:05 +00:00
zhengzangw
dec17bd990 [feat] reduce memory leakage in dataloader and pyav 2024-06-21 18:23:30 +00:00
zhengzangw
f32c1173b7 config for local load 2024-06-20 10:23:38 +00:00
Shen Chenhui
416837a86b Hotfix/vae (#502)
* fix assert

* fix vae config; update path

---------

Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-06-20 17:49:16 +08:00
Zheng Zangwei (Alex Zheng)
51dbf1a616 Hotfix/forcehf (#483)
* hotfix

* hotfix
2024-06-19 22:07:44 +08:00
Zheng Zangwei (Alex Zheng)
403772eee1 Docs/fix zangwei (#474)
* [docs] fix training data num

* [docs] update sp

* add support for issue #470
2024-06-19 16:53:53 +08:00
zhengzangw
525e29abbe reformat and update docs 2024-06-17 15:37:23 +00:00
Shen Chenhui
ee4e06c29b Merge pull request #151 from hpcaitech/feature/docs_v1.2
add vbench performance
2024-06-17 18:26:37 +08:00
Shen-Chenhui
5cbfe53086 add vbench performance 2024-06-17 10:25:55 +00:00
FrankLeeeee
f9ec54b246 updated inference config 2024-06-17 17:43:00 +08:00
Shen Chenhui
f0c98dd186 Merge pull request #148 from hpcaitech/feature/docs_v1.2
Feature/docs v1.2
2024-06-17 17:18:27 +08:00
Shen-Chenhui
d2e710c977 format 2024-06-17 09:13:12 +00:00
Frank Lee
4d243955ca [checkpoint] adapted vae to hf (#145) 2024-06-17 14:59:33 +08:00
zhengzangw
b6b2535c79 update inference 2024-06-17 05:57:25 +00:00
Frank Lee
93ba7719ec [checkpoint] adapted inference to hf pretrained weights (#143) 2024-06-17 11:27:24 +08:00
zhengzangw
c93e846017 [feat] fps control 2024-06-14 07:44:35 +00:00
Frank Lee
9dde960b95 added gradio (#133)
* added gradio

* added gradio
2024-06-13 16:56:30 +08:00
zhengzangw
a8a34d56b9 [fix] inference with score 2024-06-13 02:37:45 +00:00
zhengzangw
d55c87768b [exp] stage3 2024-06-11 13:52:49 +00:00
zhengzangw
6094f5fe92 [feat] add score for inference 2024-06-09 12:01:26 +00:00
zhengzangw
ce601066c5 [stage2] update config 2024-06-05 15:49:51 +00:00
zhengzangw
d028417a61 [config] update training config 2024-06-05 07:42:45 +00:00
zhengzangw
c04f157fec [config] stage2 training 2024-06-05 07:29:45 +00:00
zhengzangw
509f4cd36b update installation 2024-06-03 09:44:28 +00:00
zhengzangw
fd51586704 [fix] start_from_scratch 2024-05-31 06:46:30 +00:00
zhengzangw
8a686660bc read video 2024-05-30 08:09:03 +00:00
Frank Lee
2e1e26a2e4 added timer for benchmarking (#114) 2024-05-29 14:43:15 +08:00
zhengzangw
27d86e3d68 [fix] ckpt save 2024-05-23 09:01:26 +00:00
zhengzangw
fe60a93240 update feat train 2024-05-21 09:55:26 +00:00
zhengzangw
a50bec768f [feat] complete training with feature 2024-05-21 07:20:14 +00:00
zhengzangw
066b0c9bb3 [wip] feat training 2024-05-21 05:45:06 +00:00
zhengzangw
80f9ecbde3 [feat] generate feature 2024-05-21 04:05:02 +00:00
zhengzangw
771100ed88 Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-20 09:40:36 +00:00
zhengzangw
bdc67a3933 [wip] debug extract feat 2024-05-20 09:40:28 +00:00
Zheng Zangwei (Alex Zheng)
9cf394884c Dev/load batch (#105)
* add train_load_batch

* update train_load_batch

---------

Co-authored-by: pxy <pexure@gmail.com>
2024-05-20 17:40:05 +08:00
zhengzangw
5b9e753039 [feat] unify dataloader api 2024-05-20 08:40:45 +00:00
zhengzangw
5aad90acaf [feat] extract feature 2024-05-17 09:53:48 +00:00
zhengzangw
a016325a8e [feat] enable freezing y_embedder 2024-05-17 06:40:44 +00:00
zhengzangw
b8b0398eaa [feat] new config 12s/it 2024-05-16 05:25:30 +00:00
zhengzangw
5160fc0fd9 [feat] add lancher for eval loss and search bs 2024-05-15 17:06:54 +00:00
zhengzangw
0592723022 [feat] update bs search and loss eval 2024-05-15 13:05:53 +00:00