Commit graph

98 commits

Author SHA1 Message Date
Zheng Zangwei (Alex Zheng)
febf3ad4b2
Update Open-Sora 2.0 (#807)
* upload v2.0

* update docs

* [hotfix] fit latest fa3 (#802)

* update readme

* update readme

* update readme

* update train readme

* update readme

* update readme: motion score

* cleaning video dc ae WIP

* update config

* add dependency functions

* undo cleaning

* use latest dcae

* complete high compression training

* update hcae config

* cleaned up vae

* update ae.md

* further cleanup

* update vae & ae paths

* align naming of ae

* [hotfix] fix ring attn bwd for fa3 (#803)

* train ae default without wandb

* update config

* update evaluation results

* added hcae report

* update readme

* update readme demo

* update readme demo

* update readme gif

* display demo directly in readme

* update paper

* delete files

---------

Co-authored-by: Hongxin Liu <lhx0217@gmail.com>
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
Co-authored-by: wuxiwen <wuxiwen.simon@gmail.com>
2025-03-12 13:14:22 +08:00
Zheng Zangwei (Alex Zheng)
f1c6b8b88e open-sora v1.3 code upload (#786)
Co-authored-by: gxyes <gxynoz@gmail.com>
2025-02-20 16:50:24 +08:00
Hongxin Liu
70ca63f30b [feature] support async ckpt & pin memory cache (#760)
* [feature] support async ckpt

* [feature] support pin memory cache

* [doc] update readme
2024-12-20 10:30:49 +08:00
Jirka Borovec
a7b6aacc99 lint: unify setting in pyproject.toml (#583)
* lint: unify setting in `pyproject.toml`

* apply pre-commit
2024-07-12 14:50:13 +08:00
zhengzangw
4b2b47b34d [fix] pixart sampling 2024-06-26 07:00:24 +00:00
FrankLeeeee
6a72b8910b [data] added error handling to dataset 2024-06-24 08:53:10 +00:00
zhengzangw
cd12584034 handle av error 2024-06-22 13:26:55 +00:00
zhengzangw
a6bdabe286 minor fix 2024-06-21 19:22:02 +00:00
zhengzangw
dec17bd990 [feat] reduce memory leakage in dataloader and pyav 2024-06-21 18:23:30 +00:00
rangoliu
81524e675e fix ar keys (#500) 2024-06-20 17:51:24 +08:00
Jianshu Guo
17cce908b2 fix:multi-fps bug. For multi-fps training, when extracting frames according to a certain frame_interval, the fps of the extracted frames actually changes. (#444)
Co-authored-by: Jianshu Guo <fguojianshu@gmail.com>
2024-06-18 16:20:11 +08:00
jackmappotion
2229f01b35 ♻️ Directory creation to use os.makedirs with exist_ok (#435)
Simplified code and improved readability / Ensured functionality remains the same by allowing directory to exist without error
2024-06-18 07:41:02 +08:00
zhengzangw
525e29abbe reformat and update docs 2024-06-17 15:37:23 +00:00
zhengzangw
9117c9fcc7 [docs] update 2024-06-14 03:34:06 +00:00
Shen-Chenhui
b16d6f5ebe format 2024-06-12 08:26:31 +00:00
zhengzangw
43fa324a6e [wip] human evaluation 2024-06-12 06:57:30 +00:00
zhengzangw
d71ae85467 [fix] correct video info 2024-06-01 05:08:42 +00:00
zhengzangw
2988d5be99 [fix] read_video for tools 2024-05-31 07:17:01 +00:00
zhengzangw
ba6c800e9a [feat] backend=av 2024-05-30 08:51:22 +00:00
zhengzangw
6fe7aa36b9 Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-30 08:49:47 +00:00
zhengzangw
ee1354a7e0 [fix] release av threads 2024-05-30 08:49:39 +00:00
xyupeng
a1a2f29e2b update read_video() 2024-05-30 16:31:37 +08:00
zhengzangw
8a686660bc read video 2024-05-30 08:09:03 +00:00
Frank Lee
2e1e26a2e4 added timer for benchmarking (#114) 2024-05-29 14:43:15 +08:00
zhengzangw
a50bec768f [feat] complete training with feature 2024-05-21 07:20:14 +00:00
zhengzangw
066b0c9bb3 [wip] feat training 2024-05-21 05:45:06 +00:00
zhengzangw
80f9ecbde3 [feat] generate feature 2024-05-21 04:05:02 +00:00
zhengzangw
c2d499129f Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-21 02:38:27 +00:00
Shen Chenhui
d71a06756b Hotfix/vae sampler (#106)
* format

* format

* fix eval loss

* format

* use default seed

* format

* change back ckpt_every to 1k

---------

Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-21 10:36:26 +08:00
zhengzangw
771100ed88 Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-20 09:40:36 +00:00
zhengzangw
bdc67a3933 [wip] debug extract feat 2024-05-20 09:40:28 +00:00
Zheng Zangwei (Alex Zheng)
9cf394884c Dev/load batch (#105)
* add train_load_batch

* update train_load_batch

---------

Co-authored-by: pxy <pexure@gmail.com>
2024-05-20 17:40:05 +08:00
zhengzangw
5b9e753039 [feat] unify dataloader api 2024-05-20 08:40:45 +00:00
zhengzangw
5aad90acaf [feat] extract feature 2024-05-17 09:53:48 +00:00
zhengzangw
9fd4554f55 [fix] vae dtype 2024-05-16 08:50:24 +00:00
ChangeFWorld
811ac1055b Add Eval loss (#99)
* evaluation half complete

* eval loss finish

* refine config

---------

Co-authored-by: Tianyi <aicfw.li@gmail.com>
2024-05-15 16:17:19 +08:00
zhengzangw
9188b75bc5 Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-14 07:25:07 +00:00
zhengzangw
a36f80f847 [feat] notebook for inference 2024-05-14 07:24:56 +00:00
Frank Lee
d1b73a7c9f handled erroneous data (#101) 2024-05-14 14:27:46 +08:00
zhengzangw
e1e379d898 [feat] update inference config 2024-05-14 05:40:17 +00:00
zhengzangw
11faae8db6 [fix] exception handling for dataset 2024-05-12 14:08:37 +00:00
Zangwei Zheng
4f27cb51fc Merge branch 'main' into dev/v1.2 2024-05-09 16:49:24 +08:00
zhengzangw
2a55d672a7 [feat] update logging and bucket 2024-05-09 08:07:56 +00:00
zhangyongshun
2ec756a240 fix ar defination inconsistency (#375) 2024-05-08 19:48:56 +08:00
Zangwei Zheng
c4f17b41fc [exp] update config 2024-05-05 20:26:26 +08:00
Zheng Zangwei (Alex Zheng)
f941fa95dc Merge branch 'dev/v1.2' into vae-clean-new 2024-05-04 20:26:42 +08:00
zhengzangw
4543bc217c [feat] image generation 2024-05-04 10:10:54 +00:00
zhengzangw
b2f302b379 [wip] try vae 2024-04-29 17:02:22 +00:00
zhengzangw
f3dcb4d6fb complete 3b backbone 2024-04-29 06:00:14 +00:00
zhengzangw
d6a16a858e [wip] multiple resolution 2024-04-27 11:43:15 +00:00