Commit graph

280 commits

Author SHA1 Message Date
Zheng Zangwei (Alex Zheng)
febf3ad4b2
Update Open-Sora 2.0 (#807)
* upload v2.0

* update docs

* [hotfix] fit latest fa3 (#802)

* update readme

* update readme

* update readme

* update train readme

* update readme

* update readme: motion score

* cleaning video dc ae WIP

* update config

* add dependency functions

* undo cleaning

* use latest dcae

* complete high compression training

* update hcae config

* cleaned up vae

* update ae.md

* further cleanup

* update vae & ae paths

* align naming of ae

* [hotfix] fix ring attn bwd for fa3 (#803)

* train ae default without wandb

* update config

* update evaluation results

* added hcae report

* update readme

* update readme demo

* update readme demo

* update readme gif

* display demo directly in readme

* update paper

* delete files

---------

Co-authored-by: Hongxin Liu <lhx0217@gmail.com>
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
Co-authored-by: wuxiwen <wuxiwen.simon@gmail.com>
2025-03-12 13:14:22 +08:00
Zheng Zangwei (Alex Zheng)
f1c6b8b88e open-sora v1.3 code upload (#786)
Co-authored-by: gxyes <gxynoz@gmail.com>
2025-02-20 16:50:24 +08:00
Hongxin Liu
70ca63f30b [feature] support async ckpt & pin memory cache (#760)
* [feature] support async ckpt

* [feature] support pin memory cache

* [doc] update readme
2024-12-20 10:30:49 +08:00
zhengzangw
06f7eb93f0 [fix] wandb log only if record time 2024-07-07 05:34:08 +00:00
zhengzangw
7e325e4e7b Merge branch 'main' of https://github.com/hpcaitech/Open-Sora into main 2024-06-27 14:02:04 +00:00
Hongxin Liu
332d9fc9c9 [feature] make timer optional and make reduce bucket size configurable (#549)
* [feature] make reduce bucket size configurable

* [feature] make timer optional
2024-06-27 13:37:54 +08:00
zhengzangw
4b2b47b34d [fix] pixart sampling 2024-06-26 07:00:24 +00:00
zhengzangw
ba65d369db [fix] time list 2024-06-21 19:21:00 +00:00
zhengzangw
dec17bd990 [feat] reduce memory leakage in dataloader and pyav 2024-06-21 18:23:30 +00:00
zhengzangw
525e29abbe reformat and update docs 2024-06-17 15:37:23 +00:00
Frank Lee
9a5ba168fb [inference] renamed duplicated variables (#153) 2024-06-17 21:45:58 +08:00
zhengzangw
b6b2535c79 update inference 2024-06-17 05:57:25 +00:00
zhengzangw
b6601fccfb [fix] inference save as path 2024-06-17 03:10:11 +00:00
Frank Lee
be61f44a29 [gradio] udpated inference logic (#138)
* [gradio] udpated inference logic

* polish
2024-06-15 22:43:33 +08:00
zhengzangw
54889b53ae minor update 2024-06-14 17:36:11 +00:00
zhengzangw
b70b749e55 [fix] loop support for score and refinement 2024-06-14 17:18:29 +00:00
zhengzangw
c93e846017 [feat] fps control 2024-06-14 07:44:35 +00:00
zhengzangw
992aae7d8f [feat] prompt refine 2024-06-14 07:37:00 +00:00
Frank Lee
a887f54711 added sp for stdit3 (#131) 2024-06-14 11:10:43 +08:00
zhengzangw
810d2a291a [docs] report for 1.2 2024-06-13 16:48:15 +00:00
zhengzangw
a8a34d56b9 [fix] inference with score 2024-06-13 02:37:45 +00:00
zhengzangw
a271faa131 [fix] condition sampling 2024-06-11 07:49:00 +00:00
zhengzangw
6094f5fe92 [feat] add score for inference 2024-06-09 12:01:26 +00:00
zhengzangw
68778cda9f update train config 2024-06-07 05:49:34 +00:00
zhengzangw
ce601066c5 [stage2] update config 2024-06-05 15:49:51 +00:00
Frank Lee
ea96cdb5e4 added warmup lr scheduler (#121) 2024-06-05 10:12:52 +08:00
zhengzangw
fd51586704 [fix] start_from_scratch 2024-05-31 06:46:30 +00:00
zhengzangw
ee1354a7e0 [fix] release av threads 2024-05-30 08:49:39 +00:00
zhengzangw
8a686660bc read video 2024-05-30 08:09:03 +00:00
Frank Lee
2e1e26a2e4 added timer for benchmarking (#114) 2024-05-29 14:43:15 +08:00
zhengzangw
fe60a93240 update feat train 2024-05-21 09:55:26 +00:00
zhengzangw
abb1b4c29e delete old feat train 2024-05-21 07:31:44 +00:00
zhengzangw
a50bec768f [feat] complete training with feature 2024-05-21 07:20:14 +00:00
zhengzangw
066b0c9bb3 [wip] feat training 2024-05-21 05:45:06 +00:00
zhengzangw
80f9ecbde3 [feat] generate feature 2024-05-21 04:05:02 +00:00
zhengzangw
c2d499129f Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-21 02:38:27 +00:00
Shen Chenhui
d71a06756b Hotfix/vae sampler (#106)
* format

* format

* fix eval loss

* format

* use default seed

* format

* change back ckpt_every to 1k

---------

Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-21 10:36:26 +08:00
zhengzangw
771100ed88 Merge branch 'dev/v1.2' of github.com:hpcaitech/Open-Sora-dev into dev/v1.2 2024-05-20 09:40:36 +00:00
zhengzangw
bdc67a3933 [wip] debug extract feat 2024-05-20 09:40:28 +00:00
Zheng Zangwei (Alex Zheng)
9cf394884c Dev/load batch (#105)
* add train_load_batch

* update train_load_batch

---------

Co-authored-by: pxy <pexure@gmail.com>
2024-05-20 17:40:05 +08:00
zhengzangw
5b9e753039 [feat] unify dataloader api 2024-05-20 08:40:45 +00:00
zhengzangw
5a1cf0c718 [fix] extract feat log 2024-05-17 10:05:49 +00:00
zhengzangw
5aad90acaf [feat] extract feature 2024-05-17 09:53:48 +00:00
zhengzangw
a016325a8e [feat] enable freezing y_embedder 2024-05-17 06:40:44 +00:00
pxy
5585e3dae3 add extract_vae_feat 2024-05-16 09:57:06 +00:00
zhengzangw
9fd4554f55 [fix] vae dtype 2024-05-16 08:50:24 +00:00
zhengzangw
b8b0398eaa [feat] new config 12s/it 2024-05-16 05:25:30 +00:00
zhengzangw
5160fc0fd9 [feat] add lancher for eval loss and search bs 2024-05-15 17:06:54 +00:00
zhengzangw
0592723022 [feat] update bs search and loss eval 2024-05-15 13:05:53 +00:00
zhengzangw
bb3c23577c [wip] eval loss and search bs 2024-05-15 12:21:07 +00:00