Commit graph

328 commits

Author SHA1 Message Date
Zangwei Zheng
1877a14abc load ema strict=False 2024-04-19 16:55:03 +08:00
Zangwei Zheng
8bf34f4418 add local_files_only 2024-04-19 16:47:26 +08:00
Zangwei Zheng
dce2ef4a1c [exp] new config 2024-04-19 15:21:00 +08:00
Zheng Zangwei (Alex Zheng)
d2a782efac Dev/fps (#55)
* support fps

* update fps
2024-04-19 13:18:52 +08:00
Zangwei Zheng
0e6c15d50b Merge branch 'main' into dev/v1.0.1 2024-04-19 12:48:22 +08:00
zhengzangw
701ce69458 update 2024-04-19 04:44:16 +00:00
zhengzangw
947a313eb5 Merge branch 'dev/v1.0.1' of github.com:hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-19 03:44:02 +00:00
Zheng Zangwei (Alex Zheng)
069ea0d687 Feat/fast bucket (#54)
* [wip] bucket

* [bug] not parallel

* update eval

* update sample.sh

* accelerate bucket build with pandarallel
2024-04-19 11:42:02 +08:00
corey-lambda
c0f3c3a9ca Create accleration/shardformer/__init__.py (#250) 2024-04-18 23:34:47 +08:00
Jiatong (Julius) Han
5af9f377d2 Update Readme_zh.md (#235) 2024-04-18 23:33:15 +08:00
Sergio Arroutbi
e31b442d74 Include latest GH action version to avoid warnings (#263)
Signed-off-by: Sergio Arroutbi <sarroutb@redhat.com>
2024-04-18 23:32:55 +08:00
7sunarni
d90c049a2f feat(ckpt_utils): support HF_MIRROR (#264)
Signed-off-by: 7sunarni <710720732@qq.com>
2024-04-18 23:31:40 +08:00
zhengzangw
de2d324765 update sample.sh 2024-04-18 15:20:17 +00:00
zhengzangw
ad6782533e update eval 2024-04-18 09:40:22 +00:00
zhengzangw
2539a610d5 update mask strategy 2024-04-18 08:13:53 +00:00
Zheng Zangwei (Alex Zheng)
1f99b9ba4b complete eval pipeline (#53) 2024-04-18 15:49:14 +08:00
Zangwei Zheng
ee2e4083e4 [feat] update eval 2024-04-17 17:35:44 +08:00
Zangwei Zheng
380ea6cce8 Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-17 17:05:12 +08:00
Zangwei Zheng
8cb6d2f0bd [feat] update eval 2024-04-17 17:05:08 +08:00
FrankLeeeee
6ee754bef9 print error data path 2024-04-17 16:45:18 +08:00
Frank Lee
79dabf8bdf added seed to dataloader args (#52) 2024-04-16 17:45:53 +08:00
Zheng Zangwei (Alex Zheng)
a72e59610f update extending ynull (#51) 2024-04-16 16:45:06 +08:00
Frank Lee
db94454645 Feature/timeout (#50)
* added large nccl timeout

* polish

* polish
2024-04-15 23:55:58 +08:00
Zangwei Zheng
d53715c0c2 update all old configs 2024-04-15 18:15:28 +08:00
Zangwei Zheng
50ad9a1ca5 small update 2024-04-15 17:36:20 +08:00
Zangwei Zheng
63e86f6dd6 hotfix inference 2024-04-15 13:44:30 +08:00
Zheng Zangwei (Alex Zheng)
c0e7bb977f update requirements (#280) 2024-04-15 09:36:25 +08:00
Zangwei Zheng
1207af03a1 a bunch of update 2024-04-14 17:05:25 +08:00
Zangwei Zheng
e88185fb9f update notebook 2024-04-14 02:02:59 +08:00
Zangwei Zheng
8513ff8734 v1.1 training preparation 2024-04-14 00:20:00 +08:00
xyupeng
7ebe6c2d87 Dev/pxy (#49)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere
2024-04-13 15:49:05 +08:00
Zangwei Zheng
f5e347e08e merge 2024-04-13 15:47:42 +08:00
Zangwei Zheng
3b85effe5a a bunch of update for data 2024-04-13 15:44:24 +08:00
xyupeng
4e0f97f374 Dev/pxy (#48)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere
2024-04-13 15:43:19 +08:00
Zangwei Zheng
4d338419a7 add cache dir 2024-04-11 16:46:57 +08:00
Zangwei Zheng
8fa108a606 [feat] support ffmpeg 2024-04-11 15:48:48 +08:00
Zangwei Zheng
dc1ad73f64 Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-11 15:28:56 +08:00
Zangwei Zheng
fff002bede [feat] support parquet 2024-04-11 15:28:49 +08:00
Hongxin Liu
2393c63083 [feature] add batch size search script (#47) 2024-04-11 14:23:13 +08:00
Zangwei Zheng
6e2f42cd9f [feat] faster get file list 2024-04-11 13:34:02 +08:00
Zangwei Zheng
bd6a3e46e4 Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-11 11:48:13 +08:00
Zangwei Zheng
da1038ca5c a bunch of update 2024-04-11 11:48:06 +08:00
Tom Young
745c1ed784 . 2024-04-11 10:24:01 +08:00
Tom Young
4bfcb8314f Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-11 10:10:44 +08:00
Tom Young
ed65131c57 . 2024-04-11 10:10:13 +08:00
Frank Lee
aa84ad4562 updated llava captioning (#45)
* updated llava captioning

* polish
2024-04-09 15:53:27 +08:00
Zangwei Zheng
aced1fb80f [fix] merge csv 2024-04-09 14:01:10 +08:00
Zangwei Zheng
e00f93d111 [exp] update 2024-04-09 13:55:55 +08:00
Zangwei Zheng
71a48c5d27 training config 2024-04-09 10:23:28 +08:00
Zangwei Zheng
e1d98678be [fix] dataset ext judge 2024-04-08 20:44:01 +08:00