Commit graph

129 commits

Author SHA1 Message Date
zhengzangw
80f9ecbde3 [feat] generate feature 2024-05-21 04:05:02 +00:00
Shen Chenhui
d71a06756b Hotfix/vae sampler (#106)
* format

* format

* fix eval loss

* format

* use default seed

* format

* change back ckpt_every to 1k

---------

Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-21 10:36:26 +08:00
pxy
514511282d update get_info() 2024-05-21 02:11:23 +00:00
Shen Chenhui
5d264f6cda format (#103)
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-15 15:26:22 +08:00
Tom Young
c279d0f8f0 Pllava captioning 2024-05-15 07:19:12 +00:00
Shen Chenhui
6559366d86 add fpsmax function (#102)
Co-authored-by: Shen-Chenhui <shen_chenhui@u.nus.edu>
2024-05-14 14:49:01 +08:00
xyupeng
3c9d13de8f Dev/pxy (#100)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

* update filter_panda10m

* update readme

* update readme

* update launch.ipynb

* update scene_cut

* update scene_cut

* update readme

* update launch.ipynb

* update readme

* add 1.1 demo

* update readme

* add 1.1 demo

* update readme

* Update README.md

* add num_workers for pandarallel

* update scene_cut

* update readme

* update datautil

* update scoring

* update scoring

* update readme

* update scoring

* update scene_cut

* update scene_cut

* udpate datautil

* update datautil
2024-05-14 11:21:14 +08:00
zhengzangw
6194da6504 [fix] update inference and datautil 2024-05-13 06:33:12 +00:00
Zangwei Zheng
4f27cb51fc Merge branch 'main' into dev/v1.2 2024-05-09 16:49:24 +08:00
tianzedavid
abd0af8a89 chore: fix some comments (#355) 2024-05-09 16:19:42 +08:00
Fangdong Wu
9e5959c2f9 revise the package import error in tools/caption/caption_llava.py (#357) 2024-05-09 16:19:19 +08:00
Zheng Zangwei (Alex Zheng)
f047d5786a [refactor] clean train.py code (#94) 2024-05-08 16:07:57 +08:00
Zangwei Zheng
917643d5bd [wip] 2024-05-07 14:51:11 +08:00
FrankLeeeee
ec88d2d54e resolved conflicts 2024-05-07 03:08:41 +00:00
zhengzangw
4543bc217c [feat] image generation 2024-05-04 10:10:54 +00:00
Tom Young
d3bc7c86a6 put back EXTENSIONS 2024-05-02 01:20:33 +00:00
xyupeng
93ae382c2f update scoring (#82)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

* update filter_panda10m

* update readme

* update readme

* update launch.ipynb

* update scene_cut

* update scene_cut

* update readme

* update launch.ipynb

* update readme

* add 1.1 demo

* update readme

* add 1.1 demo

* update readme

* Update README.md

* add num_workers for pandarallel

* update scene_cut

* update readme

* update datautil

* update scoring

* update scoring
2024-04-30 14:44:45 +08:00
周钰坤
59591d8afc update 2024-04-30 13:36:41 +08:00
Tom Young
e84ccb2a31 scenedetect installation guide 2024-04-29 09:40:38 +00:00
Zheng Zangwei (Alex Zheng)
cff6298f6f update caption readme (#331) 2024-04-26 18:12:12 +08:00
Tom Young
335e8a3eed new camera motion detection (#65) 2024-04-26 10:45:42 +08:00
YuKun Zhou
343568985b Llama3 keyword extraction (#70)
* Create caption_llama3.py

* Update caption_llama3.py
2024-04-26 10:32:28 +08:00
Frank Lee
42aea5470e Release/v1.1 update (#305)
* Update structure.md

* Update report_v1.md

* Update sample-ref.py (#75)

* Update interpolation.py

* Dev/pxy (#77)

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

* update filter_panda10m

* update readme

* update readme

* update launch.ipynb

* update scene_cut

* update scene_cut

* update readme

* update launch.ipynb

* update readme

* add 1.1 demo

* update readme

* add 1.1 demo

* update readme

* Update README.md

---------

Co-authored-by: Yanjia0 <42895286+Yanjia0@users.noreply.github.com>
Co-authored-by: YuKun Zhou <90625606+1zeryu@users.noreply.github.com>
Co-authored-by: xyupeng <99191637+xyupeng@users.noreply.github.com>
2024-04-25 12:50:55 +08:00
YuKun Zhou
0abb237743 Update interpolation.py 2024-04-24 23:51:23 +08:00
xyupeng
2219fc8703 Dev/pxy (#72)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

* update filter_panda10m

* update readme

* update readme

* update launch.ipynb

* update scene_cut

* update scene_cut

* update readme

* update launch.ipynb
2024-04-24 15:52:07 +08:00
xyupeng
f7329dda38 Dev/pxy (#69)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

* update filter_panda10m

* update readme

* update readme
2024-04-23 21:05:45 +08:00
xyupeng
d79c8c6b47 Dev/pxy (#66)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring
2024-04-23 19:50:45 +08:00
xyupeng
a37cd74133 Dev/pxy (#64)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut
2024-04-23 15:34:58 +08:00
xyupeng
3f267bd326 Dev/pxy (#63)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring
2024-04-22 17:48:18 +08:00
zhengzangw
a3346808a6 Merge branch 'main' into dev/v1.1 2024-04-22 09:26:17 +00:00
xyupeng
e933ed8727 Dev/pxy (#61)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh
2024-04-22 17:15:55 +08:00
Zangwei Zheng
65804b2e9a fix datautil 2024-04-22 15:27:22 +08:00
Zheng Zangwei (Alex Zheng)
341b12f9bf Dev/v1.0.1 (#58)
* update (#57)

* update

* update datautil

* add VBench prompt

* update eval

* update eval

* update intepolation

* add vbench eval

* Dev/sdedit implementation (#56)

* Update utils.py

* update

* update

* update

---------

Co-authored-by: YuKun Zhou <90625606+1zeryu@users.noreply.github.com>
2024-04-20 21:23:10 +08:00
zhengzangw
d262f14a24 update 2024-04-20 02:43:38 +00:00
Zheng Zangwei (Alex Zheng)
1f99b9ba4b complete eval pipeline (#53) 2024-04-18 15:49:14 +08:00
Zangwei Zheng
50ad9a1ca5 small update 2024-04-15 17:36:20 +08:00
Zangwei Zheng
63e86f6dd6 hotfix inference 2024-04-15 13:44:30 +08:00
Zangwei Zheng
1207af03a1 a bunch of update 2024-04-14 17:05:25 +08:00
Zangwei Zheng
8513ff8734 v1.1 training preparation 2024-04-14 00:20:00 +08:00
xyupeng
7ebe6c2d87 Dev/pxy (#49)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere
2024-04-13 15:49:05 +08:00
Zangwei Zheng
f5e347e08e merge 2024-04-13 15:47:42 +08:00
Zangwei Zheng
3b85effe5a a bunch of update for data 2024-04-13 15:44:24 +08:00
xyupeng
4e0f97f374 Dev/pxy (#48)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere
2024-04-13 15:43:19 +08:00
Zangwei Zheng
8fa108a606 [feat] support ffmpeg 2024-04-11 15:48:48 +08:00
Zangwei Zheng
fff002bede [feat] support parquet 2024-04-11 15:28:49 +08:00
Zangwei Zheng
6e2f42cd9f [feat] faster get file list 2024-04-11 13:34:02 +08:00
Zangwei Zheng
bd6a3e46e4 Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-11 11:48:13 +08:00
Zangwei Zheng
da1038ca5c a bunch of update 2024-04-11 11:48:06 +08:00
Tom Young
745c1ed784 . 2024-04-11 10:24:01 +08:00
Tom Young
4bfcb8314f Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-11 10:10:44 +08:00