Commit graph

278 commits

Author SHA1 Message Date
Zangwei Zheng
e1d98678be [fix] dataset ext judge 2024-04-08 20:44:01 +08:00
Zangwei Zheng
36268b1c0f Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-08 20:42:46 +08:00
Zangwei Zheng
8d3f0f8282 [fix] dataset ext judge 2024-04-08 20:42:38 +08:00
Frank Lee
65cb8eb67c added support for llava mistral (#44) 2024-04-08 16:43:32 +08:00
Hongxin Liu
4bd85a3851 [faeture] add script to split dataset by bucket (#43) 2024-04-08 16:04:19 +08:00
Zangwei Zheng
3210a691cf Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-08 14:12:57 +08:00
Zangwei Zheng
a445927680 misc 2024-04-08 14:12:50 +08:00
Frank Lee
f0d4d55ed7 fixed captioning data format check (#42) 2024-04-08 10:38:14 +08:00
Frank Lee
11978080f4 enabled uneven data sharding for captioning (#41)
* enabled uneven data sharding for captioning

* poslih
2024-04-08 10:07:43 +08:00
Zangwei Zheng
50c0a35658 [fix] bucket 2024-04-08 02:28:14 +08:00
Zangwei Zheng
2685f2930e fix bucket index 2024-04-07 19:48:44 +08:00
Zangwei Zheng
02b6335628 fix bucket index 2024-04-07 19:35:30 +08:00
Zangwei Zheng
882225897b fix bucket index 2024-04-07 16:28:44 +08:00
Frank Lee
f7324500d3 added prompt and data type check (#40) 2024-04-07 15:52:01 +08:00
Hongxin Liu
1182003c9b [feature] accelerate iddpm (#39) 2024-04-07 14:30:38 +08:00
Zangwei Zheng
4f171fd800 update caption 2024-04-07 00:48:03 +08:00
xyupeng
c4bf35727c Dev/pxy (#38)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme
2024-04-06 16:45:59 +08:00
xyupeng
7da8be989a Dev/pxy (#37)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme
2024-04-06 16:40:48 +08:00
xyupeng
0dfea90a89 Dev/pxy (#36)
update scoring & scene_cut
2024-04-06 16:33:06 +08:00
Zheng Zangwei (Alex Zheng)
c9b81d8fd6 add camera motion detection (#34) 2024-04-05 23:42:31 +08:00
Shen-Chenhui
0d7c226ce6 add remove duplicates by path function 2024-04-05 17:28:17 +08:00
Shen-Chenhui
f3c417a61e add filter by flow score function 2024-04-05 14:48:46 +08:00
Shen-Chenhui
d8203d5cc1 add intersect func 2024-04-05 11:21:00 +08:00
Zangwei Zheng
57a1e7f6c4 format tools 2024-04-05 10:00:30 +08:00
Zangwei Zheng
112bb51c08 Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-04 17:42:34 +08:00
Zangwei Zheng
0dc7e85c18 update docs 2024-04-04 17:42:25 +08:00
Frank Lee
34b88c5260 fixed aesthetic scoring (#33) 2024-04-04 17:24:54 +08:00
Frank Lee
3bbee00436 accelerate aesthetic scoring (#32)
* accelerate aesthetic scoring

* polish
2024-04-04 16:03:43 +08:00
Zheng Zangwei (Alex Zheng)
1bb49f75e7 update frame extraction (#31) 2024-04-04 15:34:26 +08:00
Frank Lee
04c502f859 added checks for video corruption (#30) 2024-04-04 14:51:36 +08:00
Zangwei Zheng
6762476261 update mask & config 2024-04-03 17:25:41 +08:00
Zangwei Zheng
3fcda91877 Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-03 15:15:11 +08:00
Zangwei Zheng
12dcbeee8e update csvutil & mask 2024-04-03 15:15:04 +08:00
Hongxin Liu
cabf1d7746 [feature] support dp for matching (#29) 2024-04-03 14:42:59 +08:00
Zangwei Zheng
550ea32fad update csvutil 2024-04-03 13:33:46 +08:00
Frank Lee
6a86f20386 fixed llava image gen performance (#28) 2024-04-03 11:32:10 +08:00
Hongxin Liu
c18ad83f01 [hotfix] fix caption processing (#27) 2024-04-03 11:32:01 +08:00
xyupeng
b66a6e39d1 Dev/pxy (#26)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching
2024-04-02 21:20:39 +08:00
Zangwei Zheng
070f8a3dfb Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-02 21:17:22 +08:00
Zangwei Zheng
b522fc89f1 update config 2024-04-02 21:17:13 +08:00
xyupeng
35989f54d6 Dev/pxy (#24)
* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching
2024-04-02 21:01:27 +08:00
Hongxin Liu
810ebeeb6a [feature] support dp for optical flow scoring (#23) 2024-04-02 19:04:33 +08:00
Zangwei Zheng
065774a501 [feat] resize images 2024-04-02 16:55:03 +08:00
Zangwei Zheng
00c20261f0 update data pipeline 2024-04-02 15:55:58 +08:00
Zangwei Zheng
72bd0313bf Merge branch 'dev/v1.0.1' of https://github.com/hpcaitech/Open-Sora-dev into dev/v1.0.1 2024-04-02 14:57:13 +08:00
Hongxin Liu
c618f77bdc [feature] move t5 text processing to csvutil (#22)
* [feature] move t5 text processing to csvutil

* polish code
2024-04-02 14:56:44 +08:00
Zheng Zangwei (Alex Zheng)
b5414b36b8 Dev/datapipe (#21)
* fix #210

* fix #209

* fix #188

* [docs] add training order

* update data pipeline

---------

Co-authored-by: Sze-qq <68757353+Sze-qq@users.noreply.github.com>
2024-04-02 14:51:21 +08:00
Zangwei Zheng
0971cbc8c3 Merge branch 'main' into dev/v1.0.1 2024-04-02 13:38:32 +08:00
Zheng Zangwei (Alex Zheng)
7612d22fc6 Exp/image mix (#20)
* [exp] image mixed training

* [exp] add batch info

* [exp] launch

* update num_step_per_epoch

* [feat] verify image mix training
2024-04-02 13:35:09 +08:00
xyupeng
f15ef17937 Merge pull request #19 from hpcaitech/dev/pxy
Dev/pxy
2024-04-02 12:50:36 +08:00