28 commits

Author	SHA1	Message	Date
Zheng Zangwei (Alex Zheng)	c9b81d8fd6	add camera motion detection (#34)	2024-04-05 23:42:31 +08:00
Shen-Chenhui	0d7c226ce6	add remove duplicates by path function	2024-04-05 17:28:17 +08:00
Shen-Chenhui	f3c417a61e	add filter by flow score function	2024-04-05 14:48:46 +08:00
Shen-Chenhui	d8203d5cc1	add intersect func	2024-04-05 11:21:00 +08:00
Zheng Zangwei (Alex Zheng)	1bb49f75e7	update frame extraction (#31)	2024-04-04 15:34:26 +08:00
Frank Lee	04c502f859	added checks for video corruption (#30)	2024-04-04 14:51:36 +08:00
Zangwei Zheng	12dcbeee8e	update csvutil & mask	2024-04-03 15:15:04 +08:00
Zangwei Zheng	550ea32fad	update csvutil	2024-04-03 13:33:46 +08:00
Hongxin Liu	c18ad83f01	[hotfix] fix caption processing (#27)	2024-04-03 11:32:01 +08:00
Zangwei Zheng	00c20261f0	update data pipeline	2024-04-02 15:55:58 +08:00
Hongxin Liu	c618f77bdc	[feature] move t5 text processing to csvutil (#22) ... * [feature] move t5 text processing to csvutil * polish code	2024-04-02 14:56:44 +08:00
Zheng Zangwei (Alex Zheng)	b5414b36b8	Dev/datapipe (#21) ... * fix #210 * fix #209 * fix #188 * [docs] add training order * update data pipeline --------- Co-authored-by: Sze-qq <68757353+Sze-qq@users.noreply.github.com>	2024-04-02 14:51:21 +08:00
Zangwei Zheng	4bfb90295b	update csvutil	2024-04-01 11:45:38 +08:00
Zangwei Zheng	cdd3b5eb74	llava fix and config modification	2024-03-31 23:44:37 +08:00
Zheng Zangwei (Alex Zheng)	f1ee27ba2f	[feat] llava support image and text (#13) ... * [feat] llava support image and text * add resize for image * update gpt4 caption * update prompt for llava image captioning	2024-03-31 20:59:33 +08:00
Zangwei Zheng	987283fa1b	[fix] transform may not fit enough	2024-03-30 17:05:15 +08:00
Zheng Zangwei (Alex Zheng)	682a699aec	Update image process (#5) ... * [docs] update tool docs * update aes	2024-03-29 23:34:10 +08:00
Zangwei Zheng	2d4a5df287	[wip] image wrong with flashattn	2024-03-28 22:04:43 +08:00
Zangwei Zheng	a01f6da20e	[feat] support for stdit2 sampling	2024-03-28 21:35:33 +08:00
Zangwei Zheng	7392d2e551	[feat] multiple frames with 360p	2024-03-27 00:24:46 +08:00
Zangwei Zheng	13423c57a7	train dataset support new format	2024-03-25 18:36:56 +08:00
Zangwei Zheng	6140f1bbba	update csvutil	2024-03-25 17:08:35 +08:00
Zangwei Zheng	5e3eca2d0f	add parallel pandas	2024-03-25 15:36:32 +08:00
Zangwei Zheng	3c5ce7f743	complete data format	2024-03-25 15:12:18 +08:00
Zangwei Zheng	bc27737f7c	[feat] add more csv filter	2024-03-24 16:58:16 +08:00
Zangwei Zheng	24c707bfb9	update csvutil for vidprom	2024-03-23 16:02:26 +08:00
Zangwei Zheng	e2856e6397	add datasets doc	2024-03-17 20:09:58 +08:00
Zangwei Zheng	921e3138b3	update docs	2024-03-17 15:47:48 +08:00

Renamed from tools/data/csvutil.py (Browse further)