Dev/pxy (#67)

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scoring/matching

* update scene_cut

* update scene_cut

* update scene_cut[A

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* update scene_cut

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* update readme

* update readme

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* extract frames using opencv everywhere

* filter panda10m

* filter panda10m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* m

* ocr

* add ocr

* add main.sh

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* add ocr

* update scene_cut

* update remove main.sh

* update scoring

* update scoring

* update scoring

* update README

* update readme

* update scene_cut

* update readme

* update scoring

* update readme

* update readme

docs/data_processing.md

@@ -1,9 +1,20 @@
 # Data Processing
+We establish a complete pipeline for video/image data processing. The pipeline is shown below.
 
-## Dataset Management
+![pipeline](/assets/readme/report_data_pipeline.png)
 
-## Scene Detection and Video Splitting
+First, raw videos, 
+either from the  Internet or public datasets, are split into shorter clips based on scene detection. 
+Then, we evaluate these videos by predicting multiple scores using existing models. We first predict the aesthetic score 
+and the optical flow score for a video. We also conduct OCR to detect texts in the video. Only videos with satisfactory 
+evaluation results are sent to the next step for captioning. After captioning, the matching score is also calculated as 
+an assessment of video-text alignment. Finally, we filter samples based on the matching score and 
+conduct camera motion detection for the remaining samples. 
+In summary, our pipeline produces video-text pairs which have high aesthetic quality, large video motion and strong 
+semantic consistency.
 
-## Scoring and Filtering
-
-## Captioning
+For more information, please refer to:
+- [Dataset Management](https://github.com/hpcaitech/Open-Sora-dev/blob/dev/v1.1/tools/datasets/README.md)
+- [Scene Detection and Video Splitting](https://github.com/hpcaitech/Open-Sora-dev/blob/dev/v1.1/tools/scene_cut/README.md)
+- [Scoring and Filtering](https://github.com/hpcaitech/Open-Sora-dev/blob/dev/v1.1/tools/scoring/README.md)
+- [Captioning](https://github.com/hpcaitech/Open-Sora-dev/blob/dev/v1.1/tools/caption/README.md)