Skip to main content

COV Pipeline context and parts that have already been run through

Note: The COV data is stored on microcenter at /media/gqc/T7/cctv/COV/Data/Video_Lists.

Notebook OrderNotebook NamePython File NameRun for COV
1cctv-video_list-creator.ipynbvideo_list_creator.pyWas not run through video_list-creator since we did not have actual COV videos on hand. The videos table was populated using the video_lists csv which are present in COV/Data/Video_Lists
2metadata_DB_extract_inspection_condition_data.ipynbextract_inspection_condition_data.pyWas not run through metadata_DB_extract_inspection_condition_data since I(Dhananjay) did not have
3cctv-import_supplementary_data.ipynbimport_suppl_data.pyThis module import distance regions, video-types, Condition_code_standard, and all_conditions CSV files into Video_DB as separate tables. It also updates videos table's video-type column.
4cctv-frame-extraction.ipynbframe_extractor.pyThis module extracts frames from a list of videos and saves them under a zip file.
5cctv-full-frame-stitch-and-Azure-OCR.ipynbstitch_and_ocr.pyThis will do the following:Run Azure OCR on 6 stacked full frames,The OCR results will be saved to OCR_JSON column in the frames table which can be used for blurring in the next stage.
6cctv-save-blurred-frames.ipynbblur_frames.pyThis module takes in the extracted frames and the CSV files generated by cctv-frame-extraction.ipynb utility and recognize the text present in the frames.
7cctv-extract-distance-values.ipynbextract_distance_values.pyThis module takes in the OCR_JSON column in the frames table containing OCR results and extracts the distance values
8cctv-distance-value-post-processing.ipynbdistance_postprocessor.pyThis module processes the distance values detected by OCR to remove outliers and fill in the frames without distances by linear interpolation and extrapolation.
9cctv-extract-condition_codes.ipynbextract_condition_codes.pyThis module takes in the OCR_JSON column in the frames table containing OCR results and extracts condition codes.
10cctv_SD1_label_images.ipynbSD1_label_images.pyThis notebook is used to assign condition codes to each frame.
11cctv-prepare-cctv-training-csv.ipynbtraining_data_splitter.pyThis module creates the correct data split between training, validation and test and writes the training, validation, and test into the sqlite3 database.