Condition Data Extraction Notes
The purpose of this document is to track Jake's findings when trying to run LGBM notebooks with new data from DNV.
The purpose of this document is to track Jake's findings when trying to run LGBM notebooks with new data from DNV.
- We have 43536 images with labels from 73 videos (including Clement Ave video).
- We have 45830 images with labels from 80 videos and 257266 images with labels from 486 videos(including 80 videos)
The following runs are used to evaluate which model configuration perform better. The average F1 and F2 scores of the 10 runs are used as the evaluation metric.
- Link to concept of Fastai
We noticed that a few critical fields, namely Pipe Length, Pipe Size, and Pipe Age,
Validation Scores of Models before fine-tuned with SD1 data
Observation
Docs and outputs with Deven
In the gqc-utility-notebooks repo in the MSI machine, there is a gitignored data/ folder. It contains the utilized DNV data and the outputs from the notebooks pertaining to lightGBM.
This document contains Jake's notes of receiving and processing new data from DNV.