논문 상세보기
Development of a Framework for Improvement of Sensor Data Quality from Weather Buoys KCI 등재
해양기상부표의 센서 데이터 품질 향상을 위한 프레임워크 개발
- 언어ENG
- URLhttps://db.koreascholar.com/Article/Detail/426203
pp.186-197
In this study, we focus on the improvement of data quality transmitted from a weather buoy that guides a route of ships. The buoy has an Internet-of-Thing (IoT) including sensors to collect meteorological data and the buoy’s status, and it also has a wireless communication device to send them to the central database in a ground control center and ships nearby. The time interval of data collected by the sensor is irregular, and fault data is often detected. Therefore, this study provides a framework to improve data quality using machine learning models. The normal data pattern is trained by machine learning models, and the trained models detect the fault data from the collected data set of the sensor and adjust them. For determining fault data, interquartile range (IQR) removes the value outside the outlier, and an NGBoost algorithm removes the data above the upper bound and below the lower bound. The removed data is interpolated using NGBoost or long-short term memory (LSTM) algorithm. The performance of the suggested process is evaluated by actual weather buoy data from Korea to improve the quality of ‘AIR_TEMPERATURE’ data by using other data from the same buoy. The performance of our proposed framework has been validated through computational experiments based on real-world data, confirming its suitability for practical applications in real- world scenarios.
2. Related Studies and limitations
3. Models for Data Quality Improvement
3.1 Detecting outliers
3.2 Data Interpolation
4. Computational Experiments
5. Conclusion
Acknowledgment
