Articles with "data cleaning" as a keyword



Optimizing EEG ICA decomposition with data cleaning in stationary and mobile experiments

Sign Up to like & get
recommendations!
Published in 2024 at "Scientific Reports"

DOI: 10.1038/s41598-024-64919-3

Abstract: Electroencephalography (EEG) studies increasingly utilize more mobile experimental protocols, leading to more and stronger artifacts in the recorded data. Independent Component Analysis (ICA) is commonly used to remove these artifacts. It is standard practice to… read more here.

Keywords: sample rejection; ica decomposition; decomposition; data cleaning ... See more keywords
Photo from wikipedia

Federated Data Cleaning: Collaborative and Privacy-Preserving Data Cleaning for Edge Intelligence

Sign Up to like & get
recommendations!
Published in 2021 at "IEEE Internet of Things Journal"

DOI: 10.1109/jiot.2020.3027980

Abstract: As an important driving factor of emerging Internet-of-Things (IoT) applications, machine learning algorithms are currently facing the challenge of how to “clean” data noise, that is introduced during the training process (e.g., asynchronous execution and… read more here.

Keywords: edge intelligence; data cleaning; federated data; privacy ... See more keywords

Automatic Data Cleaning System for Large-Scale Location Image Databases Using a Multilevel Extractor and Multiresolution Dissimilarity Calculation

Sign Up to like & get
recommendations!
Published in 2021 at "IEEE Intelligent Systems"

DOI: 10.1109/mis.2020.3021704

Abstract: In this article, we propose a system for automatically classifying and cleaning location images in large-scale image databases uploaded by arbitrary users. Detecting incorrect scenes uploaded by users and maintaining the correctness of the database… read more here.

Keywords: data cleaning; system; multiresolution dissimilarity; dissimilarity calculation ... See more keywords

MCRe: A Unified Framework for Handling Malicious Traffic With Noise Labels Based on Multidimensional Constraint Representation

Sign Up to like & get
recommendations!
Published in 2024 at "IEEE Transactions on Information Forensics and Security"

DOI: 10.1109/tifs.2023.3318962

Abstract: Due to the limitations of the existing annotation methods, the prevalence of label noise can be caused in realistic malicious traffic datasets, which has a significant impact on the training and evaluation of deep learning-based… read more here.

Keywords: malicious traffic; representation; data cleaning; mcre ... See more keywords

Big Data Cleaning Based on Mobile Edge Computing in Industrial Sensor-Cloud

Sign Up to like & get
recommendations!
Published in 2020 at "IEEE Transactions on Industrial Informatics"

DOI: 10.1109/tii.2019.2938861

Abstract: With the advent of 5G, the industrial Internet of Things has developed rapidly. The industrial sensor-cloud system (SCS) has also received widespread attention. In the future, a large number of integrated sensors that simultaneously collect… read more here.

Keywords: data cleaning; cloud; mobile edge; big data ... See more keywords
Photo from wikipedia

A Fast Abnormal Data Cleaning Algorithm for Performance Evaluation of Wind Turbine

Sign Up to like & get
recommendations!
Published in 2021 at "IEEE Transactions on Instrumentation and Measurement"

DOI: 10.1109/tim.2020.3044719

Abstract: A fast wind turbine abnormal data cleaning algorithm via image processing for wind turbine power generation performance measurement and evaluation is proposed in this paper. The proposed method includes two stages, data cleaning and data… read more here.

Keywords: performance; wind turbine; data cleaning; power ... See more keywords

Enhancing data cleaning process on accounting data for fraud detection

Sign Up to like & get
recommendations!
Published in 2025 at "Indonesian Journal of Electrical Engineering and Computer Science"

DOI: 10.11591/ijeecs.v37.i2.pp1014-1022

Abstract: Data cleaning is a crucial step in fraud detection as it involves identifying and correcting any inaccuracies or inconsistencies in the data. This can help to ensure that the data being used for fraud detection… read more here.

Keywords: data cleaning; fraud detection; accounting data; fraud ... See more keywords
Photo from wikipedia

Data cleaning process for HIV-indicator data extracted from DHIS2 national reporting system: a case study of Kenya

Sign Up to like & get
recommendations!
Published in 2020 at "BMC Medical Informatics and Decision Making"

DOI: 10.1186/s12911-020-01315-7

Abstract: Background The District Health Information Software-2 (DHIS2) is widely used by countries for national-level aggregate reporting of health-data. To best leverage DHIS2 data for decision-making, countries need to ensure that data within their systems are… read more here.

Keywords: reporting; data cleaning; facility; process ... See more keywords

Reliability-enhanced data cleaning in biomedical machine learning using inductive conformal prediction

Sign Up to like & get
recommendations!
Published in 2025 at "PLOS Computational Biology"

DOI: 10.1371/journal.pcbi.1012803

Abstract: Accurately labeling large datasets is important for biomedical machine learning yet challenging while modern data augmentation methods may generate noise in the training data, which may deteriorate machine learning model performance. Existing approaches addressing noisy… read more here.

Keywords: training data; training; machine learning; biomedical machine ... See more keywords

Image-based cell profiling enhancement via data cleaning methods

Sign Up to like & get
recommendations!
Published in 2022 at "PLoS ONE"

DOI: 10.1371/journal.pone.0267280

Abstract: With the advent of high-throughput assays, a large number of biological experiments can be carried out. Image-based assays are among the most accessible and inexpensive technologies for this purpose. Indeed, these assays have proved to… read more here.

Keywords: cell; cell profiling; image based; data cleaning ... See more keywords

Ontology-Driven Data Cleaning Towards Lossless Data Compression

Sign Up to like & get
recommendations!
Published in 2022 at "Studies in health technology and informatics"

DOI: 10.3233/shti220492

Abstract: With the available data in healthcare, healthcare organizations and practitioners require interoperable, efficient, and non-time-consuming data exchange. Currently, several cases aim to the exchanged data security, without considering the complexity of the data to be… read more here.

Keywords: data compression; ontology driven; driven data; ontology ... See more keywords