Articles with "apache spark" as a keyword



Halvade somatic: Somatic variant calling with Apache Spark

Sign Up to like & get
recommendations!
Published in 2022 at "GigaScience"

DOI: 10.1093/gigascience/giab094

Abstract: Abstract Background The accurate detection of somatic variants from sequencing data is of key importance for cancer treatment and research. Somatic variant calling requires a high sequencing depth of the tumor sample, especially when the… read more here.

Keywords: halvade somatic; somatic variant; sequencing data; apache spark ... See more keywords

Unsupervised Graph Anomaly Detection Algorithms Implemented in Apache Spark

Sign Up to like & get
recommendations!
Published in 2018 at "Lobachevskii Journal of Mathematics"

DOI: 10.1134/s1995080218090184

Abstract: The graph anomaly detection problem occurs in many application areas and can be solved by spotting outliers in unstructured collections of multi-dimensional data points, which can be obtained by graph analysis algorithms. We implement the… read more here.

Keywords: algorithms; apache spark; anomaly detection; graph ... See more keywords

DECA: scalable XHMM exome copy-number variant calling with ADAM and Apache Spark

Sign Up to like & get
recommendations!
Published in 2019 at "BMC Bioinformatics"

DOI: 10.1186/s12859-019-3108-7

Abstract: BackgroundXHMM is a widely used tool for copy-number variant (CNV) discovery from whole exome sequencing data but can require hours to days to run for large cohorts. A more scalable implementation would reduce the need… read more here.

Keywords: copy number; spark; apache spark; number variant ... See more keywords

Concept and benchmark results for Big Data energy forecasting based on Apache Spark

Sign Up to like & get
recommendations!
Published in 2018 at "Journal of Big Data"

DOI: 10.1186/s40537-018-0119-6

Abstract: The present article describes a concept for the creation and application of energy forecasting models in a distributed environment. Additionally, a benchmark comparing the time required for the training and application of data-driven forecasting models… read more here.

Keywords: spark; apache spark; energy forecasting; big data ... See more keywords
Photo from wikipedia

Big Data in metagenomics: Apache Spark vs MPI

Sign Up to like & get
recommendations!
Published in 2020 at "PLoS ONE"

DOI: 10.1371/journal.pone.0239741

Abstract: The progress of next-generation sequencing has lead to the availability of massive data sets used by a wide range of applications in biology and medicine. This has sparked significant interest in using modern Big Data… read more here.

Keywords: big data; version; mpi; spark ... See more keywords

A distributed computing model for big data anonymization in the networks

Sign Up to like & get
recommendations!
Published in 2023 at "PLOS ONE"

DOI: 10.1371/journal.pone.0285212

Abstract: Recently big data and its applications had sharp growth in various fields such as IoT, bioinformatics, eCommerce, and social media. The huge volume of data incurred enormous challenges to the architecture, infrastructure, and computing capacity… read more here.

Keywords: big data; apache spark; data anonymization; model ... See more keywords

Application of Machine Learning for Predictive Analysis and Management of Mediterranean-Farmed Fish Mortalities: A Risk Management Case Study Using Apache Spark

Sign Up to like & get
recommendations!
Published in 2024 at "Applied Sciences"

DOI: 10.3390/app142210112

Abstract: The current study evaluates the performance of three machine learning models—Decision Trees, Random Forest, and Linear Regression—applied to aquaculture data to mitigate risks in aquaculture management. The performances of these models are analyzed and properly… read more here.

Keywords: management; apache spark; study; machine learning ... See more keywords

A Cloud-Based Framework for Large-Scale Log Mining through Apache Spark and Elasticsearch

Sign Up to like & get
recommendations!
Published in 2019 at "Applied Sciences"

DOI: 10.3390/app9061114

Abstract: The volume, variety, and velocity of different data, e.g., simulation data, observation data, and social media data, are growing ever faster, posing grand challenges for data discovery. An increasing trend in data discovery is to… read more here.

Keywords: cloud based; mining; apache spark; log mining ... See more keywords