A novel mapreduce algorithm for distributed mining of sequential patterns using co-occurrence information
Sign Up to like & getrecommendations! Published in 2018 at "Applied Intelligence"
DOI: 10.1007/s10489-018-1259-2
Abstract: Sequential Pattern Mining (SPM) problem is much studied and extended in several directions. With the tremendous growth in the size of datasets, traditional algorithms are not scalable. In order to solve the scalability issue, recently… read more here.
Keywords: occurrence information; mapreduce; mapreduce algorithm; algorithm ... See more keywords
Analysis of hadoop MapReduce scheduling in heterogeneous environment
Sign Up to like & getrecommendations! Published in 2020 at "Ain Shams Engineering Journal"
DOI: 10.1016/j.asej.2020.06.009
Abstract: Abstract Over the last decade, several advancements have happened in distributed and parallel computing. A lot of data is generated daily from various sources, and this speedy data proliferation led to the development of many… read more here.
Keywords: mapreduce scheduling; hadoop mapreduce; mapreduce; scheduling heterogeneous ... See more keywords
Application and Performance Optimization of MapReduce Model in Image Segmentation
Sign Up to like & getrecommendations! Published in 2020 at "IEEE Access"
DOI: 10.1109/access.2019.2963343
Abstract: With the increase of glass detection speed, some defects of MapReduce distributed computing framework are exposed, and the processing speed and timeliness cannot meet the requirements of glass-defect detection in industrial technology. Based on the… read more here.
Keywords: mapreduce; application performance; performance optimization; segmentation ... See more keywords
Optimizing MapReduce Task Scheduling on Virtualized Heterogeneous Environments Using Ant Colony Optimization
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3176729
Abstract: Consuming Hadoop MapReduce via virtual infrastructure as a service is becoming common practice as cloud service providers (CSP) offers relevant applications and scalable resources. One of the predominant requirements of cloud users is to improve… read more here.
Keywords: mapreduce task; using ant; colony optimization; mapreduce ... See more keywords
The Performance Optimization of Big Data Processing by Adaptive MapReduce Workflow
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3193770
Abstract: The discussion context of this paper is big data processing of MapReduce by volunteer computing in dynamic and opportunistic environments. This paper conducts a series of simulations to explore the relationship between the overall performance… read more here.
Keywords: optimization; data processing; big data; mapreduce ... See more keywords
Noninvasive MapReduce Performance Tuning Using Multiple Tuning Methods on Hadoop
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Systems Journal"
DOI: 10.1109/jsyst.2020.3022286
Abstract: There are more than 190 configuration parameters affecting the performance of MapReduce jobs on Hadoop. It is time-consuming and tedious for general users who have no deep knowledge of Hadoop configuring to tune the parameters… read more here.
Keywords: mapreduce; tuning methods; mapreduce performance; performance ... See more keywords
In Defense of MapReduce
Sign Up to like & getrecommendations! Published in 2017 at "IEEE Internet Computing"
DOI: 10.1109/mic.2017.53
Abstract: Don't throw the MapReduce baby out with the bath water! read more here.
Keywords: mapreduce; defense mapreduce;
An Open Source Project for Tuning and Analyzing MapReduce Performance in Hadoop and Spark
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Software"
DOI: 10.1109/ms.2020.3044598
Abstract: MapReduce parameter tuning is time consuming, and existing tuning systems are difficult to use. We present an open source project, Catla for Hadoop and Spark, to provide comprehensive MapReduce tuning, prediction, and visualization tools based… read more here.
Keywords: hadoop spark; open source; mapreduce; source project ... See more keywords
Joint Optimization of MapReduce Scheduling and Network Policy in Hierarchical Data Centers
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Cloud Computing"
DOI: 10.1109/tcc.2019.2961653
Abstract: As large-scale data analytic becomes norm in various industries, using MapReduce frameworks to analyze ever-increasing volumes of data will keep growing. In turn, this trend drives up the intention to move MapReduce into multi-tenant clouds.… read more here.
Keywords: topology; network; data centers; scheduler ... See more keywords
swMR: A Framework for Accelerating MapReduce Applications on Sunway Taihulight
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Transactions on Emerging Topics in Computing"
DOI: 10.1109/tetc.2018.2881265
Abstract: MapReduce has already been an indispensable framework for the programmers to develop big data applications at scale without concerning the underlying complex system details. However, such an important framework is missing on the Sunway many-core… read more here.
Keywords: mapreduce; swmr framework; sunway taihulight; accelerating mapreduce ... See more keywords
Enhancing Leakage Prevention for MapReduce
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Transactions on Information Forensics and Security"
DOI: 10.1109/tifs.2022.3166641
Abstract: When public clouds become the platform of choice for MapReduce processing, users are placing higher demands on the privacy of the job data and program. A number of solutions employed trusted hardware to protect MapReduce… read more here.
Keywords: information; leakage prevention; mapreduce; bloom filter ... See more keywords