On the role of message broker middleware for many-task computing on a big-data platform
Sign Up to like & getrecommendations! Published in 2018 at "Cluster Computing"
DOI: 10.1007/s10586-018-2634-9
Abstract: We have designed and implemented a new data processing framework called “Many-task computing On HAdoop” (MOHA) which aims to effectively support fine-grained many-task applications that can show another type of data-intensive workloads in the YARN-based… read more here.
Keywords: many task; message broker; task computing; hadoop ... See more keywords
Real-Time Big Data Stream Processing Using GPU with Spark Over Hadoop Ecosystem
Sign Up to like & getrecommendations! Published in 2017 at "International Journal of Parallel Programming"
DOI: 10.1007/s10766-017-0513-2
Abstract: In this technological era, every person, authorities, entrepreneurs, businesses, and many things around us are connected to the internet, forming Internet of thing (IoT). This generates a massive amount of diverse data with very high-speed,… read more here.
Keywords: big data; real time; stream processing; time ... See more keywords
EMM: Extended matching market based scheduling for big data platform hadoop
Sign Up to like & getrecommendations! Published in 2021 at "Multimedia Tools and Applications"
DOI: 10.1007/s11042-021-11283-3
Abstract: Hadoop has emerged as a popular choice for processing Big data. Its cluster is used to process large scale jobs. The performance of a cluster is largely dependent upon the different kind of scheduling policies… read more here.
Keywords: big data; hadoop; performance; matching market ... See more keywords
A system based on Hadoop for radar data analysis
Sign Up to like & getrecommendations! Published in 2019 at "Journal of Ambient Intelligence and Humanized Computing"
DOI: 10.1007/s12652-018-0980-3
Abstract: Nowadays, radar technique is widely used in many applications, such as electronic warfare, weather prediction, navigation, and self-driving car. Large amounts of radar data has been generated by the wide use of radar technique. Analyzing… read more here.
Keywords: system; hadoop; spark; radar data ... See more keywords
Analysis of hadoop MapReduce scheduling in heterogeneous environment
Sign Up to like & getrecommendations! Published in 2020 at "Ain Shams Engineering Journal"
DOI: 10.1016/j.asej.2020.06.009
Abstract: Abstract Over the last decade, several advancements have happened in distributed and parallel computing. A lot of data is generated daily from various sources, and this speedy data proliferation led to the development of many… read more here.
Keywords: mapreduce scheduling; hadoop mapreduce; mapreduce; scheduling heterogeneous ... See more keywords
HEAP: An Efficient and Fault-Tolerant Authentication and Key Exchange Protocol for Hadoop-Assisted Big Data Platform
Sign Up to like & getrecommendations! Published in 2018 at "IEEE Access"
DOI: 10.1109/access.2018.2883105
Abstract: Hadoop framework has been evolved to manage big data in cloud. Hadoop distributed file system and MapReduce, the vital components of this framework, provide scalable and fault-tolerant big data storage and processing services at a… read more here.
Keywords: big data; fault tolerant; authentication; security ... See more keywords
An Energy Efficiency Optimization and Control Model for Hadoop Clusters
Sign Up to like & getrecommendations! Published in 2019 at "IEEE Access"
DOI: 10.1109/access.2019.2907018
Abstract: The majority of large-scale data intensive applications designed by MapReduce model are deployed and executed on a large-scale distributed Hadoop system. Running such application on a large cluster requires a large amount of energy. Therefore… read more here.
Keywords: energy efficiency; control; hadoop; model ... See more keywords
Hadoop Data Reduction Framework: Applying Data Reduction at the DFS Layer
Sign Up to like & getrecommendations! Published in 2021 at "IEEE Access"
DOI: 10.1109/access.2021.3127499
Abstract: Big-data processing systems such as Hadoop, which usually utilize distributed file systems (DFSs), require data reduction schemes to maximize storage space efficiency. These schemes have different tradeoffs, and there are no all-purpose schemes applicable to… read more here.
Keywords: reduction; hadoop; data reduction; dfs ... See more keywords
A Dynamic Repository Approach for Small File Management With Fast Access Time on Hadoop Cluster: Hash Based Extended Hadoop Archive
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3163433
Abstract: Small file processing in Hadoop is one of the challenging task. The performance of the Hadoop is quite good when dealing with large files because they require lesser metadata and consume less memory. But while… read more here.
Keywords: hash; hadoop; small file; hadoop archive ... See more keywords
KNN Normalized Optimization and Platform Tuning Based on Hadoop
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Access"
DOI: 10.1109/access.2022.3195872
Abstract: Big data has become part of the life for many people. The data about people’s life are being continously collected, analysized and applied as our society progresses into the big data era. Behind the scene,… read more here.
Keywords: hadoop; platform; classification; algorithm ... See more keywords
Domain Adaptive Log Anomaly Prediction for Hadoop System
Sign Up to like & getrecommendations! Published in 2022 at "IEEE Internet of Things Journal"
DOI: 10.1109/jiot.2022.3178873
Abstract: Hadoop provides a powerful platform that allows reliable, scalable, and distributed processing of massive data sets across a cluster of computers. Log data record events taken place in the Hadoop system that helps to understand… read more here.
Keywords: system; hadoop; domain; anomaly ... See more keywords