Articles with "data locality" as a keyword



An Enhanced Data-Locality-Aware Task Scheduling Algorithm for Hadoop Applications

Sign Up to like & get
recommendations!
Published in 2018 at "IEEE Systems Journal"

DOI: 10.1109/jsyst.2017.2764481

Abstract: In general, Hadoop improves the task scheduling performance by determining data locality based on the location in which the input splits and MapTask are executed. However, if an input split consists of multiple data blocks… read more here.

Keywords: data locality; task scheduling; scheduling algorithm; hadoop ... See more keywords

Improving Data Locality of Tasks by Executor Allocation in Spark Computing Environment

Sign Up to like & get
recommendations!
Published in 2024 at "IEEE Transactions on Cloud Computing"

DOI: 10.1109/tcc.2024.3406041

Abstract: The concept of data locality is crucial for distributed systems (e.g., Spark and Hadoop) to process Big Data. Most of the existing research optimized the data locality from the aspect of task scheduling. However, as… read more here.

Keywords: data locality; executor allocation; locality; locality tasks ... See more keywords

Optimizing Data Locality by Integrating Intermediate Data Partitioning and Reduce Task Scheduling in Spark Framework

Sign Up to like & get
recommendations!
Published in 2025 at "IEEE Transactions on Parallel and Distributed Systems"

DOI: 10.1109/tpds.2025.3611388

Abstract: Data locality is crucial for distributed computing systems (e.g., Spark and Hadoop), which is the main factor considered in the task scheduling. Simultaneously, the effects of data locality on reduce tasks are determined by the… read more here.

Keywords: data locality; data partitioning; intermediate data; task scheduling ... See more keywords

Data-Locality-Aware Task Assignment and Scheduling for Distributed Job Executions

Sign Up to like & get
recommendations!
Published in 2024 at "IEEE Transactions on Services Computing"

DOI: 10.1109/tsc.2025.3594158

Abstract: This paper addresses the data-locality-aware task assignment and scheduling problem for distributed job executions. Our goal is to minimize job completion times without prior knowledge of future job arrivals. We propose an Optimal Balanced Task… read more here.

Keywords: task; data locality; locality aware; task assignment ... See more keywords

Leveraging Data Locality in Quantum Convolutional Classifiers

Sign Up to like & get
recommendations!
Published in 2024 at "Entropy"

DOI: 10.3390/e26060461

Abstract: Quantum computing (QC) has opened the door to advancements in machine learning (ML) tasks that are currently implemented in the classical domain. Convolutional neural networks (CNNs) are classical ML architectures that exploit data locality and… read more here.

Keywords: data locality; quantum convolutional; leveraging data; locality quantum ... See more keywords