LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Cloud‐based data streams optimization

Photo by kmuza from unsplash

Many modern applications of sensor networks and transaction analysis require real‐time processing of their stream data sets. These data streams vary continuously over time. Current stream processing approaches focus on… Click to show full abstract

Many modern applications of sensor networks and transaction analysis require real‐time processing of their stream data sets. These data streams vary continuously over time. Current stream processing approaches focus on only one of the two optimization perspectives, proposing optimization techniques for data streams processing regardless of the processing environment or improving the processing environment only. In this paper, a brief survey of recent approaches to data streams processing coming from the two optimizations perspectives is proposed; their shortcomings are presented as well. Then, a proposal to an innovative and integrative framework is developed; it is referred to as the continuous query optimization based on multiple plans (CQOMP) for data streams over the cloud environment. CQOMP combines the two optimization perspectives and provides an optimized stream clusters processing using multiple split query plans. Each plan is constructed for a cluster of data that has nearest characteristics and it processes streams tuples over the cloud. We also propose a novel algorithm called the optimized multiple plans (OMP) for processing data streams clusters on Cloud Computing. The OMP algorithm efficiently divides data streams and generates optimized multiple split plans. Each plan is for processing a group of data streams on the cloud. We present the experimental results of the OMP solution compared to the alternative state‐of‐the‐art data stream approaches. The experiments show the efficiency and the scalability of the combined OMP algorithm on different cloud environments, the real Amazon cloud environment, and the simulated windows azure cloud environment.

Keywords: data streams; stream; cloud environment; optimization; cloud based

Journal Title: Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery
Year Published: 2018

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.