Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Orchestrating big data analysis workflows in the cloud: research challenges, survey, and future directions
Barika M., Garg S., Zomaya A., Wang L., Moorsel A., Ranjan R.  ACM Computing Surveys 52 (5): 1-41, 2019. Type: Article
Date Reviewed: Mar 2 2021

When processing different big data workflows, many new and (so far) unknown patterns and performance requirements are visible. We are forced to search new processing models and management techniques that can support the design of different aspects of big data workflows: infrastructure (hardware), platforms (software), and efficient methods for scheduling and deployment workflows. These big, serious, scientific, technological, organizational, and technical problems lead to at least three important challenges (research questions) that are expanded and developed in this paper:

(1) A description of “the different models and fundamental requirements of big data workflow applications”;
(2) The new challenges related to the cloud and edge data centers, and this type of workflow application; and
(3) The known “approaches, techniques, tools, and technologies” for developing “a new big data orchestration system.”

In successive sections, the authors present different research challenges, an existing knowledge and approaches survey, and possible future development directions for orchestrating big data analysis workflows. They give a detailed overview of many different issues related to workflow orchestration, big data workflow requirements in the cloud, a new big data workflow application classification and research taxonomy, currently used techniques and approaches, different systems and examples with data workflow support, and some still open challenges in the field.

The paper is supported with many valuable literature references, which show a general outline and the state of the art in big data computer systems organization and computing methodologies. This survey is a comprehensive analysis of many important and sometimes secondary issues, which suggests we may be facing an important paradigm shift in computer systems processing.

Reviewer:  Dominik Strzalka Review #: CR147202 (2105-0114)
Bookmark and Share
  Featured Reviewer  
Cloud Computing (C.2.4 ... )
Distributed Architectures (C.1.4 ... )
Real-Time And Embedded Systems (C.3 ... )
General (C.0 )
Would you recommend this review?
Other reviews under "Cloud Computing": Date
Web portals for high-performance computing: a survey
Calegari P., Levrier M., Balczyski P.  ACM Transactions on the Web 13(1): 1-36, 2019. Type: Article
Sep 24 2021
Secure sensor cloud
Kumar V., Sen A., Madria S.,  Morgan&Claypool Publishers, San Rafael, CA, 2018. 126 pp. Type: Book (978-1-681734-68-2)
Dec 21 2020
 Zooming in on wide-area latencies to a global cloud provider
Jin Y., Renganathan S., Ananthanarayanan G., Jiang J., Padmanabhan V., Schroder M., Calder M., Krishnamurthy A.  SIGCOMM 2019 (Proceedings of the ACM Special Interest Group on Data Communication, Beijing, China,  Aug 19-23, 2019) 104-116, 2019. Type: Proceedings
Feb 27 2020

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright © 2000-2021 ThinkLoud, Inc.
Terms of Use
| Privacy Policy