Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Reproducibility in scientific computing
Ivie P., Thain D.  ACM Computing Surveys 51 (3): 1-36, 2018. Type: Article
Date Reviewed: Nov 19 2019

The authors discuss reproducible research, that is, research where the same task produces the same result as the original research. Researchers in the computing community are encouraged to make their results reproducible so that others can verify, reproduce, and extend their computational experiments. Such a process is of great interest to scientific computing, where it means writing the same program running on the same computer architecture and operating system as the original. However, due to the various versions of software, operating systems, and programming languages available, it is often hard to replicate every detail.

It is obvious that science is becoming more digitized, creating scientific computing environments in which the research paper becomes an expression of activities through categorized and systematized data and computer program code. Hence, reproducibility in scientific computing demands that both software and data be available in the exact same way as in the original research. The result is that scientists have become much more concerned with reproducible work environments. Scientific computing experiments are widely designed as scientific workflows published as digital objects. The authors understand workflow’s potential in the scientific computing research process, where a scientific workflow includes an executable description of scientific procedures. An interesting point of view is the assumption that reproducibility in scientific computing requires an environment where input data, computer program code, and workflow are freely available and cited. This notion correlates with a need to document the full context of computational experiments.

A very useful topic for readers is the authors’ analysis of a working environment, that is, the basic computational elements (scopes) used in a specific workflow, including commands, data, software, operating system, and hardware. To ensure reproducibility, all elements should be preserved and described in detail, that is, documented. In addition to the basic elements, the authors identify workflow as key to designing a scientific computing environment that allows for reproducibility. Thus, they present not only technical barriers to reproducibility in scientific computing, but also a survey on possible solutions and practical ways to overcome common problems.

This study is a good choice for readers who know something about scientific computing or are quite familiar with the topic. Computer science researchers and students, as well as professionals in scientific computing environments and digital labs, may find the paper to be very valuable and a useful source for their work.

Reviewer:  F. J. Ruzic Review #: CR146784 (2004-0088)
Bookmark and Share
  Featured Reviewer  
Computer And Information Science Education (K.3.2 )
Computer Science Education (K.3.2 ... )
Data Models (H.2.1 ... )
Formal Methods (D.2.4 ... )
Project And People Management (K.6.1 )
Software/ Program Verification (D.2.4 )
Would you recommend this review?
Other reviews under "Computer And Information Science Education": Date
An empirical study of students’ perceptions on the setup and grading of group programming assignments
Aivaloglou E., van der Meulen A.  ACM Transactions on Computing Education (TOCE) 3(21): 1-22, 2021. Type: Article
Mar 15 2022
Transformative teaching: a collection of stories of engineering faculty’s pedagogical journeys
Kellam N., Boklage A., Coley B.,  Morgan&Claypool Publishers, San Rafael, CA, 2019. 126 pp. Type: Book (978-1-681735-45-0)
Jan 11 2021
Deep learning in the IT curriculum
Hoover A., Spryszynski A., Halper M.  SIGITE 2019 (Proceedings of the 20th Annual SIG Conference on Information Technology Education, Tacoma, WA,  Oct 3-5, 2019) 49-54, 2019. Type: Proceedings
Dec 13 2019

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright © 2000-2022 ThinkLoud, Inc.
Terms of Use
| Privacy Policy