Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
DeepGauge: multi-granularity testing criteria for deep learning systems
Ma L., Juefei-Xu F., Zhang F., Sun J., Xue M., Li B., Chen C., Su T., Li L., Liu Y., Zhao J., Wang Y.  ASE 2018 (Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, Montpellier, France, Sep 3-7, 2018)120-131.2018.Type:Proceedings
Date Reviewed: Oct 30 2019

Deep learning systems, driven by the success of deep neural networks (DNNs), are used in a wide variety of application areas, including safety-critical areas such as medical diagnostics and autonomous vehicles. However, DNN testing lags behind the testing of more conventional safety-critical systems.

This paper presents and evaluates a set of testing criteria for deep learning systems that measure testing adequacy. Experimental results indicate that the criteria are capable of distinguishing the effectiveness of different adversarial techniques and also have the potential to enable analysis of the internal states of DNNs.

This paper is likely to be of interest to readers concerned with DNN experiments, as well as readers with an interest in developing engineering processes for safety- or business-critical systems that incorporate deep learning systems. The work presented provides a promising basis on which to develop automated testing for such systems.

Reviewer:  Edel Sherratt Review #: CR146753 (2002-0035)
Bookmark and Share
 
Testing And Debugging (D.2.5 )
 
 
General (D.2.0 )
 
 
Learning (I.2.6 )
 
Would you recommend this review?
yes
no
Other reviews under "Testing And Debugging": Date
Software defect removal
Dunn R., McGraw-Hill, Inc., New York, NY, 1984. Type: Book (9789780070183131)
Mar 1 1985
On the optimum checkpoint selection problem
Toueg S., Babaoglu O. SIAM Journal on Computing 13(3): 630-649, 1984. Type: Article
Mar 1 1985
Software testing management
Royer T., Prentice-Hall, Inc., Upper Saddle River, NJ, 1993. Type: Book (9780135329870)
Mar 1 1994
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy