Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Joint online coflow routing and scheduling in data center networks
Tan H., Jiang S., Li Y., Li X., Zhang C., Han Z., Lau F. IEEE/ACM Transactions on Networking27 (5):1771-1786,2019.Type:Article
Date Reviewed: Sep 3 2020

With the proliferation of big data initiatives across corporations and academia, the importance of distributed computing frameworks has created many research opportunities related to routing and scheduling the multiple groups of parallel flows generated by MapReduce, Spark, and other similar frameworks. Coflows is the name given to the abstraction of the network flows that distribute the data for parallel computation on distributed nodes and the subsequent redistribution of the results for aggregation or further computation.

The authors propose an algorithm, for both scheduling and routing traffic between nodes in a data center, which aims to minimize the total coflow completion time. Given that each computation stage is dependent on all the data for that stage having been sent and received, minimizing this time is of much greater benefit than the traditional minimization of the average packet transmission time. A single delayed flow will hold up the whole distributed computation.

The authors propose a constraint minimization approach, which being NP hard, they approximate using a binary search over a simplified solution space. Having identified a viable set of paths, the exact route across the network is made with random choices at each hop, such that the constraints are still satisfied. Multiple coflows are handled without rerouting existing traffic, but rather by rescaling the bandwidth utilization along each path so as to accommodate the newly arrived coflow, once again using a binary search. One advantage of the proposed approach is that it does not require upfront knowledge of all future coflows. One criticism is that the provided theoretical performance guarantees are far too wide to be of practical interest.

Reviewer:  Bernard Kuc Review #: CR147052 (2102-0037)
Bookmark and Share
  Featured Reviewer  
 
Network Architecture And Design (C.2.1 )
 
 
Routing Protocols (C.2.2 ... )
 
 
Scheduling (D.4.1 ... )
 
Would you recommend this review?
yes
no
Other reviews under "Network Architecture And Design": Date
Designing data networks
Ellis R., Prentice-Hall, Inc., Upper Saddle River, NJ, 1986. Type: Book (9789780132018647)
Apr 1 1986
Internetworking
Pouzin L., Prentice-Hall, Inc., Upper Saddle River, NJ, 1986. Type: Book (9789780131650503)
Feb 1 1987
Broadband network technology: an overview for the data and telecommunications industries
Cooper E., Prentice-Hall, Inc., Upper Saddle River, NJ, 1986. Type: Book (9789780130833792)
Oct 1 1987
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy