research-article

Public Access

Virtual Time Machine for Reproducible Network Emulation

Authors:

Jason LiuAuthors Info & Claims

SIGSIM-PADS '19: Proceedings of the 2019 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation

Pages 61 - 70

https://doi.org/10.1145/3316480.3322897

Published: 29 May 2019 Publication History

Abstract

Reproducing network emulation experiments on diverse physical platforms with varying computation and communication resources is non-trivial. Many state-of-the-art network emulation testbeds do not guarantee timing fidelity. Consequently, results obtained from these testbeds can be misleading, especially when insufficient physical resources are provided to run the experiments. Reproducibility is far from being the norm. In this paper, we present a novel approach that can guarantee reproducible results for network emulation. Our system, called the Virtual Time Machine (VTM), takes advantage of both time dilation and carefully controlled scheduling of the virtual machines. Time dilation allows sufficiently scaled resources to run the experiments in virtual time, and controlled VM scheduling prescribes the precise timing of message passing for distributed applications---independent of the resource provisioning of the underlying physical testbed. Preliminary experiments show that VTM can guarantee reproducible results with varying time dilation, resource subscription, and VM scheduling scenarios.

References

[1]

Association for Computing Machinery (ACM). 2019. Artifact Review and Badging. https://www.acm.org/publications/policies/artifact-review-badging.

[2]

Craig Bergstrom, Srinidhi Varadarajan, and Godmar Back. 2006. The Distributed Open Network Emulator: Using Relativistic Time for Distributed Scalable Simulation. In Proceedings of the 20th Workshop on Principles of Advanced and Distributed Simulation (PADS'06). 19--28.

Digital Library

[3]

Chameleon. 2019. https://www.chameleoncloud.org/.

[4]

CloudLab. 2019. https://www.cloudlab.us/.

[5]

Phillip M. Dickens, Philip Heidelberger, and David M. Nicol. 1996. Parallelized direct execution simulation of message-passing parallel programs. IEEE Transactions on Parallel and Distributed Systems, Vol. 7, 10 (October 1996), 1090--1105.

Digital Library

[6]

Miguel Erazo, Yue Li, and Jason Liu. 2009. SVEET! A scalable virtualized evaluation environment for TCP. In Proceedings of the 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities (TridentCom'09).

[7]

Global Environment for Network Innovations (GENI). 2019. http://www.geni.net/.

[8]

Andreas Grau, Steffen Maier, Klaus Herrmann, and Kurt Rothermel. 2008. Time Jails: A Hybrid Approach to Scalable Network Emulation. In Proceedings of the 22nd Workshop on Principles of Advanced and Distributed Simulation (PADS'08). 7--14.

Digital Library

[9]

Diwaker Gupta, Kashi Venkatesh Vishwanath, Marvin McNett, Amin Vahdat, Ken Yocum, Alex Snoeren, and Geoffrey M. Voelker. 2011. DieCast: Testing Distributed Systems with an Accurate Scale Model. ACM Trans. Comput. Syst., Vol. 29, 2, Article 4 (2011), 48 pages.

Digital Library

[10]

Diwaker Gupta, Ken Yocum, Marvin McNett, Alex C. Snoeren, Amin Vahdat, and Geoffrey M. Voelker. 2006. To Infinity and Beyond: Time-Warped Network Emulation. In Proceedings of the 3rd Symposium on Networked Systems Design and Implementation (NSDI'06). 87--100.

Digital Library

[11]

Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, Bob Lantz, and Nick McKeown. 2012. Reproducible Network Experiments Using Container-based Emulation. In Proc. of the 8th International Conference on Emerging Networking Experiments and Technologies (CoNEXT'12). 253--264.

Digital Library

[12]

George Karypis and Vipin Kumar. 1998. A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput., Vol. 20 (1998), 359--392. Issue 1.

Digital Library

[13]

Jereme Lamps, Vignesh Babu, David M. Nicol, Vladimir Adam, and Rakesh Kumar. 2018. Temporal Integration of Emulation and Network Simulators on Linux Multiprocessors. ACM Trans. Model. Comput. Simul., Vol. 28, 1, Article 1 (Jan. 2018), 25 pages.

Digital Library

[14]

Jereme Lamps, David M. Nicol, and Matthew Caesar. 2014. TimeKeeper: A Lightweight Virtual Time System for Linux. In Proceedings of the 2nd ACM SIGSIM Conference on Principles of Advanced Discrete Simulation (SIGSIM-PADS'14). 179--186.

Digital Library

[15]

Bob Lantz, Brandon Heller, and Nick McKeown. 2010. A Network in a Laptop: Rapid Prototyping for Software-defined Networks. In Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks (Hotnets-IX). Article 19, 6 pages.

Digital Library

[16]

Jason Liu. 2008. A primer for real-time simulation of large-scale networks. In Proceedings of the 41st Annual Simulation Symposium (ANSS'08). 85--94.

Digital Library

[17]

Jason Liu, Yougu Yuan, David M. Nicol, Robert S. Gray, Calvin C. Newport, David Kotz, and Luiz Felipe Perrone. 2004. Simulation Validation Using Direct Execution of Wireless Ad-Hoc Routing Protocols. In Proceedings of the 18th Workshop on Parallel and Distributed Simulation (PADS'04). 7--16.

Digital Library

[18]

Xin Liu, Huaxia Xia, and Andrew A. Chien. 2003. Network emulation tools for modeling grid behavior. In Proceedings of 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid'03).

[19]

Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. 2008. OpenFlow: Enabling Innovation in Campus Networks. SIGCOMM Comput. Commun. Rev., Vol. 38, 2 (March 2008), 69--74.

Digital Library

[20]

Open vSwitch. 2019. http://openvswitch.org/.

[21]

P. Wette et al. 2014. MaxiNet: Distributed emulation of software-defined networks. In IFIP Networking Conference. 1--9.

[22]

Platforms for Advanced Wireless Research (PAWR). 2019. https://www.advancedwireless.org/.

[23]

Steven K. Reinhardt, Mark D. Hill, James R. Larus, Alvin R. Lebeck, James C. Lewis, and David A. Wood. 1993. The Wisconsin Wind Tunnel: Virtual Prototyping of Parallel Computers. In Proceedings of the 1993 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems. 48--60.

Digital Library

[24]

Hajime Tazaki, Fr�d�ric Uarbani, Emilio Mancini, Mathieu Lacage, Daniel Camara, Thierry Turletti, and Walid Dabbous. 2013. Direct Code Execution: Revisiting Library OS Architecture for Reproducible Network Experiments. In Proceedings of the 9th ACM Conference on Emerging Networking Experiments and Technologies (CoNEXT'13). 217--228.

Digital Library

[25]

Elias Weing"artner, Florian Schmidt, Hendrik Vom Lehn, Tobias Heer, and Klaus Wehrle. 2011. SliceTime: A Platform for Scalable and Accurate Network Emulation. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI'11). 253--266.

Digital Library

[26]

Jiaqi Yan and Dong Jin. 2015. VT-Mininet: Virtual-time-enabled Mininet for Scalable and Accurate Software-Define Network Emulation. In Proceedings of the 1st ACM SIGCOMM Symposium on Software Defined Networking Research (SOSR'15). Article 27, 7 pages.

Digital Library

[27]

Yuhao Zheng, Dong Jin, and David M. Nicol. 2013. Impacts of Application Lookahead on Distributed Network Emulation. In Proceedings of the 2013 Winter Simulation Conference (WSC'13). 2996--3007.

Digital Library

[28]

Yuhao Zheng and David M. Nicol. 2011. A Virtual Time System for OpenVZ-Based Network Emulations. In Proceedings of the 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation (PADS'11). 1--10.

Digital Library

Cited By

Babu VNicol D(2022)Temporally synchronized emulation of devices with simulation of networksProceedings of the 2022 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3518997.3531020(1-12)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3518997.3531020
Babu VNicol D(2022)Mechanisms for Precise Virtual Time Advancement in Network EmulationACM Transactions on Modeling and Computer Simulation10.1145/347886732:2(1-26)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3478867
Khan SAkram AAlsaif HUsman M(2021)Emulating Software Defined Network using Mininet-ns3-WIFI Integration for Wireless NetworksWireless Personal Communications: An International Journal10.1007/s11277-020-08002-w118:1(75-92)Online publication date: 2-Jan-2021
https://dl.acm.org/doi/10.1007/s11277-020-08002-w
Show More Cited By

Index Terms

Virtual Time Machine for Reproducible Network Emulation

Recommendations

NEAT

In evaluating the performance of highly complex networked systems, emulation is often used as it maintains much of the realism of testbeds, while offering increased flexibility and scalability. In large emulation systems, multiple and heterogeneous ...
Live gang migration of virtual machines
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing

This paper addresses the problem of simultaneously migrating a group of co-located and live virtual machines (VMs), i.e, VMs executing on the same physical machine. We refer to such a mass simultaneous migration of active VMs as "live gang migration". ...
Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning
VEE '09: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

We present the design, implementation, and evaluation of post-copy based live migration for virtual machines (VMs) across a Gigabit LAN. Live migration is an indispensable feature in today's virtualization technologies. Post-copy migration defers the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGSIM-PADS '19: Proceedings of the 2019 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation

May 2019

215 pages

ISBN:9781450367233

DOI:10.1145/3316480

General Chair:
Dong (Kevin) Jin
Illinois Institute of Technology Chicago, Illinois, USA
,
Program Chairs:
Jason Liu
Florida International University, Miami, Florida USA
,
Laxmikant V. Kale
University of Illinois at Urbana-Champaign Urbana, Illinois USA

Copyright � 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSIM: ACM Special Interest Group on Simulation and Modeling

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

DHS
NSF
National Natural Science Foundation of China

Conference

SIGSIM-PADS '19

Sponsor:

SIGSIM

SIGSIM-PADS '19: SIGSIM Principles of Advanced Discrete Simulation

June 3 - 5, 2019

IL, Chicago, USA

Acceptance Rates

SIGSIM-PADS '19 Paper Acceptance Rate 13 of 25 submissions, 52%;

Overall Acceptance Rate 398 of 779 submissions, 51%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
442
Total Downloads

Downloads (Last 12 months)112
Downloads (Last 6 weeks)11

Reflects downloads up to 22 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Babu VNicol D(2022)Temporally synchronized emulation of devices with simulation of networksProceedings of the 2022 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3518997.3531020(1-12)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3518997.3531020
Babu VNicol D(2022)Mechanisms for Precise Virtual Time Advancement in Network EmulationACM Transactions on Modeling and Computer Simulation10.1145/347886732:2(1-26)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3478867
Khan SAkram AAlsaif HUsman M(2021)Emulating Software Defined Network using Mininet-ns3-WIFI Integration for Wireless NetworksWireless Personal Communications: An International Journal10.1007/s11277-020-08002-w118:1(75-92)Online publication date: 2-Jan-2021
https://dl.acm.org/doi/10.1007/s11277-020-08002-w
Babu VNicol DLiu JGiabbanelli PCarothers C(2020)Precise Virtual Time Advancement for Network EmulationProceedings of the 2020 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3384441.3395978(175-186)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3384441.3395978

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents