Dynamically creating custom SDN high-speed network paths for big data science flows

Sergio Rivera, Mami Hayashida, James Griffioen, Zongming Fei

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations


Existing campus network infrastructure is not designed to effectively handle the transmission of big data sets. Performance degradation in these networks is often caused by middleboxes - appliances that enforce campus-wide policies by deeply inspecting all traffic going through the network (including big data transmissions).We are developing a Software-Defined Networking (SDN) solution for our campus network that grants privilege to science flows by dynamically calculating routes that bypass certain middleboxes to avoid the bottlenecks they create. Using the global network information provided by an SDN controller, we are developing graph databases approaches to compute custom paths that not only bypass middleboxes to achieve certain requirements (e.g., latency, bandwidth, hop-count) but also insert rules that modify packets hop-by-hop to create the illusion of standard routing/forward despite the fact that packets are being rerouted. In some cases, additional functionality needs to be added to the path using network function virtualization (NFV) techniques (e.g., NAT). To ensure that path computations are run on an up-To-date snapshot of the topology, we introduce a versioning mechanism that allows for lazy topology updates that occur only when "important" network changes take place and are requested by big data flows.

Original languageEnglish
Title of host publicationPEARC 2017 - Practice and Experience in Advanced Research Computing 2017
Subtitle of host publicationSustainability, Success and Impact
ISBN (Electronic)9781450352727
StatePublished - Jul 9 2017
Event2017 Practice and Experience in Advanced Research Computing, PEARC 2017 - New Orleans, United States
Duration: Jul 9 2017Jul 13 2017

Publication series

NameACM International Conference Proceeding Series
VolumePart F128771


Conference2017 Practice and Experience in Advanced Research Computing, PEARC 2017
Country/TerritoryUnited States
CityNew Orleans

Bibliographical note

Publisher Copyright:
© 2017 Copyright held by the owner/author(s).


  • Big Data Flows
  • Path Calculation
  • Software-Defined Networks

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications


Dive into the research topics of 'Dynamically creating custom SDN high-speed network paths for big data science flows'. Together they form a unique fingerprint.

Cite this