Wide-area backbone networks (WAN) of Internet service providers and cloud providers are the workhorses of Internet traffic delivery. The providers spend millions of dollars toward building access points across the world and interconnecting them using optical links. Improving the availability and efficiency of the WAN is central to their ability to provide services in a reliable, cost-effective manner. Consequently, there has been significant research into measuring and characterizing various aspects of the WAN, such as topology, routing, traffic, and reliability.
Much of prior work, however, focuses on the IP layer, and little is publicly known about the characteristics of the optical layer which forms the physical transmission medium of WANs. While laboratory measurements can inform certain quantities (e.g., expected signal quality), only “in the wild” characterization can shed light on the behavior and the combined impact of many relevant factors in practice.
Studying optical-layer characteristics of backbone networks is not simply a matter of curiosity. The performance of this layer ultimately determines the network’s effectiveness at carrying traffic.
Our dataset is based on 14 months of data, from February 2015 to April 2016, taken from Microsoft’s optical backbone in North America. This backbone has O(50) optical cross-connects, O(100) WAN segments, and O(1000) optical channels. We poll the aggregation devices every 15 minutes for their optical signal q-factor, transmit power (dBm), chromatic dispersion (ps/nm), and polarization mode dispersion. Below we share the data set for random 4000 channels across random 115 optical paths. For confidentiality reasons, we have taken out days at which there has been an outage. This data is the first public release of a large-scale optical backbone and provides researchers with a unique opportunity to study temporal behavior of optical channels, the quality of signal, correlation among channels, correlation among segments, and more.
All 4000 channels download here. Please review the license and email mgh [at] microsoft [dot] com if you have any questions.
What is Q-factor and its relation to link bandwidth?
Optical transmit power and its impact on WAN traffic engineering.
Everything You Always Wanted to Know About Optical Networking – But Were Afraid to Ask