In Brief

Many studies have shown that the default Internet path can be suboptimal, potentially leading to poor throughput between hosts. SideStep is the first scalable and efficient system to provide free, open access to alternative paths to improve throughput -- sometimes even doubling or tripling performance. The SideStep service reuses information from content distribution networks (CDNs) to locate quality overlay paths and stream data over them. SideStep is packaged as a Java-based library and stream API that is easy to integrate into existing applications. To demonstrate its effectiveness, we provide DraFTP, and open-source FTP suite that uses SideStep to improve download performance. You can find our downloads here.

For a more detailed description, click here.

News

Motivation and Approach

The Detour study showed that Internet paths are generally suboptimal, both in terms of latency and packet loss. Later, the RON (Reliable Overlay Network) project demonstrated that users can get better transfer performance by diverting your transfer to another computer before it goes to the destination. Part of the reason for this situation is that ISPs have arrangements to carry traffic for each other, and those business arrangements trump optimal path selection. Because each ISP can have different arrangements, another nearby ISP may have a better path for you.

The primary reason why RON is not widely deployed is that it requires active probing that results in measurement overhead proportional to the square of the number of nodes in the system. Such overhead is unacceptable in many Internet-scale applications, e.g., P2P networks that tend to have millions of users. An alternative approach is to pick detouring points at random, and hope that you get lucky and find a better path. Although there is very low overhead in this approach, it is unlikely to improve performance in general. SideStep sits between these two exteremes of the cost/performance tradeoff: it finds high-quality detour points with high probability, and requires only a constant amount of measurement overhead per node.

SideStep achieves high scalability by using content distribution network (CDN) redirection dynamics as hints regarding good candidate detour points. CDNs cache copies of web objects on thousands of servers worldwide and redirect clients to different servers, over short time scales, based on server load and network conditions. In Drafting Behind Akamai, we demonstrate that these redirections are primarily driven by network conditions and suggest that one could use them to identify quality Internet paths without monitoring or probing them. Initial results from SideStep show that CDN redirection \emph{dynamics} are indeed effective hints -- inexpensive to attain and validate and sufficiently accurate to drive a large-scale detouring service.

The approach is surprisingly effective. In our measurement study conducted on 100s of computers worldwide, we found that SideStep improves performance more than half the time. (The other half of the time there was no better path to be found, so performance was the same -- SideStep can never hurt your bandwidth.)

Motivation for Names

We call this project SideStep because we are "sidestepping" poor Internet paths given to users by default. The FTP suite is called DraFTP because it, like SideStep, exploits the "drafting" approach to building efficient large-scale systems. In this case, we efficiently determine path-quality information by allowing CDNs to absorb the cost of measurement much like cyclists in a peleton efficiently cruise at high speeds by allowing riders in front to deflect the slowing force of wind.

People

Collaborators

Publications

Resources

Frequently Asked Questions