Multipath TCP
Multipath TCP (MPTCP) is an ongoing effort of the Internet Engineering Task Force's (IETF) Multipath TCP working group, that aims at allowing a Transmission Control Protocol (TCP) connection to use multiple paths to maximize throughput and increase redundancy. In January 2013, the IETF published the Multipath specification as an Experimental standard in RFC 6824. It was replaced in March 2020 by the Multipath TCP v1 specification in RFC 8684.
| Communication protocol | |
 | |
| Purpose | General Purpose |
|---|---|
| Developer(s) | IETF |
| Introduction | 2009 |
| Based on | IP, normally layered with TCP |
| RFC(s) | 8684 |
| Internet protocol suite |
|---|
| Application layer |
| Transport layer |
| Internet layer |
| Link layer |
Multipath TCP (MPTCP) is an ongoing effort of the Internet Engineering Task Force's (IETF) Multipath TCP working group, that aims at allowing a Transmission Control Protocol (TCP) connection to use multiple paths to maximize throughput and increase redundancy.[1]
In January 2013, the IETF published the Multipath specification as an Experimental standard in RFC 6824. It was replaced in March 2020 by the Multipath TCP v1 specification in RFC 8684.
Benefits
[edit]The redundancy offered by Multipath TCP enables inverse multiplexing of resources, and thus increases TCP throughput to the sum of all available link-level channels instead of using a single one as required by standard TCP. Multipath TCP is backward compatible with standard TCP.
Multipath TCP is particularly useful in the context of wireless networks;[2] using both Wi-Fi and a mobile network is a typical use case.[3] In addition to the gains in throughput from inverse multiplexing, links may be added or dropped as the user moves in or out of coverage without disrupting the end-to-end TCP connection.[4]
The problem of link handover is thus solved by abstraction in the transport layer, without any special mechanisms at the network or link layers. Handover functionality can then be implemented at the endpoints without requiring special functionality in the subnetworks - in accordance to the Internet's end-to-end principle.
Multipath TCP also brings performance benefits in datacenter environments.[5] In contrast to Ethernet channel bonding using 802.3ad link aggregation, Multipath TCP can balance a single TCP connection across multiple interfaces and reach very high throughput.[6]
Multipath TCP causes a number of new issues. From a network security perspective, multipath routing causes cross-path data fragmentation that results in firewalls and malware scanners becoming inefficient when they only see one path's traffic. In addition, SSL decryption will become inefficient by way of the end-to-end encryption protocols.[7]
User interface
[edit]In order to facilitate its deployment, Multipath TCP presents the same socket interface as TCP. This implies that any standard TCP application can be used above Multipath TCP while in fact spreading data across several subflows.[8]
Some applications could benefit from an enhanced API to control the underlying Multipath TCP stack. Two different APIs have been proposed to expose some of features of the Multipath TCP stack to applications: an API that extends Netlink on Linux[9] and an enhanced socket API.[10]
Implementations
[edit]In July 2013, the MPTCP working group reported five independent implementations of Multipath TCP,[11] including the initial reference implementation[8] in the Linux kernel.[12][13]
The currently available implementations are:
- Linux kernel (new reference implementation) introduced in the mainlined kernel in v5.6[14]
- Linux kernel (initial reference implementation) fork from Université catholique de Louvain researchers and other collaborators[8]
- FreeBSD (IPv4 only) from Swinburne University of Technology[15] and AI/ML-based from Deakin University[16]
- F5 Networks BIG-IP LTM[17]
- Citrix Netscaler[18]
- Apple iOS 7, released on September 18, 2013 is the first large scale commercial deployment of Multipath TCP.[19] Since iOS 7, any application can use Multipath TCP.
- Apple Mac OS X 10.10, released on October 16, 2014[20]
- Alcatel-Lucent released MPTCP proxy version 0.9 source code on October 26, 2012[21][22]
In July 2014, Oracle reported that an implementation on Solaris was being developed. In June 2015, work is in progress.[23] There is also an ongoing effort to push a new Multipath TCP implementation in the mainline Linux kernel.[24]
During the MPTCP WG meeting at IETF 93, SungHoon Seo announced that KT had deployed since mid June a commercial service that allows smartphone users to reach 1 Gbit/s using a MPTCP proxy service.[25] Wavenet uses the Linux kernel implementation (developed by Tessares) to deploy Hybrid Access Networks.
Use cases
[edit]Multipath TCP was designed to be backward compatible with regular TCP. As such, it can support any application. However, some specific deployments[26] leverage the ability of simultaneously using different paths.
Apple uses Multipath TCP to support the Siri application on iPhone. Siri sends voice samples over an HTTPS session to Apple servers. Those servers reply with the information requested by the users. According to Apple engineers, the main benefits[27] of Multipath TCP with this application are:
- User-feedback (Time-to-First-Word) 20% faster in the 95th percentile
- 5x reduction of network failures
Other deployment use Multipath TCP to aggregate the bandwidth of different networks. For example, several types of smartphones, notably in Korea, use Multipath TCP to bond WiFi and 4G through SOCKS proxies.[28] Another example are the Hybrid Access Networks that are deployed by network operators willing to combine xDSL and LTE networks. In this deployment, Multipath TCP is used to efficiently balance the traffic over the xDSL and the LTE network.[29]
In the standardisation of converged fixed and mobile communication networks, 3GPP and BBF are interoperating to provide an ATSSS (Access Traffic Selection, Switching, Splitting) feature to support multipath sessions, e.g, by applying Multipath TCP both in the User Equipment (UE) or Residential Gateway (RG) and on the network side.[30]
Multipath TCP options
[edit]Multipath TCP uses options that are described in detail in RFC 8684. All Multipath TCP options are encoded as TCP options with Option Kind 30, as reserved by IANA.[31]
The Multipath TCP option consists of the standard Option-Kind (in this case 30) and Length values, followed by a 4-bit subtype field, for which the IANA maintains a sub-registry entitled "MPTCP Option Subtypes" under the "Transmission Control Protocol (TCP) Parameters" registry. This subtype field indicates the MPTCP header type, and its values are defined as follows:
| Value | Symbol | Name |
|---|---|---|
| 0x0 | MP_CAPABLE | Multipath Capable |
| 0x1 | MP_JOIN | Join Connection |
| 0x2 | DSS | Data Sequence Signal (Data ACK and Data Sequence Mapping) |
| 0x3 | ADD_ADDR | Add Address |
| 0x4 | REMOVE_ADDR | Remove Address |
| 0x5 | MP_PRIO | Change Subflow Priority |
| 0x6 | MP_FAIL | Fallback |
| 0x7 | MP_FASTCLOSE | Fast Close |
| 0x8 | MP_TCPRST | Subflow Reset |
| 0xf | MP_EXPERIMENTAL | Reserved for Private Use |
Values 0x9 through 0xe are currently unassigned.
Protocol operation
[edit]Simplified description
[edit]
The core idea of multipath TCP is to define a way to build a connection between two hosts and not between two interfaces (as standard TCP does).
For instance, Alice has a smartphone with 3G and WiFi interfaces (with IP addresses 10.11.12.13 and 10.11.12.14) and Bob has a computer with an Ethernet interface (with IP address 20.21.22.23).
In standard TCP, the connection is established between two IP addresses. Each TCP connection is identified by a four-tuple (source and destination addresses and ports). Given this restriction, an application can only create one TCP connection through a single link. Multipath TCP allows the connection to use several paths simultaneously. For this, Multipath TCP creates one TCP connection, called subflow, over each path that needs to be used.
The purpose of the different protocol operations (defined in RFC 6824) are:
- to handle when and how to add/remove paths (for instance if there's a connection lost or some congestion control)
- to be compatible with legacy TCP hardware (such as some firewalls that can automatically reject TCP connections if the sequence number aren't successive)
- to define a fair congestion control strategy between the different links and the different hosts (especially with those that don't support MPTCP)
Multipath TCP adds new mechanisms to TCP transmissions:
- The subflow system, used to gather multiple standard TCP connections (the paths from one host to another). Subflows are identified during the TCP three-way handshake. After the handshake, an application can add or remove some subflows (subtypes 0x3 and 0x4).
- The MPTCP DSS option contains a data sequence number and an acknowledgement number. These allow receiving data from multiple subflows in the original order, without any corruption (message subtype 0x2)
- A modified retransmission protocol handles congestion control and reliability.
Detailed specification
[edit]The detailed protocol specification is provided in RFC 8684. Several survey articles provide an introduction to the protocol.[32][33]
Congestion control
[edit]Several congestion control mechanisms have been defined for Multipath TCP. Their main difference with classical TCP congestion control schemes is that they need to react to congestion on the different paths without being unfair with single path TCP sources that could compete with them on one of the paths.[3] Four Multipath TCP congestion control schemes are currently supported by the Multipath TCP implementation in the Linux kernel.
- The Linked Increase Algorithm defined in RFC 6356
- The Opportunistic Linked Increase Algorithm[34]
- The wVegas delay based congestion control algorithm
- The Balanced Linked Increase Algorithm[35]
Alternatives
[edit]Multipath QUIC
[edit]The IETF is currently developing the QUIC protocol that integrates the features that are traditionally found in the TCP, TLS and HTTP protocols. It can be extended to support the same use cases as Multipath TCP. A first design for Multipath QUIC has been proposed,[36] implemented and evaluated.[37]
Stream Control Transmission Protocol
[edit]Stream Control Transmission Protocol (SCTP) is a reliable in-order datagram stream transport protocol originally intended for telecommunication signaling. It supports concurrent use of multiple access links and allows the application to influence the access interface selections on a datagram stream basis. It also supports mobility via access renegotiation. Hence, SCTP is also a transport layer solution. It offers type 3 flow granularity with concurrency, but with more flow scheduling control than Multipath TCP. It also fully supports mobility in a fashion similar to Multipath TCP.[38]
IMS SIP
[edit]Within the IP Multimedia Subsystem (IMS) architecture, Session Initiation Protocol (SIP) can support the concurrent use of multiple contact IP addresses for the registration of one or more IMS user agents. This allows for the creation of multiple IMS signaling paths. On these signaling paths, signaling messages carry Session Description Protocol (SDP) messaging to negotiate media streams. SDP allows for the (re-)negotiation of the streams of one media session over multiple paths. In turn, this enables application layer multipath transport. From this point of view, IMS can therefore offer application layer multipath support with flow granularity and concurrent access. A multipath extension to Real-time Transport Protocol (RTP) has been under discussion within the IETF.[39] Multipath RTP can offer flow granularity with concurrent access and mobility (via IMS, SDP signaling or the RTP control protocol).[38] Very recently in addition a proposal to extend also DCCP (Datagram Congestion Control Protocol) by a multipath feature is discussed at IETF in TSVWG (Transport Area Working Group) [40] dubbed as MP-DCCP.
AI/ML-based Multipath TCP
[edit]A deep reinforcement learning (DRL) framework for joint congestion control and packet scheduling uses policy gradients to learn congestion control and scheduling strategies from experience. [41] DRL-based Multipath TCP has been used in distributed edge learning applications.[42]
Other protocols and experiments
[edit]At the session layer, the Mobile Access Router project experimented in 2003 with the aggregation of multiple wireless accesses with heterogeneous technologies, transparently balancing traffic between them in response to the perceived performance of each of them.[43]
Parallel access schemes[38] used to accelerate transfers by taking advantage of HTTP range requests to initiate connections to multiple servers of a replicated content, are not equivalent to Multipath TCP as they involve the application layer and are limited to content of known size.
RFC
[edit]- RFC 6181 - Threat Analysis for TCP Extensions for Multipath Operation with Multiple Addresses
- RFC 6182 - Architectural Guidelines for Multipath TCP Development
- RFC 6356 - Coupled Congestion Control for Multipath Transport Protocols
- RFC 6824 - TCP Extensions for Multipath Operation with Multiple Addresses (v0; replaced by RFC 8684)
- RFC 6897 - Multipath TCP (MPTCP) Application Interface Considerations
- RFC 7430 - Analysis of Residual Threats and Possible Fixes for Multipath TCP (MPTCP)
- RFC 8041 - Use Cases and Operational Experience with Multipath TCP
- RFC 8684 - TCP Extensions for Multipath Operation with Multiple Addresses (v1)
- RFC 8803 - 0-RTT TCP Convert Protocol
See also
[edit]References
[edit]- ^ Multipath TCP working group
- ^ Paasch, Christoph; Detal, Gregory; Duchene, Fabien; Raiciu, Costin; Bonaventure, Olivier (2012). "Exploring mobile/WiFi handover with multipath TCP". Proceedings of the 2012 ACM SIGCOMM workshop on Cellular networks: Operations, challenges, and future design - Cell Net '12. ACM SIGCOMM workshop on Cellular Networks (Cellnet'12). p. 31. doi:10.1145/2342468.2342476. ISBN 9781450314756.
- ^ a b S. Pokhrel; M. Panda; H. Vu (2017-02-24). "Analytical Modeling of Multipath TCP Over Last-Mile Wireless". IEEE/ACM Transactions on Networking. 25 (3): 1876–1891. doi:10.1109/TNET.2017.2663524. S2CID 21518823.
- ^ S. Pokhrel; M. Mandjes (2019-03-24). "Improving Multipath TCP Performance over WiFi and Cellular Networks: an Analytical Approach". IEEE Transactions on Mobile Computing. 25 (3): 1876–1891. doi:10.1109/TMC.2018.2876366. S2CID 69263415.
- ^ Raiciu; Barre; Pluntke; Greenhalgh; Wischik; Handley (2011). "Improving datacenter performance and robustness with multipath TCP". ACM SIGCOMM Computer Communication Review. 41 (4): 266. CiteSeerX 10.1.1.306.3863. doi:10.1145/2043164.2018467. S2CID 61962047.
- ^ C. Paasch; G. Detal; S. Barré; F. Duchêne; O. Bonaventure. "The fastest TCP connection with Multipath TCP". Retrieved 2013-09-20.
- ^ Afzal, Zeeshan (2020). Life of a Security Middlebox Challenges with Emerging Protocols and Technologies (PhD). ISBN 978-91-7867-103-8. OCLC 1139703033.
- ^ a b c "The Linux kernel MultiPath TCP project". Retrieved 2014-11-28.
- ^ Hesmans, B.; Detal, G.; Barre, S.; Bauduin, R.; Bonaventure, O. (2015). "SMAPP". SMAPP towards smart Multipath TCP-enabled applications. pp. 1–7. doi:10.1145/2716281.2836113. ISBN 9781450334129. S2CID 9940025.
- ^ "Survey of MPTCP Implementations (Internet-Draft, 2013)". Retrieved 2013-09-20.
- ^ Barre; Paasch; Bonaventure (2011). "MultiPath TCP: From Theory to Practice". IFIP Networking.
- ^ Raiciu; Paasch; Barre; Ford; Honda; Duchene; Bonaventure; Handley (2012). "How Hard Can It Be? Designing and Implementing a Deployable Multipath TCP". Usenix NSDI: 399–412.
- ^ "Linux MPTCP Upstream Project".
- ^ "Multipath TCP for FreeBSD v0.1". Retrieved 2013-09-23.
- ^ Pokhrel, Shiva Raj; Kua, Jonathan; Fleming, Brenton; Ozer, Sebnem; Howe, Jeff; Walid, Anwar (2024). "Multipath TCP implementation under FreeBSD-13 for pluggable machine learning models". Computer Networks. 252: 596–609. doi:10.1016/j.comnet.2024.110671.
- ^ "Release Note: BIG-IP LTM and TMOS 11.5.0". f5 Networks. 2014-05-30. Retrieved 2014-05-30.
- ^ John Gudmundson (2013-05-28). "Maximize mobile user experience with NetScaler Multipath TCP". Citrix. Retrieved 2013-09-20.
- ^ "Apple seems to also believe in Multipath TCP". Retrieved 2013-09-20.
- ^ "MPTCP ROAMS FREE (BY DEFAULT!) – OS X YOSEMITE". 2014-10-20. Retrieved 2015-09-16.
- ^ Georg Hampel (2012-10-26). "code release for MPTCP Proxy". Alcatel-Lucent. Retrieved 2016-12-28.
- ^ Georg Hampel; Anil Rana (2012-10-26). "MPTCP PROXY" (PDF). Bell Labs/Alcatel-Lucent. Retrieved 2016-12-28.
- ^ Rao, Shoaib. "Some comments on RFC 6824". Retrieved 25 June 2015.
- ^ "MPTCP Upstream Project". 2019-12-17. Retrieved 2020-01-10.
- ^ "KT's GiGA LTE" (PDF).
- ^ Bonaventure, Olivier; See, SungHoon (2016). "Multipath TCP Deployments". IETF Journal.
- ^ C. Paasch, iOS & Linux Implementation Updates, IETF-99, https://datatracker.ietf.org/meeting/99/materials/slides-99-mptcp-sessa-ios-linux-implementation-updates/
- ^ S. Seo, KT’s GiGA LTE - Mobile MPTCP Proxy Deployment, IETF-97, https://www.ietf.org/proceedings/97/slides/slides-97-banana-kt-giga-lte-mobile-mptcp-proxy-development-01.pdf
- ^ Gregory Detal, Sebastien Barre, Bart Peirens, Olivier Bonaventure, "Leveraging Multipath TCP to create Hybrid Access Networks ", SIGCOMM'17 (Industrial demo), http://conferences.sigcomm.org/sigcomm/2017/files/program-industrial-demos/sigcomm17industrialdemos-paper4.pdf
- ^ 3GPP TR 23.793, "Study on access traffic steering, switch and splitting support in the 5G system architecture (Release 16)", https://www.3gpp.org/ftp/Specs/latest/Rel-16/23_series/23793-g00.zip
- ^ "IANA Protocol Registry TCP Option Kind Numbers". Retrieved 2013-09-24.
- ^ Paasch, Christoph; Bonaventure, Olivier (April 2014). "Multipath TCP". Communications of the ACM. 57 (4): 51–57. doi:10.1145/2578901. hdl:2078.1/141195. S2CID 17581886.
- ^ Raiciu, Costin; Iyengar, Janardhan; Bonaventure, Olivier (2013). Haddadi, Hamed; Bonaventure, Olivier (eds.). Recent Advances in Reliable Transport Protocols. ACM SIGCOMM.
- ^ Khalili, Ramin; Gast, Nicolas; Popovic, Miroslav; Upadhyay, Utkarsh; Le Boudec, Jean-Yves (2012). "MPTCP is not pareto-optimal". Proceedings of the 8th international conference on Emerging networking experiments and technologies. pp. 1–12. doi:10.1145/2413176.2413178. ISBN 9781450317757. S2CID 14210629.
- ^ Peng, Qiuyu; Walid, Anwar; Hwang, Jaehyun; Low, Steven H. (2013). "Multipath TCP: Analysis, Design and Implementation". IEEE/ACM Transactions on Networking. 24: 596–609. arXiv:1308.3119. Bibcode:2013arXiv1308.3119P. doi:10.1109/TNET.2014.2379698. S2CID 250322.
- ^ Q. De Coninck; O. Bonaventure (2010-10-30). "Multipath Extension for QUIC". IETF.
- ^ Q. De Coninck; O. Bonaventure (2010-12-12). "Multipath QUIC: Design and Evaluation" (PDF). Proc. Conext'2017, Seoul, Korea.
- ^ a b c P. Rodriguez; E. Biersack (2002-07-01). "Dynamic parallel access to replicated content in the Internet" (PDF). IEEE/ACM Transactions on Networking. Archived from the original (PDF) on 2013-09-27.
- ^ "Draft-ietf-avtcore-MPRTP-03".
- ^ "Draft-ietf-TSVWG-multipath-DCCP-04".
- ^ S. Pokhrel; A. Walid (2023-02-01). "Learning to Harness Bandwidth With Multipath Congestion Control and Scheduling". IEEE Transactions on Mobile Computing. 22 (2): 996–1009. arXiv:2105.14271. doi:10.1109/TMC.2021.3085598. S2CID 69245415.
- ^ S. Pokhrel; J. Choi; A. Walid (2023). "Fair and Efficient Distributed Edge Learning With Hybrid Multipath TCP". IEEE/ACM Transactions on Networking. 31 (4): 1582–1594. arXiv:2211.09723. doi:10.1109/TNET.2022.3219924. S2CID 98245675.
- ^ R. Chakravorty; I. Pratt; P. Rodriguez (2003-07-01). "Mobile Access Router". University of Cambridge, Microsoft Research.
External links
[edit]