IWARP
From Wikipedia, the free encyclopedia
- The correct title of this article is iWARP. The initial letter is shown capitalized due to technical restrictions.
The Internet Wide Area RDMA Protocol (iWARP) is an Internet Engineering Task Force (IETF) update of the RDMA Consortium's RDMA over TCP standard. iWARP is a superset of the Virtual Interface Architecture that permits zero-copy transmission over legacy TCP. It may be thought of as the features of InfiniBand applied to Ethernet.
Because a kernel implementation of the TCP stack is a tremendous bottleneck, a few vendors now implement TCP in hardware. As simple data loses are rare in tightly coupled network environments, the error-correction mechanisms of TCP may be performed by software while the more frequently performed communications are handled strictly by logic embedded on the NIC. This additional hardware is known as the TCP offload engine (TOE).
TOE itself does not prevent copying on the receive side, and must be combined with RDMA hardware for zero-copy results. The RDMA / TCP specification is a set of different wire protocols intended to be implemented in hardware (though it seems feasible to emulate it in software for compatibility but without the performance benefits).
The main component is the Data Direct Protocol (DDP), which permits the actual zero-copy transmission. DDP itself does not perform the transmission; TCP does.
However, TCP does not respect message boundaries; it sends data as a sequence of bytes without regard to protocol data units (PDU). In this regard, DDP itself may be better suited for SCTP, and indeed a focus of the IETF has been to standardize RDMA over SCTP. To run DDP over TCP requires a tweak known as marker PDU aligned (MPA) framing so as to guarantee boundaries of messages.
Furthermore, DDP is not intended be to accessed directly. Instead, a separate RDMA protocol (RDMAP) provides the services to read and write data. Therefore, the entire RDMA over TCP specification is really RDMAP over DDP over MPA over TCP. All of these protocols are intended to be implemented in hardware.
Like InfiniBand, iWARP does not have a standard programming interface, only a set of verbs. Unlike IB, iWARP only has reliable connected communication as this is the only service that TCP and SCTP provide. The iWARP specification also omits many of the special features of IB, such as atomic remote operations.
Networking protocols for iWARP include protocols offered in the OpenFabrics Enterprise Distribution (OFED) by the OpenFabrics Alliance for Linux operating systems, and the Winsock Direct protocol for Microsoft Windows.
OFED protocols include Sockets Direct Protocol (SDP), iSCSI Extensions for RDMA (iSER), and others.
[edit] External Links
- iWARP Consortium at the University of New Hampshire InterOperability Laboratory -- Testing on iWARP devices
- EE Times article (dated 12/07/2001) on iWARP
- Network World article (dated 09/26/05) on iWARP and competing technologies
- Remote Direct Data Placement Charter links to IETF specifications on iWARP
- NetEffect -- producers of iWARP equipment