Linux on z Systems

Linux on z Systems (or Linux on z for short, and previously Linux on System z) is the collective term for the Linux operating system compiled to run on IBM mainframes, especially IBM System z and IBM LinuxONE servers. Other terms with the same meaning include Linux on zEnterprise, Linux on zSeries, Linux/390, zLinux, z/Linux, etc.

History

Linux on z originated as two separate efforts to port Linux to IBM's largest servers. The first effort, the "Bigfoot" project, developed by Linas Vepstas in late 1998 through early 1999, was an independent distribution and has since been abandoned.^[1] IBM published a collection of patches and additions to the Linux 2.2.13 kernel on December 18, 1999, to start today's mainline Linux on z.^[2] Formal product announcements quickly followed in 2000, including the Integrated Facility for Linux (IFL) engines. Think Blue Linux was an early mainframe distribution consisting mainly of Red Hat packages added to the IBM kernel.^[3] Commercial Linux distributors introduced mainframe editions very quickly after the initial kernel work.

At the start of IBM's involvement, Linux patches for System z included some object code only (OCO) modules, without source code.^[4] Soon after IBM replaced the OCO modules with open source modules. Linux on z is free software under the GNU General Public License.

According to IBM, by May, 2006, over 1,700 customers were running Linux on their mainframes.^[5]

Virtualization

Virtualization is required by default on IBM z Systems; there is no option to run Linux on z without some degree of virtualization. (Only the very first 64-bit mainframe models, the z900 and z800, included a non-virtualized "basic mode.") First layer virtualization is provided by the Processor Resource and System Manager (PR/SM) to deploy one or more Logical Partitions (LPARs). Each LPAR supports a variety of operating systems including Linux on z. A hypervisor called z/VM can also be run as the second layer virtualization in LPARs to create as many virtual machines (VMs) as there are resources assigned to the LPARs to support them. KVM on z is another hypervisor option. This multi-layer virtualization capability allows z Systems to deploy hundreds or thousands of virtual machines within a single physical system.

PR/SM on z Systems has earned Common Criteria Evaluation Assurance Level (EAL) 5+ security certification,^[6] and z/VM has earned Common Criteria EAL4+ certification for its ability to protect virtual machines in an LPAR.^[7]

The first layer of z System virtualization (PR/SM) allows a z machine to run up to 80 LPARs (limit on the IBM z13). Therefore, with PR/SM alone, one z System can deploy up to 80 Linux instances. These can be considered as 80 virtual "bare metal" servers because PR/SM allows CPUs to be dedicated to individual LPARs. A single z System with up to 80 z/VM or KVM LPARs can run a very large number of virtual machines as long as there are adequate CPU, memory, and I/O resources configured with the system for the desired performance, capacity, and throughput.

z Systems' PR/SM and hardware attributes allow compute resources to be dynamically changed to meet workload demands. CPU and memory resources can be nondisruptively added to the system and dynamically assigned, recognized, and used by LPARs. I/O resources such as IP and SAN ports can also be added dynamically. They are virtualized and shared across all LPARs. The hardware component that provides this capability is called the Channel Subsystem. Each LPAR can be configured to either "see" or "not see" the virtualized I/O ports to establish desired "shareness" or isolation. This virtualization capability allows significant reduction in I/O resources because of its ability to share them and drive up utilization.

Inter-LPAR communication is facilitated by PR/SM and z Systems hardware. Intra-LPAR communication is facilitated by z/VM which originates the System Defined Networking concept. From a communication standpoint, with the first layer virtualization PR/SM and the second layer virtualization z/VM, Linux instances in a z System do not have the need for top-of-rack IP switches and SAN switches. This eliminates a large portion of cost and complexity from the equation. Mainframe virtualization capabilities also allow the system to be highly utilized at 80%, 90%, or even 100% and still be productive.

When Linux applications in an LPAR access data and applications in other LPARs such as CICS, IBM DB2, IMS, Linux, and other mainframe subsystems, running on the same physical mainframe, they can utilize HiperSockets – fast, memory-only TCP/IP connections. As compared to TCP/IP over standard network interface cards (NICs, also known as Open System Adapters or OSAs in mainframes), HiperSockets can improve end-user responsiveness (reduce network latency and processing overhead), security (since there's no network connection to intercept), and reliability (since there's no network connection to lose).^[8]

With the zEC12, zBC12, and later models, the HiperSocket concept is extended beyond the physical machine boundary via a "RoCE" adapter to facilitate a secure and high speed inter-system communication. Applications in LPAR A in system A can thus use HiperSockets to communicate with applications in LPAR B in system B to ensure the security and performance attributes.

Hardware

Beginning with Linux kernel version 4.1 released in early 2015, Linux on z is only available as a 64-bit operating system compatible with z/Architecture mainframes. Previously Linux on z was also available as a 31-bit operating system compatible with older model mainframes introduced prior to 2000's z900 model. However, the newer 64-bit Linux kernel and 64-bit Linux on z distributions are still backward compatible with applications compiled for 31-bit Linux on z. Historically the Linux kernel architecture designations were "s390" and "s390x" to distinguish between the 31-bit and 64-bit Linux on z kernels respectively, but "s390" now also refers generally to the one Linux on z kernel architecture.

Linux runs on standard, general purpose mainframe CPs (Central Processors) as well as IFLs (Integrated Facility for Linux). IFLs are mainframe processors dedicated to running Linux, either natively or under a hypervisor (z/VM or KVM on z). Microcode restricts IFLs from running "traditional" workloads, such as z/OS, but they are physically identical to other z System processors. IFLs are typically less expensive to acquire from IBM than CPs.^[9]

Advantages

Linux on z gives the flexibility of running Linux with the advantages of mainframe hardware. Using virtualization, numerous smaller servers can be combined onto one mainframe, gaining some benefits of centralization, but allowing specialized servers thanks to virtualization support, which can lower operating costs. IBM mainframes allow transparent use of redundant processor execution steps and integrity checking, which is important for critical applications in certain industries such as banking.. Mainframes typically allow hot-swapping of hardware, such as processors and memory. This swapping is typically transparent to the operating system, allowing routine repairs to be performed without shutting down the system.

Pricing and costs

Linux on z is not generally appropriate on premises for small businesses that would have fewer than about 10 distributed Linux servers, although some expensive per-processor licensed software can quickly reduce that rule of thumb. Most software vendors, including IBM, treat the highly virtualized IFLs just like non-virtualized processors on other platforms for licensing purposes. In other words, a single IFL running scores of Linux instances still typically counts as one "ordinary" CPU, at the same CPU price, for software licensing. Test, development, quality assurance, training, and redundant production server instances can all run on one IFL (or more IFLs, but only if needed for peak demand performance capacity). Thus, beyond some minimum threshold, Linux on z can quickly become cost-advantageous when factoring in labor and software costs.

The cost equation for Linux on z is not always well understood and is controversial, and many businesses and governments have difficulty measuring, much less basing decisions on, software, labor, and other costs (such as the costs of outage and security breaches). Acquisition costs are often more visible, and small, non-scalable servers are "cheap." Nonetheless, non-acquisition costs are no less real and are usually far greater than hardware acquisition prices. Also, individual users and departments within larger businesses and governments sometimes have difficulty sharing computing infrastructure (or any other resources, for that matter), citing a loss of control. Server centralization, as Linux on z provides, might reward cooperation with better service and lower costs, but that's not to say that cooperation is always easily accomplished within a corporate bureaucracy.

Linux on z also supports less expensive disk storage devices than z/OS because Linux does not require FICON or ESCON attachment, although z/OS may use disk space more efficiently, on balance, due to hardware-assisted database compression common on z/OS and the smaller number of operating system instances z/OS typically requires. There are also some operational advantages using some FICON-attached storage with Linux on z, for example support for z/VM Live Guest Relocation.

Appropriate workloads

Mainframe characteristics are designed for such business workloads as transaction processing (especially in conjunction with concurrent, high volume batch processing) and large database management. Mainframe design traditionally emphasizes "balanced" performance for all computing elements including input/output, implemented via channel I/O. Mainframes offload I/O, system accounting, and other non-core computing tasks from the main CPUs as much as possible, and z/Architecture additionally offloads cryptographic calculations. For example, in a single IBM z13 machine up to 141 processor cores are available to configure as IFLs. However, every such machine also has 27 additional main cores: 2 as spares, 1 for firmware support, and the remainder running system accounting and I/O support tasks. In addition, each I/O adapter typically has two PowerPC processors, and a z13 supports hundreds of I/O adapters. There are also separate processors handling memory and cache control tasks, environmental monitoring, and internal interconnections, as examples.

Historically, mainframes in general, and Linux on z in particular, did not execute "CPU-intensive" single task computations with notably high performance compared to certain other platforms with a few notable exceptions such as cryptographic calculations. Examples included most scientific simulations, weather forecasting, and molecular modeling. Supercomputers, including Linux-based supercomputers, excel at these workloads. This bifurcation between mainframes and other platforms has significantly blurred in recent years, starting with the introduction of 2008's System z10, a machine based on quad-core 4.4 GHz processors with hardware decimal floating point. As mainframe processor technology has continued to evolve, and especially with the introduction of the IBM LinuxONE and IBM z13 models in 2015, IBM has started promoting its mainframes as ideal platforms to run real-time analytics and other computationally intensive tasks that mainframes did not historically run well. IBM sold its X86 server product line to Lenovo in 2014.

Mainframes do not provide graphics or sound adapters, and are as such ill-suited for digital media editing or computer-aided design (CAD) except perhaps in support roles (e.g. content storage, parts inventories, metadata management, security services, etc.)

Support

Like all other versions of Linux, Linux on z is governed by the GPL free software license. Complete Linux on z source code is available from numerous parties on a free and equal basis, and architectural support is part of the main Linux kernel effort. IBM assigns several of its programmers to the community effort, but IBM is by no means the only participant.

Though there are no obstacles to running any Linux on z distribution on an IBM z System, IBM routinely tests three particular Linux on z distributions: Red Hat, SUSE,^[10] and, starting in 2015, Canonical's Ubuntu Linux. Other notable Linux on z distributions include Debian,^[11] Fedora,^[12] Slackware,^[13] CentOS, and Gentoo.^[14]

Nearly every free or open-source software package available for Linux generally is available for Linux on z, including Apache HTTP Server, Samba software, JBoss, PostgreSQL, MySQL, PHP, Python programming language, Concurrent Versions System (CVS), GNU Compiler Collection (GCC), LLVM, and Perl, among many others.^[15]

Red Hat and SUSE offer mainline support for their distributions running Linux on z.^[16][17] In 2015 Canonical announced plans to offer official support for its distribution starting in early 2016. IBM Global Services also offers support contracts, including 24x7 coverage.^[18] Some standard Linux software applications are readily available pre-compiled, including popular closed-source enterprise software packages such as WebSphere,^[19] DB2^[20] and Oracle^[21] databases and applications, SAP R/3, SAP ERP,^[22] and IBM's Java Developer's Kit (JDK),^[23] to name only a few.

Developer resources

IBM offers resources to developers wishing to target Linux for z:

• The Linux Test Drive, a free program granting a single Linux on System z virtual machine for 30 days.^[24]
• The IBM Systems Application Advantage for Linux (Chiphopper), a developer program to help developers write and publish cross-platform Linux software.^[25]
• The Community Development System for Linux on System z (CDSL) program, a platform for providing open source developers a platform for porting to Linux on System z.^[26]
• The Linux Remote Development Program, a fee-based extended developer support program.^[27]

Linux on z supports Unicode and ASCII just like any other Linux distribution—it is not an EBCDIC-based operating system.^[28] However, for convenience Linux is able to read kernel parameters in EBCDIC. z/VM takes advantage of this capability.

Porting Linux applications to Linux on z is fairly straightforward. Potential issues include endianness (Linux on z is big-endian) and reliance on non-portable libraries particularly if source code is not available.^[29] Programs can be easily cross compiled to z/Architecture binaries on non-mainframe Linux systems.^[30]

Emulators

There are at least three software-based System z mainframe emulators.

• FLEX-ES from Fundamental Software is a commercially offered option.^[31]
• The open source Hercules emulator supports Linux on System z (and can even run on Linux on System z itself).
• In 2010, IBM introduced the Rational Developer for System z Unit Test Feature (now called Rational Development and Test Environment for z, or sometimes RDTz for short) which provides a restricted use execution environment that can run on X86 hardware. IBM's license terms limit use of RDTz to certain application development tasks, not including final pre-production compiling or pre-production testing (such as stress testing). RDTz includes z/OS (with common middleware) and is also compatible with Linux on z.^[32]

See also

• Comparison of Linux distributions
• OpenSolaris for System z
• Linux on Power
• UNIX System Services
• zIIP
• zAAP
• z/TPF
• z/VSE

References

External links

• Linux on z Systems
• Linux on z/VM
• Linux on z Systems developer site
• Linux for S/390 and zSeries community wiki
• Linux for S/390 and zSeries web site
• linux-390, users mailing list.
• linux-s390, kernel devel mailing list.
• IBM Software for Linux
• IBM Redbooks for Linux on System z technical know-how
• Virtualization Cookbooks for Red Hat Enterprise Linux (RHEL) and SUSE Linux Enterprise Server (SLES).
• Linux Technology Center at IBM
• Porting GCC to the IBM S/390 platform