GNU Hurd

GNU Hurd

Developer	GNU Project Thomas Bushnell Roland McGrath Marcus Brinkmann Neal Walfield Samuel Thibault
Written in	Assembly, C
OS family	Unix-like
Working state	Current
Source model	open-source
Latest release	0.9 / 18 December 2016 (2016-12-18)[1]
Platforms	IA-32, i686
Kernel type	Multiserver microkernel
License	GNU GPLv2+[2]
Official website	www.gnu.org/software/hurd/index.html

GNU Hurd is the multiserver microkernel written as part of GNU. It has been under development since 1990 by the GNU Project of the Free Software Foundation, designed as a replacement for the Unix kernel,^[3] and released as free software under the GNU General Public License. While the Linux kernel soon proved to be a more viable solution, development of GNU Hurd continued, albeit at a slow pace.^[4]

GNU Hurd consists of a set of protocols and server processes (or daemons, in Unix terminology) that run on the GNU Mach microkernel.^[3] The Hurd aims to surpass the Unix kernel in functionality, security, and stability, while remaining largely compatible with it. The GNU Project chose the multiserver microkernel^[5] for the operating system, due to perceived advantages over the traditional Unix monolithic kernel architecture,^[6] a view that had been advocated by some developers in the 1980s.^[4]

Name and logo

In December 1991 the primary architect of the Hurd described the name as a mutually recursive acronym:^[7]

It's time [to] explain the meaning of "Hurd". "Hurd" stands for "Hird of Unix-Replacing Daemons". And, then, "Hird" stands for "Hurd of Interfaces Representing Depth". We have here, to my knowledge, the first software to be named by a pair of mutually recursive acronyms.

— Thomas (then Michael) Bushnell

As both hurd and hird are homophones of the English word herd, the full name GNU Hurd is also a play on the words herd of gnus, reflecting how the kernel works.^[8] The logo is called the Hurd boxes and it also reflects on architecture. The logo is a graph where nodes represent the Hurd kernel's servers and directed edges are IPC messages.^[7]

Development history

Richard Stallman founded the GNU project in September 1983 with an aim to create a free GNU operating system. Initially the components required for kernel development were written: editors, shell, compiler and all the others. By 1989, the GNU GPL came into being and the only major component missing was the kernel.^[9][10]

Development on the Hurd began in 1990 after an abandoned kernel attempt in 1986, based on the research TRIX operating system developed by Professor Steve Ward and his group at MIT's Laboratory for Computer Science (LCS).^[11] According to Thomas Bushnell, the initial Hurd architect, their early plan was to adapt the 4.4BSD-Lite kernel and, in hindsight, "It is now perfectly obvious to me that this would have succeeded splendidly and the world would be a very different place today".^[12] In 1987 Richard Stallman proposed using the Mach microkernel developed at Carnegie Mellon University. Work on this was delayed for three years due to uncertainty over whether CMU would release the Mach code under a suitable license.^[11]

With the release of the Linux kernel in 1991, the primary user of GNU's userland components soon became operating systems based on the Linux kernel (Linux distributions), prompting the coining of the term GNU/Linux.

Development of the Hurd has proceeded slowly. Despite an optimistic announcement by Stallman in 2002 predicting a release of GNU/Hurd later that year,^[13] the Hurd is still not considered suitable for production environments. Development in general has not met expectations, and there are still a significant number of bugs and missing features.^[14] This has resulted in a poorer product than many (including Stallman) had expected.^[15] In 2010, after twenty years under development, Stallman said that he was "not very optimistic about the GNU Hurd. It makes some progress, but to be really superior it would require solving a lot of deep problems", but added that "finishing it is not crucial" for the GNU system because a free kernel already existed (Linux), and completing Hurd would not address the main remaining problem for a free operating system: device support.^[16]

The Debian project, among others, have worked on the Hurd project to produce binary distributions of Hurd-based GNU operating systems for IBM PC compatible systems.

After years of stagnation, development picked up again in 2015 and 2016, with four releases during these two years.^[17]

On August 20, 2015, amid the Google Summer of Code, it was announced that GNU Guix had been ported to GNU Hurd,^[18] making it the first native package manager on the Hurd.^[19]

Architecture

General structure of monolithic, microkernel and hybrid kernel-based operating systems, respectively.

Unlike most Unix-like kernels, the Hurd uses a server–client architecture, built on a microkernel that is responsible for providing the most basic kernel services – coordinating access to the hardware: the CPU (through process management and scheduling), RAM (via memory management), and other various input/output devices (via I/O scheduling) for sound, graphics, mass storage, etc. In theory the microkernel design would allow for all device drivers to be built as servers working in user space, but today most drivers of this kind are still contained in the GNU Mach kernel space.^[20]

According to Hurd developers, the main advantage of microkernel-based design is the ability to extend the system: developing a new module would not require in depth knowledge of the rest of the kernel, and a bug in one module would not crash the entire system. Hurd provides a concept of translators, a framework of modules used to extend a file system functionality.^[21]

From early on, the Hurd was developed to use GNU Mach as the microkernel. This was a technical decision made by Richard Stallman, who thought it would speed up the work by saving a large part of it. He has admitted that he was wrong about that.^[22] Other Unix-like systems working on the Mach microkernel include OSF/1, Lites, and MkLinux. macOS and NeXTSTEP use hybrid kernels based on Mach.

Other microkernels

From 2004 onward, various efforts were launched to port the Hurd to more modern microkernels. The L4 microkernel was the original choice in 2004, but progress slowed to a halt. Nevertheless, during 2005, Hurd developer Neal Walfield finished the initial memory management framework for the L4/Hurd port, and Marcus Brinkmann ported essential parts of glibc; namely, getting the process startup code working, allowing programs to run, thus allowing the first user programs (trivial ones such as the hello world program) in C to run.

Since 2005 Brinkmann and Walfield started researching Coyotos as a new kernel for HURD.^[23][24] In 2006, Brinkmann met with Jonathan Shapiro (a primary architect of the Coyotos Operating System) to aid in and discuss the use of the Coyotos kernel for GNU/Hurd. In further discussion HURD developers realised that Coyotos (as well as other similar kernels) are not suitable for HURD. ^[25]

In 2007, Hurd developers Neal Walfield and Marcus Brinkmann gave a critique of the Hurd architecture, known as "the critique",^[26] and a proposal for how a future system may be designed, known as "the position paper".^[27] In 2008, Neal Walfield began working on the Viengoos microkernel as a modern native kernel for HURD. As of 2009, development on Viengoos is paused due to Walfield lacking time to work on it.^[28]

In the meantime, others have continued working on the Mach variant of Hurd.^[29]

Unix extensions

A number of traditional Unix concepts are replaced or extended in the Hurd.

Under Unix, every running program has an associated user id, which normally corresponds to the user that started the process. This id largely dictates the actions permitted to the program. No outside process can change the user id of a running program. A Hurd process, on the other hand, runs under a set of user ids, which can contain multiple ids, one, or none. A sufficiently privileged process can add and remove ids to another process. For example, there is a password server that will hand out ids in return for a correct login password.

Regarding the file system, a suitable program can be designated as a translator for a single file or a whole directory hierarchy. Every access to the translated file, or files below a hierarchy in the second case, is in fact handled by the program. For example, a file translator may simply redirect read and write operations to another file, like a Unix symbolic link. The effect of Unix mounting is achieved by setting up a filesystem translator (using the "settrans" command). Translators can also be used to provide services to the user. For example, the ftpfs translator allows a user to encapsulate remote FTP sites within a directory. Then, standard tools such as ls, cp, and rm can be used to manipulate files on the remote system. Even more powerful translators are ones such as UnionFS, which allows a user to unify multiple directories into one; thus listing the unified directory reveals the contents of all the directories.

The Hurd requires a multiboot-compliant boot loader, such as GRUB.

Architecture of the servers

According to the Debian documentation, there are 24 servers (18 core servers and 6 file system servers) named as follows:^[30]

Core servers

• auth (authentication server): Receives requests and passwords from programs and gives them an ID, which changes the privileges of the program.
• crash (crash server): Handles all fatal errors.
• exec (execution server): Translates an executable image (currently ELF and a.out are supported) to a runnable image in memory.
• fifo (FIFO translator): Implements named pipes.
• new-fifo (new FIFO server): An alternate server for named pipes.
• firmlink (the firmlink translator): Implements firmlinks ‒ "half-way between a symbolic link and a hard link".^[31]
• fwd (forward server): Forwards requests to other servers, used by fifo and symlink servers.
• hostmux (host multiplexer server)
• ifsock (server for sockets interface): Helps with UNIX domain socket addresses.
• init (init server): Basic system booting and configuration.
• magic (magic server): Signals that a name lookup must be resolved internally by a process when the result involves the process's state.
• null (null server): Implements /dev/null and /dev/zero.
• pfinet (pfinet server): Implements the PF_INET protocol family.
• pflocal (pflocal server): Implements UNIX domain sockets.
• proc (process server): Assigns PIDs and manages process-level actions.
• symlink (symbolic link translator): Implements symbolic links for filesystems that don't support them.
• term (terminal server): A POSIX terminal.
• usermux (user multiplexer server): Invokes user-specific translators.

Filesystem servers

ext2fs

The ext2 filesystem translator. It receives disk blocks from the microkernel and gives files and directories to the applications.

isofs

The translator for the ISO 9660 filesystem. Translates blocks of a CD or DVD to files and directories for the applications.

nfs

See Network File System.

ufs

Translator for the BSD filesystem of the same name, UFS.

ftpfs

File transfer protocol filesystem translator.

storeio

The storage translator.

The servers collectively implement the POSIX API, with each server implementing a part of the interface. For instance, the various filesystem servers each implement the filesystem calls. The storage server will work as a wrapping layer, similar to the block layer of Linux. The equivalent of VFS of Linux is achieved by libdiskfs and libpager libraries.

GNU distributions running Hurd

Debian GNU/Hurd with Xfce4 and web browser Midori

Hurd-based GNU distributions include:

• Arch Hurd
• Debian GNU/Hurd
• Guix System Distribution (under development)
• NixOS - experiment (discontinued)^[32]
• Bee (discontinued)
• Gentoo (discontinued)
• GNU/Hurd Live CD^[33] (discontinued)

See also

• GNU Mach
• GNU Linux-libre – a kernel and a GNU package
• Kernel-based Virtual Machine (KVM)
• Linux-libre
• Minix 3
• Multiboot Specification

References

External links

Wikimedia Commons has media related to Hurd.

Wikinews has related news: GNU Hurd operating system: first user program run using L4 microkernel

• Official website