Human–computer chess matches

This article documents the progress of significant human–computer chess matches.

Chess computers were first able to beat strong chess players in the late 1980s. Their most famous success was the victory of Deep Blue over then World Chess Champion Garry Kasparov in 1997, but there was some controversy over whether the match conditions favored the computer.

In 2002–2003 three human-computer matches were drawn. But whereas Deep Blue was a specialized machine, these were chess programs running on commercially available computers.

Chess programs running on commercially-available desktop computers had convincing victories against human players in matches in 2005 and 2006. Since that time, chess programs running on commercial hardware - more recently including mobile phones - have been able to defeat even the strongest human players.

MANIAC (1956)

In 1956 MANIAC, developed at Los Alamos Scientific Laboratory, became the first computer to defeat a human in a chess-like game. Playing with the simplified Los Alamos rules, it defeated a novice in 23 moves.^[1]

Mac Hack VI (1966–1968)

In 1966 MIT student Richard Greenblatt wrote the chess program Mac Hack VI using MIDAS macro assembly language on a Digital Equipment Corporation PDP-6 computer with 16K of memory. Mac Hack VI evaluated 10 positions per second.

In 1967, several MIT students and professors (organized by Seymour Papert) challenged Dr. Hubert Dreyfus to play a game of chess against Mac Hack VI. Dreyfus, a professor of philosophy at MIT, wrote the book What Computers Can’t Do, questioning the computer’s ability to serve as a model for the human brain. He also asserted that no computer program could defeat even a 10-year-old child at chess. Dreyfus accepted the challenge. Herbert A. Simon, an artificial intelligence pioneer, watched the game. He said “It was a wonderful game – a real cliffhanger between two woodpushers with bursts of insights and fiendish plans…great moments of drama and disaster that go in such games.” The computer was beating Dreyfus when he found a move, which could have captured the enemy queen. The only way the computer could get out of this was to keep Dreyfus in checks with its own queen until it could fork the queen and king, and then exchange them. That is what the computer did. Soon, Dreyfus was losing. Finally, the computer checkmated Dreyfus in the middle of the board.

In the spring of 1967, Mac Hack VI played in the Boston Amateur championship winning 2 games and drawing 2 games. Mac Hack VI beat a 1510 United States Chess Federation player. This is the first time a computer won a game in a human tournament. At the end of 1968, Mac Hack VI achieved a rating of 1529. The average rating in the USCF was near 1500.^[2]

Chess x.x (1968–1978)

In 1968, Northwestern University students Larry Atkin, David Slate and Keith Gorlen began work on Chess (Northwestern University). On July 25, 1976, Chess 4.5 scored 5–0 in the Class B (1600–1799) section of the 4th Paul Masson chess tournament in Saratoga, California. This was the first time a computer won a human tournament. Chess 4.5 was rated 1722. Chess 4.5 running on a Control Data Corporation CDC Cyber 175 supercomputer (2.1 megaflops) looked at less than 1500 positions per second. On February 20, 1977, Chess 4.5 won the 84th Minnesota Open Championship with 5 wins and 1 loss. It defeated expert Charles Fenner rated 2016. On April 30, 1978, Chess 4.6 scored 5–0 at the Twin Cities Open in Minneapolis. Chess 4.6 was rated 2040.^[3] International Master Edward Lasker stated that year, "My contention that computers cannot play like a master, I retract. They play absolutely alarmingly. I know, because I have lost games to 4.7."^[4]

David Levy's bet (1978)

For a long time in the 1970s and 1980s it remained an open question whether any Chess program would ever be able to defeat the expertise of top humans. In 1968, International Master David Levy made a famous bet that no chess computer would be able to beat him within ten years. He won his bet in 1978 by beating Chess 4.7 (the strongest computer at the time), but acknowledged then that it would not be long before he would be surpassed.

Cray Blitz (1981)

In 1981, Cray Blitz scored 5–0 in the Mississippi State Championship. In round 4 it defeated Joe Sentef (2262) to become the first computer to beat a master in tournament play and the first computer to gain a master rating (2258).^[5]

HiTech (1988)

In 1988, HiTech won the Pennsylvania State Chess Championship with a score of 4.5–0.5. HiTech defeated International Master Ed Formanek (2485).^[6]

The Harvard Cup Man versus Computer Chess Challenge was organized by Harvard University. There were six challenges from 1989 until 1995. They played in Boston and New York City. In each challenge the humans scored higher and the highest scorer was a human.^[7][8]

Year	Men-Compu.	Human points	Compu. points	Winner	Points	Best Program	Points	Rank
1989	4–4	13½	2½	Boris Gulko, Michael Rohde	4	Deep Thought	1	5
1991	4–4	12	4	Maxim Dlugy	3½	Heuristic Alpha	2	5
1992	5–5	18	7	Michael Rohde	5	Socrates	3	3
1993	6–6	27	9	Joel Benjamin	5	Socrates	3	6
1994	6–8	29½	18½	Joel Benjamin	6½	WChess	5	4
1995	6–6	23½	12½	Joel Benjamin	4½	Virtual Chess	3½	4

The Aegon Man-Machine Tournaments (1986–1997)

The 12 Aegon Man-Machine Tournaments were held annually from 1986 to 1997. The Dutch Computer Chess Federation (CSVN) organized the Aegon Man-Machine Tournaments in The Hague, Netherlands. The Aegon insurance company hosted the tournaments. An equal number of humans and computers played a 6 round swiss tournament with all games between humans and computers. The early tournaments were mostly local players and anti-computer tactics specialists. Later tournaments included masters and grandmasters. In the early tournaments, humans won more games. In the later tournaments, computers won more games.

100 players played in the 1997 tournament. Computers won 151 ½ points. Humans won 148 ½ points. Yona Kosashvili scored highest for the humans at 6 points out of 6 games. Kallisto scored highest for the computers at 4 ½ points.^[9]

Year	Players	Rounds	Human points	Comp Points	Winner	Points	Best Program	Points	Rank
1986	2*11	7			Fred van der Vliet	6	Rebel	4½	5
1987	2*13	6			Martin Voorn	6	Mephisto Dallas 16 bit	4½	3
1988	2*16	6			Lex Jongsma	6	Mephisto Mega 4	4	7
1989	2*16	6	57½	23	Ad van den Berg	5	Chess Challenger	3½	8
1990	2*14	6	47	37	HiTech	5	HiTech	5	1
1991	2*20	6			John van der Wiel	6	MChess	4	8
1992	2*24	6	84	60	David Bronstein	6	Mephisto 68030	4	8
1993	2*32	6			David Bronstein	5½	The King	5	3
1994	2*38	6	114	114	Larry Christiansen	5½	Gideon	4½	5
1995	2*48	6	132	155	John van der Wiel	5½	Hiarcs	5	2
1996	2*50	6	137½	162½	Yasser Seirawan	6	Quest	4½	5
1997	2*50	6	148½	151½	Yona Kosashvili	6	Kallisto	4½	4

Deep Thought (1989)

In 1988, Deep Thought shared first place with Tony Miles in the Software Toolworks Championship, ahead of a former world champion Mikhail Tal and several grandmasters including Samuel Reshevsky, Walter Browne, and Mikhail Gurevich. It also defeated grandmaster Bent Larsen, making it the first computer to beat a grandmaster in a tournament. Its rating for performance in this tournament of 2745 (USCF scale).

In 1989, Levy was defeated by the computer Deep Thought in an exhibition match.

Deep Thought, however, was still considerably below World Championship Level, as the then reigning world chess champion Garry Kasparov demonstrated in two convincing wins in 1989.

Chess Genius (1994)

The "Chess Genius" program was entered into a Professional Chess Association rapid chess tournament in 1994. It defeated and eliminated world champion Kasparov, but lost to Viswanathan Anand in the next round.^[10] This was the first time a computer had defeated the world champion in an official game, albeit at rapid time controls.

Kasparov – Deep Blue (1996–1997)

1996

Kasparov played a six-game match against IBM's Deep Blue in 1996. Kasparov lost the first game (Deep Blue – Kasparov, 1996, Game 1), the first time a reigning world champion had lost to a computer using regular time controls. However, Kasparov regrouped to win three and draw two of the remaining five games of the match, for a convincing 4–2 match victory.

1997

In May 1997, an updated version of Deep Blue defeated Kasparov 3½–2½ in a highly publicized six-game match. Kasparov won the first, lost the second, and drew the next three. The match was even after five games but Kasparov was crushed in Game 6. This was the first time a computer had ever defeated a world champion in match play. A documentary film was made about this famous match-up entitled Game Over: Kasparov and the Machine. In that film Kasparov casually says, "I have to tell you that, you know, game two was not just a single loss of a game. It was a loss of the match, because I couldn't recover."

It should be noted however, that in game 6, Kasparov blundered very early into the game. Kasparov cites tiredness and unhappiness with the IBM team's conduct at the time as the main reason.

Kasparov claimed that several factors weighed against him in this match. In particular, he was denied access to Deep Blue's recent games, in contrast to the computer's team that could study hundreds of Kasparov's.

After the loss Kasparov said that he sometimes saw deep intelligence and creativity in the machine's moves, suggesting that during the second game, human chess players, in contravention of the rules, intervened. IBM denied that it cheated, saying the only human intervention occurred between games. The rules provided for the developers to modify the program between games, an opportunity they said they used to shore up weaknesses in the computer's play revealed during the course of the match. Kasparov requested printouts of the machine's log files but IBM refused, although the company later published the logs on the Internet.^[11] Kasparov demanded a rematch, but IBM refused and dismantled Deep Blue.

Kasparov maintains that he was told the match was to be a scientific project but that it soon became apparent that IBM wanted to beat him and nothing more.

Anand – REBEL (1998)

With increasing processing power, Chess programs running on regular workstations began to rival top flight players. In 1998, Rebel 10 defeated Viswanathan Anand who at the time was ranked second in the world, by a score of 5–3. However most of those games were not played at normal time controls. Out of the eight games, four were blitz games (five minutes plus five seconds Fischer delay (see time control) for each move) these Rebel won 3–1. Then two were semi-blitz games (fifteen minutes for each side) which Rebel won as well (1½–½). Finally two games were played as regular tournament games (forty moves in two hours, one hour sudden death) here it was Anand who won ½–1½.^[12] At least in fast games computers played better than humans but at classical time controls — at which a player's rating is determined — the advantage was not so clear.

Deep Junior at Dortmund (2000)

Deep Junior played 9 grandmasters at the Sparkassen Chess Meeting in Dortmund, Germany from July 6 to July 17, 2000. The 2000 Sparkassen Chess Meeting was a category 19 chess tournament. Computer program Deep Junior competed in a round robin format. Deep Junior scored 4.5 in 9 rounds. Deep Junior performed at a rating of 2703.^[13]

Round	White	Elo	Black	Elo	Result	Moves	ECO
1	Bareev, E	2702	Deep Junior		½–½	146	D46
2	Deep Junior		Huebner, R	2615	1-0	39	C04
3	Adams, M	2755	Deep Junior		½–½	84	C68
4	Deep Junior		Khalifman, A	2667	½–½	129	B08
5	Kramnik, V	2770	Deep Junior		1-0	65	D00
6	Deep Junior		Akopian, V	2660	½–½	89	B00
7	Anand, V	2762	Deep Junior		½–½	35	D05
8	Deep Junior		Piket, J	2649	0-1	68	B15
9	Leko, P	2740	Deep Junior		0-1	120	C48

Kramnik – Deep Fritz (2002)

In October 2002, Vladimir Kramnik (who had succeeded Kasparov as Classical World Chess Champion) and Deep Fritz competed in the eight-game Brains in Bahrain match, which ended in a 4–4 draw.

Kramnik was given several advantages in his match against Fritz when compared to most other Man vs. Machine matches, such as the one Kasparov lost against Deep Blue in 1997. The code of Fritz was frozen some time before the first match and Kramnik was given a copy of Fritz to practice with for several months. Another difference was that in games lasting more than 56 moves, Kramnik was allowed to adjourn until the following day, during which time he could use his copy of Fritz to aid him in his overnight analysis of the position.^[14]

Kramnik won games 2 and 3 by "conventional" anti-computer tactics — play conservatively for a long-term advantage the computer is not able to see in its game tree search. Fritz, however, won game 5 after a severe blunder by Kramnik. Game 6 was described by the tournament commentators as "spectacular." Kramnik, in a better position in the early middlegame, tried a piece sacrifice to achieve a strong tactical attack, a strategy known to be highly risky against computers who are at their strongest defending against such attacks. True to form, Fritz found a watertight defense and Kramnik's attack petered out leaving him in a bad position. Kramnik resigned the game, believing the position lost. However, post-game human and computer analysis has shown that the Fritz program was unlikely to have been able to force a win and Kramnik effectively sacrificed a drawn position. The final two games were draws. Given the circumstances, most commentators still rate Kramnik the stronger player in the match.

Kasparov – Deep Junior (2003)

In January 2003, Kasparov engaged in a six-game classical time control match with a $1 million prize fund which was billed as the FIDE "Man vs. Machine" World Championship, against Deep Junior.^[15] The engine evaluated three million positions per second.^[16] After one win each and three draws, it was all up to the final game. The final game of the match was televised on ESPN2 and was watched by an estimated 200–300 million people. After reaching a decent position Kasparov offered a draw, which was soon accepted by the Deep Junior team. Asked why he offered the draw, Kasparov said he feared making a blunder.^[17] Originally planned as an annual event, the match was not repeated.

Kasparov – X3D Fritz (2003)

In November 2003, Kasparov engaged in a four-game match against the computer program X3D Fritz (which was said to have an estimated rating of 2807), using a virtual board, 3D glasses and a speech recognition system. After two draws and one win apiece, the X3D Man-Machine match ended in a draw. Kasparov received $175,000 for the result and took home the golden trophy. Kasparov continued to criticize the blunder in the second game that cost him a crucial point. He felt that he had outplayed the machine overall and played well. "I only made one mistake but unfortunately that one mistake lost the game."

Man vs Machine World Team Championship (2004–2005)

The Man vs Machine World Team Championships were two chess tournaments in Bilbao, Spain, between leading chess grandmasters and chess computers. Both were convincingly won by the computers. A second name for the tournaments is Human vs. Computers World Team Matches.

2004

In October 2004, Ruslan Ponomariov, Veselin Topalov and Sergey Karjakin played against computers Hydra, Fritz 8, and Deep Junior. Ponomariov and Topalov were FIDE world chess champions. Sergey Karjakin at 12 was the youngest Grandmaster. The computers won 8.5 to 3.5. The humans won one game: Karjakin, the youngest and lowest rated player, defeated Deep Junior.^[18]

• Ponomariov – Hydra 0–1
• Fritz – Karjakin 1–0
• Deep Junior – Topalov 1/2–1/2
• Karjakin – Deep Junior 1–0
• Ponomariov – Fritz 1/2–1/2
• Topalov – Hydra 1/2–1/2
• Deep Junior – Ponomariov 1/2–1/2
• Hydra – Karjakin 1–0
• Fritz – Topalov 1–0
• Hydra – Ponomariov 1–0
• Karjakin – Fritz 0–1
• Topalov – Deep Junior 1/2–1/2

2005

In November 2005, 3 former FIDE world chess champions, Alexander Khalifman, Ruslan Ponomariov and Rustam Kasimdzhanov played against computers Hydra, Junior and Fritz. The computers won 8 to 4.^[19][20] The Ponomariov vs Fritz game on November 21, 2005^[21] is the last known win by a human against a top performing computer under normal chess tournament conditions.^[22]

• Ponomariov – Junior 0–1
• Hydra – Kasimdzhanov 1–0
• Fritz – Khalifman 1–0
• Ponomariov – Fritz 1–0
• Kasimdzhanov – Junior 1/2–1/2
• Khalifman – Hydra 1/2–1/2
• Hydra – Ponomariov 1–0
• Fritz – Kasimdzhanov 1/2–1/2
• Junior – Khalifman 1–0
• Ponomariov – Junior 1/2–1/2
• Kasimdzhanov – Hydra 1/2–1/2
• Khalifman – Fritz 1/2–1/2

Hydra – Adams (2005)

In 2005, Hydra, a dedicated chess computer with custom hardware and sixty-four processors and also winner of the 14th IPCCC in 2005, crushed seventh-ranked Michael Adams 5½–½ in a six-game match. While Adams was criticized for not preparing as well as Kasparov and Kramnik had, some commentators saw this as heralding the end of human-computer matches.^[23]

Kramnik – Deep Fritz (2006)

Kramnik, then still the World Champion, played a six-game match against the computer program Deep Fritz in Bonn, Germany from November 25 to December 5, 2006, losing 4–2 to the machine, with two losses and four draws. He received 500,000 Euros for playing and would have received another 500,000 Euros had he won the match. Deep Fritz version 10 ran on a computer containing two Intel Xeon CPUs (a Xeon DC 5160 3 GHz processor with a 1333 MHz FSB and a 4 MB L2 cache) and was able to evaluate eight million positions per second. Kramnik received a copy of the program in mid-October for testing, but the final version included an updated opening book.^[24] Except for limited updates to the opening book, the program was not allowed to be changed during the course of the match. The endgame tablebases used by the program were restricted to five pieces even though a complete six-piece tablebase is widely available. While Deep Fritz was in its opening book Kramnik is allowed to see Fritz’s display. The Fritz display contains opening book moves, number of games, Elo performance, score from grandmaster games and the move weighting.^[25]

In the first five games Kramnik steered the game into a typical "anti-computer" positional contest. On November 25, the first game ended in a draw at the 47th move.^[26] A number of commentators believe Kramnik missed a win.^[27] Two days later, the second game resulted in a victory for Deep Fritz, when Kramnik made what might be called the "blunder of the century" according to Susan Polgar, when he failed to defend against a threatened mate-in-one in an even position.^[28] (see also Deep Fritz v. Vladimir Kramnik blunder). The third, fourth and fifth games in the match ended in draws.

In the final game, in an attempt to draw the match, Kramnik played the more aggressive Sicilian Defence and was crushed,^[29] losing the match 4–2.

There was speculation that interest in human-computer chess competition would plummet as a result of the 2006 Kramnik–Deep Fritz match. According to McGill University computer science professor Monty Newborn, for example, "the science is done".^[30] The prediction appears to have come true, with no major human-computer matches in the next 10 years.

Rybka odds matches (2007–2008)

Since 2007 Rybka has played some odds matches against grandmasters. Jaan Ehlvest first lost a pawn-odds match, then later lost a match when given time, color, opening, and endgame advantages. Roman Dzindzichashvili then lost a match when given pawn and move odds.^[31]

In September 2008, Rybka played an odds match against Vadim Milov, its strongest opponent yet in an odds match. (Milov at the time had an Elo rating of 2705, 28th in the world). The result was a narrow victory to Milov: He had won 1½–½ when given pawn-and-move, and 2½–1½ (1 win, 3 draws) when given exchange odds but playing black. In two standard games (Milov had white, no odds), Rybka won 1½–½.^[32]

Pocket Fritz 4 (2009)

In 2009 a chess engine running on slower hardware, a 528 MHz HTC Touch HD mobile phone, reached the grandmaster level. The mobile phone won a category 6 tournament with a performance rating 2898. The chess engine Hiarcs 13 runs inside Pocket Fritz 4 on the mobile phone HTC Touch HD. Pocket Fritz 4 won the Copa Mercosur tournament in Buenos Aires, Argentina with 9 wins and 1 draw on August 4–14, 2009.^[33] Pocket Fritz 4 searches fewer than 20,000 positions per second.^[34] This is in contrast to supercomputers such as Deep Blue that searched 200 million positions per second. Pocket Fritz 4 achieves a higher performance level than Deep Blue.

Pocket Fritz 3 using version 12.1 of Hiarcs won the same event the previous year with six wins and four draws, running on a 624 MHz HP iPAQ hx2790. The 2008 Mercosur Cup was a category 7 tournament. Pocket Fritz 3 achieved a performance rating of 2690.^[35]

Komodo handicap matches (2015)

In 2015, chess engine Komodo played a series of handicap matches with GM Sergej Movsesian, GM Martin Petr, GM Petr Neuman, FM Victor Bolzoni, FM John Meyer, Mark Gray and FM Larry Gilden.^[36] These games included one pawn, two pawn, exchange (rook for knight), and knight odds. Komodo fared well in all of these drawing a majority but winning at least one in all configurations.^[37]

References