Multi-touch

Multi-touch screen
Finger touching a multi-touch screen

In computing, multi-touch is technology that enables a surface (a trackpad or touchscreen) to recognize the presence of more than one or more than two points of contact with the surface. The origins of multitouch began at CERN, MIT, University of Toronto, Carnegie Mellon University and Bell Labs in the 1970´s. multitouch was in use as early as 1985. Apple popularized the term "multi-touch" in 2007. Plural-point awareness may be used to implement additional functionality, such as pinch to zoom or to activate certain subroutines attached to predefined gestures.

The two different uses of the term resulted from the quick developments in this field, and many companies using the term to market older technology which is called gesture-enhanced single-touch or several other terms by other companies and researchers. Several other similar or related terms attempt to differentiate between whether a device can exactly determine or only approximate the location of different points of contact to further differentiate between the various technological capabilities but they are often used as synonyms in marketing.

Definition

In computing, multi-touch is technology which enables a trackpad or touchscreen) to recognize more than one[1][2] or more than two[3] points of contact with the surface. Apple popularized the term "multi-touch" in 2007 with which it implemented additional functionality, such as pinch to zoom or to activate certain subroutines attached to predefined gestures.

The two different uses of the term resulted from the quick developments in this field, and many companies using the term to market older technology which is called gesture-enhanced single-touch or several other terms by other companies and researchers.[4][5] Several other similar or related terms attempt to differentiate between whether a device can exactly determine or only approximate the location of different points of contact to further differentiate between the various technological capabilities,[5] but they are often used as synonyms in marketing.

History

1960-2000

The use of touchscreen technology pre-dates multi-touch technology and the personal computer. Early synthesizer and electronic instrument builders like Hugh Le Caine and Robert Moog experimented with using touch-sensitive capacitance sensors to control the sounds made by their instruments.[6] IBM began building the first touch screens in the late 1960s. In 1972, Control Data released the PLATO IV computer, a terminal used for educational purposes, which employed single-touch points in a 16x16 array user interface. These early touchscreens only registered one point of touch at a time. On-screen keyboards (a well-known feature today) were thus awkward to use, because key-rollover and holding down a shift key while typing another were not possible.[7]

An exception was a multi-touch reconfigurable touchscreen keyboard/display developed at the Massachusetts Institute of Technology in the early 1970s.[8]

The prototypes[9] of the x-y mutual capacitance multi-touch screens (left) developed at CERN

In 1977, one of the early implementations of mutual capacitance touchscreen technology was developed at CERN[10][11] based on their capacitance touch screens developed in 1972 by Danish electronics engineer Bent Stumpe. This technology was used to develop a new type of human machine interface (HMI) for the control room of the Super Proton Synchrotron particle accelerator. In a handwritten note dated 11 March 1972, Stumpe presented his proposed solution – a capacitive touch screen with a fixed number of programmable buttons presented on a display. The screen was to consist of a set of capacitors etched into a film of copper on a sheet of glass, each capacitor being constructed so that a nearby flat conductor, such as the surface of a finger, would increase the capacitance by a significant amount. The capacitors were to consist of fine lines etched in copper on a sheet of glass – fine enough (80 μm) and sufficiently far apart (80 μm) to be invisible (CERN Courier April 1974 p117). In the final device, a simple lacquer coating prevented the fingers from actually touching the capacitors. In 1976, MIT described a keyboard with variable graphics capable of multi-touch detection, for what is very likely to be the very first multitouch screen.[8]

In the early 1980s, The University of Toronto's Input Research Group were among the earliest to explore the software side of multi-touch input systems.[12] A 1982 system at the University of Toronto used a frosted-glass panel with a camera placed behind the glass. When a finger or several fingers pressed on the glass, the camera would detect the action as one or more black spots on an otherwise white background, allowing it to be registered as an input. Since the size of a dot was dependent on pressure (how hard the person was pressing on the glass), the system was somewhat pressure-sensitive as well.[6] Of note, this system was input only and not able to display graphics.

In 1983, Bell Labs at Murray Hill published a comprehensive discussion of touch-screen based interfaces, though it makes no mention of multiple fingers.[13] In the same year, the video-based Video Place/Video Desk system of Myron Krueger was influential in development of multi-touch gestures such as pinch-to-zoom, though this system had no touch interaction itself.[14][15]

By 1984, both Bell Labs and Carnegie Mellon University had working multi-touch-screen prototypes – both input and graphics – that could respond interactively in response to multiple finger inputs.[16][17] The Bell Labs system was based on capacitive coupling of fingers, whereas the CMU system was optical. In 1985, the canonical multitouch pinch-to-zoom gesture was demonstrated, with coordinated graphics, on CMU's system.[18] [19] In 1990, Sears et al. published a review of academic research on single and multi-touch touchscreen human–computer interaction of the time, describing single touch gestures such as rotating knobs, swiping the screen to activate a switch (or a U-shaped gesture for a toggle switch), and touchscreen keyboards (including a study that showed that users could type at 25 words per minute for a touchscreen keyboard compared with 58 words per minute for a standard keyboard, with multi-touch hypothesized to improve data entry rate); multi-touch gestures such as selecting a range of a line, connecting objects, and a "tap-click" gesture to select while maintaining location with another finger are also described.[20]

In 1991, Pierre Wellner advanced the topic publishing about his multi-touch "Digital Desk", which supported multi-finger and pinching motions.[21][22] Various companies expanded upon these inventions in the beginning of the twenty-first century.

2000- present day

Between 1999 and 2005, the company Fingerworks developed various multi-touch technologies, including Touchstream keyboards and the iGesture Pad. in the early 2000s Alan Hedge, professor of human factors and ergonomics at Cornell University published several studies about this technology.[23][24][25] In 2005, Apple acquired Fingerworks and its multi-touch technology. In January 2007, multi-touch technology became mainstream with the iPhone, and in its iPhone announcement Apple even stated it "invented multi touch",[26] however both the function and the term predate the announcement or patent requests, except for the area of capacitive mobile screens, which did not exist before Fingerworks/Apple's technology (Fingerworks filed patents in 2001–2005,[27] subsequent multi-touch refinements were patented by Apple[28]).

In 2001, Microsoft's table-top touch platform, Microsoft PixelSense (formerly Surface) started development, which interacts with both the user's touch and their electronic devices and became commercial May 29, 2007. Similarly, in 2001, Mitsubishi Electric Research Laboratories (MERL) began development of a multi-touch, multi-user system called DiamondTouch. In 2008, the Diamondtouch became a commercial product and is also based on capacitance, but able to differentiate between multiple simultaneous users or rather, the chairs in which each user is seated or the floorpad on which the user is standing. In 2007, NORTD labs Open Source system offered its CUBIT (multi-touch).

Small-scale touch devices rapidly became commonplace: in 2008, the number of touch screen telephones was expected to increase from 200,000 shipped in 2006 to 21 million in 2012.[29]

In May 2015, Apple was granted a patent for a "fusion keyboard", which turns individual physical keys into multi-touch buttons.[30]

Brands and manufacturers

A virtual keyboard before iOS 7 on an iPad

Apple has retailed and distributed numerous products using multi-touch technology, most prominently including its iPhone smartphone and iPad tablet. Additionally, Apple also holds several patents related to the implementation of multi-touch in user interfaces,[31] however the legitimacy of some patents has been disputed.[32] Apple additionally attempted to register "Multi-touch" as a trademark in the United States—however its request was denied by the United States Patent and Trademark Office because it considered the term generic.[33]

Multi-touch sensing and processing occurs via an ASIC sensor that is attached to the touch surface. Usually, separate companies make the ASIC and screen that combine into a touch screen; conversely, a trackpad's surface and ASIC are usually manufactured by the same company. There have been large companies in recent years that have expanded into the growing multi-touch industry, with systems designed for everything from the casual user to multinational organizations.

It is now common for laptop manufacturers to include multi-touch trackpads on their laptops, and tablet computers respond to touch input rather than traditional stylus input and it is supported by many recent operating systems.

A few companies are focusing on large-scale surface computing rather than personal electronics, either large multi-touch tables or wall surfaces. These systems are generally used by government organizations, museums, and companies as a means of information or exhibit display. Large scale multi-touch surfaces are manufactured by Finnish company MultiTaction on their 55" MT Cells (55" screens) who also have office locations in London, California and Singapore. MultiTaction also build unique collaboration software especially designed for multi-touch screens such as MT Canvus and MT Showcase.

Implementations

Multi-touch has been implemented in several different ways, depending on the size and type of interface. The most popular form are mobile devices, tablets, touchtables and walls. Both touchtables and touch walls project an image through acrylic or glass, and then back-light the image with LEDs.

Touch surfaces can also be made pressure-sensitive by the addition of a pressure-sensitive coating that flexes differently depending on how firmly it is pressed, altering the reflection.[34]

Handheld technologies use a panel that carries an electrical charge. When a finger touches the screen, the touch disrupts the panel's electrical field. The disruption is registered as an computer event (gesture) and may be sent to the software, which may then initiates a response to the gesture event.[35]

In the past few years, several companies have released products that use multi-touch. In an attempt to make the expensive technology more accessible, hobbyists have also published methods of constructing DIY touchscreens.[36]

Capacitive

Capacitive technologies include:[37]

Resistive

Resistive technologies include:[37]

Optical

Optical touch technology functions when a finger or an object touches the surface, causing the light to scatter, the reflection is caught with sensors or cameras that send the data to software which dictates response to the touch, depending on the type of reflection measured.

Optical technologies include:[37]

Wave

Acoustic and radio-frequency wave-based technologies include:[37]

Multi-touch gestures

Multi-touch touchscreen gestures enable predefined motions to interact with the device and software. An increasing number of devices like smartphones, tablets, laptops or desktop computers have functions that are triggered by multi-touch gestures.

Multi-touch software

Many vendors have developed multi-touch software products that allow people to drag, resize, and rotate photos, videos and electronic documents (e.g. unedged arena, nuiSense business, snowflake, omnitapps).

Multi-touch software often has common features that enable non-technical people to quickly configure multi-touch presentations. This software may be useful in museums, kiosks, education, storefront windows, fairs and showrooms. It can be also used for collaboration purposes.

Before 2007

Years before it was a viable consumer product, popular culture portrayed potential uses of multi-touch technology in the future, including in several installments of the Star Trek franchise.

In the 1982 Disney sci-fi film Tron a device similar to the Microsoft Surface was shown. It took up an executive's entire desk and was used to communicate with the Master Control computer.

In the 2002 film Minority Report, Tom Cruise uses a set of gloves that resemble a multi-touch interface to browse through information.[39]

In the 2005 film The Island, another form of a multi-touch computer was seen where the professor, played by Sean Bean, has a multi-touch desktop to organize files, based on an early version of Microsoft Surface (not be confused with the tablet computers which now bear that name).

In 2007, the television series CSI: Miami introduced both surface and wall multi-touch displays in its sixth season.

After 2007

Multi-touch technology can be seen in the 2008 James Bond film Quantum of Solace, where MI6 uses a touch interface to browse information about the criminal Dominic Greene.[40]

In the 2008 film The Day the Earth Stood Still Microsoft's Surface was used .[41]

The television series NCIS: Los Angeles which premiered 2009 makes use of multi-touch surfaces and wall panels as an initiative to go digital.

In a 2008 an episode of the television series The Simpsons, Lisa Simpson travels to the underwater headquarters of Mapple to visit Steve Mobbs, who is shown to be performing multiple multi-touch hand gestures on a large touch wall.

In the 2009 film District 9 the interface used to control the alien ship features similar technology.[42]

See also

References

  1. ↑ "Multi-touch definition of Multi-touch in the Free Online Encyclopedia.". encyclopedia2.thefreedictionary.com. Retrieved 2014-11-23.
  2. ↑ "Glossary - X2 Computing". x2computing.com. Retrieved 2014-11-23.
  3. ↑ Gardner, N.; Haeusler, H.; Tomitsch, M. (2010). Infostructures: A Transport Research Project. Freerange Press. ISBN 9780980868906. Retrieved 2014-11-23.
  4. ↑ Walker, Geoff (August 2012). "A review of technologies for sensing contact location on the surface of a display". Journal of the Society for Information Display. 20 (8): 413–440. doi:10.1002/jsid.100.
  5. 1 2 "What is Multitouch". Retrieved 2010-05-30.
  6. 1 2 Buxton, Bill. "Multitouch Overview"
  7. ↑ "Multi-Touch Technology, Applications and Global Markets". www.prnewswire.com. Retrieved 2015-11-16.
  8. 1 2 Kaplow, Roy; Molnar, Michael (1976-01-01). "A Computer-terminal, Hardware/Software System with Enhanced User Input Capabilities: The Enhanced-input Terminal System (EITS)". Proceedings of the 3rd Annual Conference on Computer Graphics and Interactive Techniques. SIGGRAPH '76. New York, NY, USA: ACM: 116–124. doi:10.1145/563274.563297.
  9. ↑ The first capacitative touch screens at CERN, CERN Courrier, 31 March 2010, retrieved 2010-05-25
  10. ↑ Stumpe, Bent (16 March 1977), A new principle for x-y touch system (PDF), CERN, retrieved 2010-05-25
  11. ↑ Stumpe, Bent (6 February 1978), Experiments to find a manufacturing process for an x-y touch screen (PDF), CERN, retrieved 2010-05-25
  12. ↑ Mehta, Nimish (1982), A Flexible Machine Interface, M.A.Sc. Thesis, Department of Electrical Engineering, University of Toronto supervised by Professor K.C. Smith.
  13. ↑ Nakatani, L. H., John A Rohrlich; Rohrlich, John A. (1983). "Soft Machines: A Philosophy of User-Computer Interface Design". Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI’83): 12–15. doi:10.1145/800045.801573. Retrieved 2009-01-28.
  14. ↑ Krueger, Myron. "Videoplace '88".
  15. ↑ Krueger, Myron, W., Gionfriddo, Thomas., &Hinrichsen, Katrin (1985). VIDEOPLACE - An Artificial Reality, Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI’85), 35 - 40.
  16. ↑ Dannenberg, R.B., McAvinney, P. and Thomas, M.T. Carnegie-Mellon University Studio Report. In Proceedings of the International Computer Music Conference (Paris, France, October 19–23, 1984). ICMI. pp. 281-286.
  17. ↑ McAvinney, P. The Sensor Frame - A Gesture-Based Device for the Manipulation of Graphic Objects. Carnegie Mellon University, 1986.
  18. ↑ TEDx Talks (2014-06-15), Future of human/computer interface: Paul McAvinney at TEDxGreenville 2014, retrieved 2017-02-24
  19. ↑ Lee, SK; Buxton, William; Smith, K. C. (1985-01-01). "A Multi-touch Three Dimensional Touch-sensitive Tablet". Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI '85. New York, NY, USA: ACM: 21–25. ISBN 0897911490. doi:10.1145/317456.317461.
  20. ↑ Sears, A., Plaisant, C., Shneiderman, B. (June 1990) A new era for high-precision touchscreens. Advances in Human-Computer Interaction, vol. 3, Hartson, R. & Hix, D. Eds., Ablex (1992) 1-33 HCIL-90-01, CS-TR-2487, CAR-TR-506.
  21. ↑ Wellner, Pierre. 1991. The Digital Desk. Video on YouTube
  22. ↑ Pierre Wellner's papers via DBLP
  23. ↑ Westerman, W., Elias J.G. and A.Hedge (2001) Multi-touch: a new tactile 2-d gesture interface for human-computer interaction Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, Vol. 1, 632-636.
  24. ↑ Shanis, J. and Hedge, A. (2003) Comparison of mouse, touchpad and multitouch input technologies. Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting, Oct. 13–17, Denver, CO, 746-750.
  25. ↑ Thom-Santelli, J. and Hedge, A. (2005) Effects of a multitouch keyboard on wrist posture, typing performance and comfort. Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting, Orlando, Sept. 26-30, HFES, Santa Monica, 646-650.
  26. ↑ Steve Jobs (2006). "And Boy Have We Patented It". Retrieved 2010-05-14. And we have invented a new technology called Multi-touch
  27. ↑ "US patent 7,046,230 "Touch pad handheld device"".
  28. ↑ Jobs; et al. "Touch Screen Device, Method, and Graphical User Interface for Determining Commands by Applying Heuristics".
  29. ↑ Wong, May. 2008. Touch-screen phones poised for growth http://www.usatoday.com/tech/products/2007-06-21-1895245927_x.htm. Retrieved April 2008.
  30. ↑ "Apple Patent Tips Multi-Touch Keyboard". 26 May 2015.
  31. ↑ Heater, Brian (27 January 2009). "Key Apple Multi-Touch Patent Tech Approved". PCmag.com. Retrieved 2011-09-27.
  32. ↑ "Apple's Pinch to Zoom Patent Has Been Tentatively Invalidated". Gizmodo. Retrieved 2013-06-12.
  33. ↑ Golson, Jordan. "Apple Denied Trademark for Multi-Touch". MacRumors. Retrieved 2011-09-27.
  34. ↑ Scientific American. 2008. "How It Works: Multitouch Surfaces Explained". Retrieved January 9, 2010.
  35. ↑ Brandon, John. 2009. "How the iPhone Works
  36. ↑ DIY Multi-touch screen
  37. 1 2 3 4 Knowledge base:Multitouch technologies. Digest author: Gennadi Blindmann
  38. ↑
  39. ↑ Minority Report Touch Interface for Real. Gizmodo.com. Retrieved on 2013-12-09.
  40. ↑ 2009. " Quantum of Solace Multitouch UI"
  41. ↑ Garofalo, Frank Joseph. "User Interfaces For Simultaneous Group Collaboration Through Multi-Touch Devices". Purdue University. p. 17. Retrieved 2012-06-03.
  42. ↑ "District 9 - Ship UI" on YouTube
Wikimedia Commons has media related to Multi-touch.
Look up multi-touch in Wiktionary, the free dictionary.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.