PrimeSense
Type | Subsidiary of Apple Inc. |
---|---|
Industry | Fabless Semiconductor |
Founded | 2005[1] |
Headquarters | Israel |
Key people |
|
Products |
|
Website | http://www.primesense.com/ |
PrimeSense is an Israeli 3D sensing company based in Tel Aviv. PrimeSense has offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $350 million on November 24, 2013.
Company Profile
PrimeSense is a fabless semiconductor company and provides products in the area of sensory inputs for consumer and commercial markets.[2]
PrimeSense's technology was originally applied to gaming but is now being applied in other fields.[3] PrimeSense is best known for licensing the hardware design and chip used in Microsoft’s Kinect motion-sensing system for the Xbox 360 in 2010.[4]
On November 24, 2013, Apple Inc. confirmed the purchase of PrimeSense.[5]
Technology
Light Coding Technology
PrimeSense’s depth acquisition is enabled by "light coding" technology. The process codes the scene with near-IR light, light that returns distorted depending upon where things are. The solution then uses a standard off-the-shelf CMOS image sensor to read the coded light back from the scene using various algorithms to triangulate and extract the 3D data. The product analyses scenery in 3 dimensions with software, so that devices can interact with users.[6][7]
Products
PrimeSense System on a Chip (SoC)
The CMOS image sensor works with the visible video sensor to enable the depth map provided by PrimeSense SoC’s Carmine (PS1080) and Capri (PS1200) to be merged with the color image. The SoCs perform a registration process so the color image (RGB) and depth (D) information is aligned properly.[8] The light coding infrared patterns are deciphered in order to produce a VGA size depth image of a scene. It delivers visible video, depth, and audio information in a synchronized fashion via the USB 2.0 interface. The SoC has minimal CPU requirements as all depth acquisition algorithms run on the SoC itself.
PrimeSense Sensors
- Carmine 1.08
- Carmine 1.09 (Short Range)
- Capri 1.25 (embedded)
PrimeSense embeds its technology in its own sensors,[9] the Carmine 1.08 and Carmine 1.09 and the yet to be released Capri 1.25 which will be available as an embedded solution. Capri 1.25, touted by the company as the world's smallest 3D sensor, debuted at International CES 2013.[10]
PrimeSense Middleware
PrimeSense developed the NiTE Middleware, the software that analyzes the data from the hardware, are the modules for OpenNI providing gesture and skeleton tracking. They are released only as binaries.[11] According to the NiTE Linkedin page: “Including computer vision algorithims, NiTE identifies users and tracks their movements, and provides the framework API for implementing Natural-Interaction UI controls based on gestures.”[12] The system can then interpret specific gestures, making completely hands-free control of electronic devices a reality.[3] Including:
- Identification of people their body properties, movements and gestures
- Classification of objects such as furniture
- Location of walls and floor[7]
Markets
PrimeSense's original focus was on the gaming[13] and living room markets,[14] but has since expanded to include:
Television
- Kinect by Microsoft is powered by PrimeSense technology allows gamers use their entire body to control play, action and movement of their onscreen characters.
PC and Mobile
- WAVI Xtion for the PC by ASUS uses PrimeSense's core 3D sensing solution, developed primarily for browsing multimedia content, accessing Web sites and social networks when the PC is hooked up to the living room TV.[15]
- Structure Sensor Mobile 3D sensor by Occipital uses a custom chip based on PrimeSense's 3D sensing solution. The sensor itself is designed to easily attach to a wide range of devices, including the Apple iPad, Android tablets and desktop platforms such as Windows, OS X and Linux.[16]
Interactive Displays
- EyePlay by Eyeclick- a interactive video gaming system with 3D interactive projection capabilities.[17]
- ViiMotion by Covii:an Interactive Software Device, created to provide generic or custom interactive applications through computer vision.[18]
- Interactive Projector by Ayotle: an interactive solution that uses a depth sensor to make any real or imaginary surface act like a tactile or contactless interactive device.[19]
- Finger Tracking MW by 3Gear Systems: a precise tracking system using computer graphics algorithms for reconstructing the precise pose of the user’s hands from 3D cameras[20]
Retail
- SmartFit by Styku:a multi-channel retail platform for fit prediction and visualization
- Bodymetrics pod by Bodymetrics: a full 3D body scanner that is designed to quickly and accurately calculate measurements which are then analyzed and used to find suitable garments.[21]
- 3D Scanner by Matterport:a low-cost 3D scanner that allows anyone to quickly and easily produce a realistic 3D model.[22]
Robotics
- SAMI by Criif: PrimeSense sensors allow the humanoid robot to be fully autonomous in the house or specific environment.[23]
Healthcare
- Ava by iRobot: an autonomous mobile robotics platform[24]
Milestones
- 2005
- PrimeSense is founded
- 2010
- 2011
- PrimeSense has raises a round of private equity funding as part of its plan to expand its motion-control chips[26]
- PrimeSense is selected by MIT Technology Review for World's Ten Most Important Technologies
- 2012
- 2013
- PrimeSense demonstrates "A World of 3D Sensing" at the 2013 International CES
Partners
- Occipital
- Covii
- Matterport
- 3Gear Systems
- Ayotle
- Willow Garage
- Open Perception
- shopperception
- SideKick
- MediaStanza
Involvement with OpenNI
PrimeSense is a founding member of OpenNI, an industry-led, non-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware.
Involvement with Microsoft
The company provided the 3D sensing technology for the first Kinect, previously known as Project Natal.[29][30]
Awards
The company was selected by MIT Technology Review magazine as one of world's 50 most innovative companies for 2011.[31]
PrimeSense wins Design Team of the Year in EE Times 2011 Annual Creativity in Electronics (ACE)[32]
PrimeSense is honored as a World Economic Forum Technology Pioneer in 2013.[33]
Competition
PrimeSense faces competition from both hardware and software providers:
- Mesa Imaging[34]
- Microsoft acquired 3D gesture recognition companies 3DV and Canesta and may release a future version of the Kinect using a chip other than PrimeSense[35]
- Omek Interactive offers a software solution that works across multiple depth cameras[36]
- SoftKinetic offers both a hardware and software solution, similar to PrimeSense[37] based on Time of flight as opposed to PrimeSense which uses Structured light.
- gestigon develops middleware for skeleton recognition and gesture control using multiple sensors, Time of flight and Structured light, and platforms/OS.</ref>
- PMDTechnologies provides long range as well as close range Time of flight sensors[38]
- Panasonic sells 3 different D-Imager cameras all of which are based on Time of flight technology. These cameras are better suited for industrial and outdoor use[39]
- LM3LABS offers a 3D body tracking middleware called 3DFeel [40] and a high-precision finger tracking called AirStrike (hardware sensor and software).[41]
- Chiaro Technologies OEM 3D capture technology being developed for industrial 3D machine vision. Structured light and Active stereo.
References
- ↑ PrimeSense home page
- ↑ http://www.primesense.com/about/
- ↑ 3.0 3.1 http://www2.technologyreview.com/tr50/primesense/
- ↑ http://venturebeat.com/2013/01/20/beyond-kinect-primesense-wants-to-drive-3d-sensing-into-more-everyday-consumer-gear/#FoKgcL7l6z2qct25.99
- ↑ http://allthingsd.com/20131124/apple-confirms-acquisition-of-3d-sensor-startup-primesense/
- ↑ http://forwardthinking.pcmag.com/gadgets/282321-primesense-motion-control-beyond-the-kinect
- ↑ 7.0 7.1 http://www.primesense.com/solutions/technology/
- ↑ http://electronicdesign.com/embedded/how-microsoft-s-primesense-based-kinect-really-works
- ↑ http://www.primesense.com/solutions/sensor/
- ↑ http://www.engadget.com/2013/01/11/primesense-capri-hands-on/
- ↑ http://wiki.debian.org/PrimeSenseNite
- ↑ http://www.linkedin.com/company/primesense/nite-middleware-902678/product
- ↑ http://www.crunchbase.com/company/primesense
- ↑ http://www.forbes.com/sites/nicoleperlroth/2010/12/13/for-primesense-microsofts-kinect-is-just-the-beginning/
- ↑ http://www.tomshardware.com/news/Motion-Sensing-Kinect-PrimeSense-WAVI-Xtion-Xbox-360,11874.html
- ↑ http://structure.io
- ↑ www.eyeclick.com
- ↑ http://vimeo.com/27158262
- ↑ http://www.3dvisworld.com/news/technology-news/3672-new-ayotle-anytouch-3d-tactile-touchscreen.html
- ↑ http://remotepresence.org/?p=394
- ↑ http://www.gizmag.com/bodymetrics-body-mapping-for-clothes-fitting/20270/
- ↑ https://angel.co/matterport
- ↑ http://visionaryexcellence.com/tag/criif/
- ↑ http://www.engadget.com/2012/02/29/irobot-reorganizes-forms-new-unit-focused-on-ava-and-other-emer/
- ↑ http://www.globes.co.il/serveen/globes/docview.asp?did=1000550536&fid=942
- ↑ http://www.reuters.com/article/2011/01/12/idUS167050511820110112
- ↑ http://www.primesense.com/news/primesense-recognized-as-technology-pioneer-by-world-economic-forum/
- ↑ http://www.primesense.com/news/primesense-unveils-capri/
- ↑ Gohring, Nancy (29 July 2010). "Mundie: Microsoft's Research Depth Enabled Kinect". PC World. Retrieved 2 August 2010.
- ↑ Corp., Microsoft (10 March 2010). "PrimeSense Supplies 3-D-Sensing Technology to "Project Natal" for Xbox 360". Retrieved 2 August 2010.
- ↑
- ↑ http://www.eetimes.com/electronics-news/4215731/EE-Times-honors-2011-ACE-Award-winners
- ↑ http://reports.weforum.org/technology-pioneers-2013/
- ↑ VentureBeat Article: PrimeSense Raises Round for Motion Control Chips
- ↑ Israeli article in Calcalist Newspaper: Microsoft Wants to Give Up PrimeSense
- ↑ VentureBeat Article: Omek Sees the PC as the NExt Frontier for MOtion Control Games ; Omek was acquired by Intel in 2013
- ↑ BBC Article: Kinect for Windows gesture sensor launched by Microsoft
- ↑ Industry Gamers: CES New Technologies for Gaming
- ↑ Panasonic D-Imager Website
- ↑ 3DFeel Website
- ↑ AirStrike Website