OpenMAX

From Wikipedia, the free encyclopedia
OpenMAX
Developer(s) Khronos Group
Website /www.khronos.org/openmax

OpenMAX (Open Media Acceleration), often shortened as "OMX", is a non-proprietary and royalty-free cross-platform set of C-language programming interfaces that provides abstractions for routines especially useful for audio, video, and still images processing.[1][2] It is intended for low power and embedded system devices (including smartphones, game consoles, digital media players, and set-top boxes) that needs to efficiently process large amounts of multimedia data in predictable ways, such as video codecs, graphics libraries, and other functions for video, image, audio, voice and speech..[3]

OpenMAX provides three layers of interfaces: application layer (AL), integration layer (IL) and development layer (DL). OpenMAX is managed by the non-profit technology consortium Khronos Group.[4]

Layers

OpenMAX AL is the interface between multimedia applications, such as a media player, and the platform media framework. It allows companies that develop applications to easily migrate their applications to different platforms (customers) that support the OpenMAX AL application programming interface (API).[5]

OpenMAX IL is the interface between media framework, (such as StageFright or MediaCodec API on Android, DirectShow on Windows, FFmpeg or Libav on Linux, or GStreamer for cross-platform), and a set of multimedia components (such as an audio or video codecs). It allows companies that build platforms (e.g. allowing an implementation of an MP3 player) to easily change components like MP3 decoders and Equalizer effects and buy components for their platform from different vendors.[6]

OpenMAX DL is the interface between physical hardware, such as digital signal processor (DSP) chips and CPUs, and software, like video codecs and 3D engines. It allows companies to easily integrate new hardware that supports OpenMAX DL without reoptimizing their low level software.

Application layer

OpenMAX AL
Developer(s) Khronos Group
Stable release 1.1 / 18 January 2011
Operating system Cross-platform
Type API
License Various

OpenMAX AL accommodates common multimedia application use cases by standardizing a set of representative objects, as well as interfaces on those objects, to control and configure them. The OpenMAX AL API is divided into two profiles: Media Player and Media Player/Recorder. A platform can be compliant to one or both of these profiles by providing all features included in a profile.

It is an application-level, C-language, multimedia API designed for resource-constrained devices. The OpenMAX AL API design puts particular emphasis on ensuring the API is suitable for mobile embedded devices - including basic mobile phones, smart “feature” phones, PDAs and mobile digital music players. Nevertheless, this does not preclude its applicability to other sophisticated media playback and recording devices.

The OpenMAX AL API design devotes particular attention to application-developer friendliness. Its status as an open cross-platform API enables developers to port the same source across multiple devices with minimal effort. Thus OpenMAX AL provides a stable base for application development.

Features

OpenMAX AL features include:

  • Video playback and recording
  • Audio playback and recording
  • Image capture (camera) and display
  • Camera controls
  • Radio and RDS
  • Basic MIDI playback
  • Metadata extraction and insertion

Digital TV extension

A digital television (DTV) extension specification of OpenMAX AL adds standards-agnostic mobile TV tuning, playback, recording and electronic program guide functionality to OpenMAX AL Multimedia API, as a modular royalty-free, cross-platform C-language API for high-performance digital TV-related applications on mobile and embedded devices. DTV Extension is compatible with all major mobile TV standards (e.g. DVB-H, ISDB-T, T-DMB, etc.), and supports broadcast, unicast and multicast delivery methods for Digital TV.[7][8]

Specification versions

Implementations

  • Android 4.0 and later exposes OpenMAX AL as part of its NDK (Native Development Kit).[10]
  • LIM OpenMAX is an open source implementation of OpenMAX AL and OpenMAX IL for Linux
  • Bellagio is an open source OpenMAX IL implementation for Linux maintained by STMicroelectronics.[11]
  • Tizonia is an open source OpenMAX IL implementation for Linux[12]
  • GStreamer (GST) is an open source multimedia framework used by several application, and it can support OpenMAX IL with its "gst-openmax" module.[13][14]
  • C-only, optimized for NEON (Cortex A8) and SIMD (for ARM11 cores using ARMv6 architecture) optimized OpenMAX DL libraries are available at [15]

Comparison with OpenSL ES

OpenSL ES (Open Sound Library for Embedded Systems)) is another Khronos Group API that also provides a audio library for the same target market as OpenMAX AL. OpenSL ES and OpenMAX AL share the same common architecture and have a few common features:

  • Audio playback and recording
  • Basic MIDI playback
  • Metadata extraction

Integration layer

OpenMAX IL
Developer(s) Khronos Group
Stable release 1.1.2 / September 15, 2008
Operating system Cross-platform
Type API
License Various

The OpenMAX IL API strives to give media components portability across an array of platforms using the C-language. In the OpenMAX IL, components represent individual blocks of functionality. Components can be sources, sinks, codecs, filters, splitters, mixers, or any other data operator. Depending on the implementation, a component could possibly represent a piece of hardware, a software codec, another processor, or a combination thereof.

The interface abstracts the hardware and software architecture in the system. The OpenMAX IL API allows the user to load, control, connect, and unload the individual components. This flexible core architecture allows the Integration Layer to easily implement almost any media use case and mesh with existing graph-based media frameworks. The key focus of the OpenMAX IL API is portability of media components.

The OpenMAX IL API design devotes particular attention to use case flexibility and optimized data transfers between components.

Open source OpenMAX IL implementations are available,

  • Bellagio, is maintained by STMicroelectronics.
  • LIM OpenMAX, an implementation that has both AL and IL.

Development layer

OpenMAX DL
Developer(s) Khronos Group
Stable release 1.0.2 / December 21, 2007
Operating system Cross-platform
Type API
License Various

The OpenMAX DL API defines a set of low-level multimedia kernels or media processing building blocks. The building blocks might be used to accelerate traditional computational hotspots within standardized media codecs and other integrated media processing engines. The functional scope of the OpenMAX DL interface spans several domains including signal processing and image processing, audio coding, image coding, and video coding.

OpenMAX DL is split into five application domains:

  • AC - Audio Codecs (MP3 decoder and AAC decoder components)
  • IC - Image Codecs (JPEG components)
  • IP - Image Processing (Generic image processing functions)
  • SP - Signal Processing (Generic audio processing functions)
  • VC - Video Codecs (H264 and MP4 components)

OpenMAX DL is, among other companies, openmax_armlibraries implemented by ARM and ANSI C sample code can be downloaded from their webpage.

The OpenMAX API is supported by the PlayStation 3 console.

Working group

The OpenMAX working group was founded alongside sister project OpenVG on July 6, 2004. Promoting members in 2008 were AMD, Apple, ARM, Creative, Dell Inc, Ericsson, Freescale, Imagination Technologies Group plc, Intel, IBM, Motorola, Nokia, Nvidia Corporation, Samsung Electronics Co. Ltd, SK Telecom, Sony Computer Entertainment Inc and Texas Instruments.

See also

References

  1. ↑ http://www.cnx-software.com/2011/11/11/openmax-open-media-acceleration/ OpenMAX (Open Media Acceleration)
  2. ↑ https://events.linuxfoundation.org/images/stories/pdf/lceu2012_debski.pdf Video4Linux2 - Path to a Standardized Video Codec API
  3. ↑ http://jan.newmarch.name/LinuxSound/Sampled/OpenMAX/ Contents of full book "Linux Sound" - Chapter 13: OpenMAX/OpenSL
  4. ↑ http://www.khronos.org/openmax/ OpenMAX - The Standard for Media Library Portability (by Khronos Group)
  5. ↑ http://elinux.org/images/e/e0/The_OpenMAX_Integration_Layer_standard.pdf The OpenMAX Integration Layer standard
  6. ↑ http://elinux.org/images/5/52/Elc2011_garcia.pdf Integrating a Hardware Video Codec into Android Stagefright using OpenMAX IL
  7. ↑ http://www.khronos.org/openmax/al/dtv/ OpenMAX AL - Digital Television (DTV) Extension
  8. ↑ https://www.khronos.org/news/press/khronos-group-releases-provisional-openmax-al-digital-tv-extension-specific Khronos Group Releases Provisional OpenMAX AL Digital TV Extension Specification
  9. ↑ Khronos Group Releases OpenMAX AL Specification for Application-level Video, Audio and Image Processing on Mobile and Handheld Devices, Khronos press release
  10. ↑ http://developer.android.com/sdk/android-4.0-highlights.html
  11. ↑ http://elinux.org/images/e/e0/The_OpenMAX_Integration_Layer_standard.pdf The OpenMAX Integration Layer standard
  12. ↑ http://www.juanrubio.me/2013/01/announcing-tizonia-openmax-il/ Announcing Tizonia OpenMAX IL
  13. ↑ http://www.cnx-software.com/2011/11/11/openmax-open-media-acceleration/#ixzz2mVjgXE49 OpenMAX (Open Media Acceleration)
  14. ↑ https://github.com/tizonia Tizonia OpenMAX IL source code on GitHub
  15. ↑ http://www.cnx-software.com/2011/11/11/openmax-open-media-acceleration/#ixzz2mVjgXE49 OpenMAX (Open Media Acceleration)
  16. ↑ http://www.tuaw.com/2011/01/20/xbmc-for-ios-and-atv2-now-available/ XBMC for iOS and Apple TV now available
  17. ↑ http://developer.amd.com/gpu/AMDAPPSDK/assets/OpenVideo_Decode_API.PDF OpenVideo Decode (OVD) API

External links

Standards of the Khronos Group
This article is issued from Wikipedia. The text is available under the Creative Commons Attribution/Share Alike; additional terms may apply for the media files.