Raw image format

Raw image file

Filename extension	.3fr, .ari, .arw, .bay, .crw, .cr2, .cap, .dcs, .dcr, .dng, .drf, .eip, .erf, .fff, .iiq, .k25, .kdc, .mdc, .mef, .mos, .mrw, .nef, .nrw, .obm, .orf, .pef, .ptx, .pxn, .r3d, .raf, .raw, .rwl, .rw2, .rwz, .sr2, .srf, .srw, .tif .x3f
Type of format	Image file formats

A camera raw image file contains minimally processed data from the image sensor of either a digital camera, image scanner, or motion picture film scanner.^[1][2] Raw files are named so because they are not yet processed and therefore are not ready to be printed or edited with a bitmap graphics editor. Normally, the image is processed by a raw converter in a wide-gamut internal colorspace where precise adjustments can be made before conversion to a "positive" file format such as TIFF or JPEG for storage, printing, or further manipulation, which often encodes the image in a device-dependent colorspace. There are dozens, if not hundreds, of raw formats in use by different models of digital equipment (like cameras or film scanners).^[3]

Rationale

Raw image files are sometimes called digital negatives, as they fulfill the same role as negatives in film photography: that is, the negative is not directly usable as an image, but has all of the information needed to create an image. Likewise, the process of converting a raw image file into a viewable format is sometimes called developing a raw image, by analogy with the film development process used to convert photographic film into viewable prints. The selection of the final choice of image rendering is part of the process of white balancing and color grading.

Like a photographic negative, a raw digital image may have a wider dynamic range or color gamut than the eventual final image format, and it preserves most of the information of the captured image. The purpose of raw image formats is to save, with minimum loss of information, data obtained from the sensor, and the conditions surrounding the capturing of the image (the metadata).

Raw image formats are intended to capture as closely as possible (i.e. at the best of the specific sensor's performance) the radiometric characteristics of the scene, that is, physical information about the light intensity and color of the scene.

Most raw image file formats store information sensed according to the geometry of the sensor's individual photo-receptive elements (sometimes called pixels) rather than points in the expected final image: sensors with hexagonal element displacement, for example, record information for each of their hexagonally-displaced cells, which a decoding software will eventually transform into the rectangular geometry during "digital developing".

File contents

Raw files contain the information required to produce a viewable image from the camera's sensor data. The structure of raw files often follows a common pattern:

• A short file header which typically contains an indicator of the byte-ordering of the file, a file identifier and an offset into the main file data
• Camera sensor metadata which is required to interpret the sensor image data, including the size of the sensor, the attributes of the CFA and its color profile
• Image metadata which is required for inclusion in any CMS environment or database. These include the exposure settings, camera/scanner/lens model, date (and, optionally, place) of shoot/scan, authoring information and other. Some raw files contain a standardized metadata section with data in Exif format.
• An image thumbnail
• Optionally a reduced-size image in JPEG format, which can be used for a quick preview
• In the case of motion picture film scans, either the timecode, keycode or frame number in the file sequence which represents the frame sequence in a scanned reel. This item allows the file to be ordered in a frame sequence (without relying on its filename).
• The sensor image data

Many raw file formats, including IIQ (Phase One), 3FR (Hasselblad), DCR, K25, KDC (Kodak), CR2 (Canon), ERF (Epson), MEF (Mamiya), MOS (Leaf), NEF (Nikon), ORF (Olympus), PEF (Pentax), RW2 (Panasonic) and ARW, SRF, SR2 (Sony), are based on the TIFF file format.^[4] These files may deviate from the TIFF standard in a number of ways, including the use of a non-standard file header, the inclusion of additional image tags and the encryption of some of the tagged data.

Panasonic's raw converter corrects geometric distortion and chromatic aberration on such cameras as the LX3,^[5][6][7] with necessary correction information presumably included in the raw.^[8] Phase One's raw converter Capture One also offers corrections for geometrical distortion, chromatic aberration, purple fringing and keystone correction emulating the shift capability of tilt-shift in software and specially designed hardware, on most raw files from over 100 different cameras.^[9][10] The same holds for Canon's DPP application, at least for all more expensive cameras like all EOS DSLRs and the G<n> series of compact cameras.

DNG, the Adobe digital negative format, is an extension of the TIFF 6.0 format and is compatible with TIFF/EP, and uses various open formats and/or standards, including Exif metadata, XMP metadata, IPTC metadata, CIE XYZ coordinates, ICC profiles, and JPEG.^[11]

Sensor image data

In digital photography, the raw file plays the role that photographic film plays in film photography. Raw files thus contain the full resolution (typically 12- or 14-bit) data as read out from each of the camera's image sensor pixels.

The camera's sensor is almost invariably overlaid with a color filter array (CFA), usually a Bayer filter, consisting of a mosaic of a 2x2 matrix of red, green, blue and (second) green filters.

One variation on the Bayer filter is the RGBE filter of the Sony Cyber-shot DSC-F828, which exchanged the green in the RG rows with "emerald"^[12] (a blue-green^[13] or cyan^[14] color). Other sensors, such as the Foveon X3 sensor, capture information directly in RGB form (using three pixel sensors in each location). These RGB raw data still need to be processed to make an image file, because the raw RGB values correspond to the responses of the sensors, not to a standard color space like sRGB. These data do not need to be demosaiced, however.

Flatbed and film scanner sensors are typically straight narrow RGB or RGBI (where "I" stands for the additional infra-red channel for automatic dust removal) strips that are swept across an image. The HDRi raw data format is able to store the infrared raw data, which can be used for infrared cleaning, as an additional 16-bit channel. The remainder of the discussion about raw files applies to them as well. (Some scanners do not allow the host system access to the raw data at all, as a speed compromise. The raw data are processed very rapidly inside the scanner to select out the best part of the available dynamic range so only the result is passed to the computer for permanent storage, reducing the amount of data transferred and therefore the bandwidth requirement for any given speed of image throughput.)

To obtain an image from a raw file, this mosaic of data must be converted into standard RGB form. This is often referred to as "raw development".

When converting from the four-sensor 2x2 Bayer-matrix raw form into RGB pixels, the green pair is used to control the luminance detail of the processed output pixel, while the red and blue, which each have half as many samples, are used mostly for the more slowly-varying chroma component of the image.

If raw format data is available, it can be used in high-dynamic-range imaging conversion, as a simpler alternative to the multi-exposure HDI approach of capturing three separate images, one underexposed, one correct and one overexposed, and "overlaying" one on top of the other.

Standardization

Providing a detailed and concise description of the content of raw files is highly problematic. There is no single raw format; formats can be similar or radically different. Different manufacturers use their own proprietary and typically undocumented formats, which are collectively known as raw format. Often they also change the format from one camera model to the next. Several major camera manufacturers, including Nikon, Canon and Sony, encrypt portions of the file in an attempt to prevent third-party tools from accessing them.^[15]

This industry-wide situation of inconsistent formatting has concerned many photographers who worry that their valuable raw photos may someday become inaccessible, as computer operating systems and software programs become obsolete and abandoned raw formats are dropped from new software. The availability of high-quality open source software which decodes raw image formats, particularly dcraw, has helped to alleviate these concerns. An essay by Michael Reichmann and Juergen Specht stated "here are two solutions – the adoption by the camera industry of A: Public documentation of RAW formats; past, present and future, or, more likely B: Adoption of a universal RAW format".^[16] "Planning for [US] Library of Congress Collections" identifies raw-file formats as "less desirable file formats", and identifies DNG as a suggested alternative.^[17]

DNG is the only raw image format for which industry-wide buy-in is being sought. It is based upon, and compatible with, the ISO standard raw image format ISO 12234-2, TIFF/EP, and is being used by ISO in their revision of that standard.

The ISO standard raw image format is ISO 12234-2, better known as TIFF/EP. (TIFF/EP also supports "non-raw", or "processed", images). TIFF/EP provided a basis for the raw image formats of a number of cameras. For example, Nikon's NEF raw files are based on TIFF/EP, and include a tag which identifies the version of TIFF/EP they are based on.^[18] Adobe's DNG raw file format was based on TIFF/EP, and the DNG specification states "DNG ... is compatible with the TIFF-EP standard".^[19] Several cameras use DNG as their raw image format, so in that limited sense they use TIFF/EP too.^[20]

Adobe Systems launched this DNG raw image format in September 2004. By September 2006, several camera manufacturers had started to announce support for DNG in newer camera models, including Leica, Samsung, Ricoh, Pentax, Hasselblad (native camera support); and, Better Light (export).^[21] The Leica Digital-Modul-R (DMR) was first to use DNG as its native format.^[22] In September 2009 Adobe stated that there were no known intellectual property encumbrances or license requirements for DNG.^[23] (There is a "Digital Negative (DNG) Specification Patent License",^[24] but it does not actually state that there are any patents held on DNG, and the September 2009 statement was made at least 4 years after this license was published).

TIFF/EP began its 5-year revision cycle in 2006.^[25] Adobe offered the DNG specification to ISO to be part of ISO's revised TIFF/EP standard.^[26][27] A progress report in October 2008 from ISO about the revision of TIFF/EP stated that the revision "... currently includes two "interoperability-profiles," "IP 1" for processed image data, using ".TIF" extension, and "IP 2" for "raw" image data, ".DNG" extension".^[28] It is "IP 2" that is relevant here. A progress report in September 2009 states that "This format will be similar to DNG 1.3, which serves as the starting point for development."^[29]

DNG has been used by open-source developers.^[15] Use by camera makers varies: the largest companies such as Canon, Nikon, Sony, and some others, do not use DNG. Smaller companies and makers of "niche" cameras who might otherwise have difficulty getting support from software companies frequently use DNG as their native raw image format. Pentax uses DNG as an optional alternative to their own raw image format. There are 15 or more such companies, even including a few that specialize in movie cameras.^[20] In addition, most Canon point & shoot cameras can support DNG by using CHDK.

Processing

To be viewed or printed, the output from a camera's image sensor has to be processed, that is, converted to a photographic rendering of the scene, and then stored in a standard raster graphics format such as JPEG. This processing, whether done in-camera or later in a raw-file converter, involves a number of operations, typically including:^[30][31]

• decoding – image data of raw files are typically encoded for compression purpose, but also often for obfuscation purpose (e.g. raw files from Canon^[32] or Nikon cameras).^[33]
• defective pixel removal – replacing data in known bad locations with interpolations from nearby locations
• white balancing – accounting for color temperature of the light that was used to take the photograph
• demosaicing – interpolating the partial raw data received from the color-filtered image sensor into a matrix of colored pixels.
• noise reduction – trading off detail for smoothness by removing small fluctuations
• color translation – converting from the camera native color space defined by the spectral sensitivities of the image sensor to an output color space (typically sRGB for JPEG)
• tone reproduction^[34][35] – the scene luminance captured by the camera sensors and stored in the raw file (with a dynamic range of typically 10 or more bits) needs to be rendered for pleasing effect and correct viewing on low-dynamic-range monitors or prints; the tone-reproduction rendering often includes separate tone mapping and gamma compression steps.
• compression – for example JPEG compression

Note that demosaicing is only performed for CFA sensors; it is not required for 3CCD or Foveon X3 sensors.

Cameras and image processing software may also perform additional processing to improve image quality, for example:

• removal of systematic noise – bias frame subtraction and flat-field correction
• dark frame subtraction
• optical correction – lens distortion correction, vignetting correction, and color fringing correction
• contrast enhancement
• increasing visual acuity by unsharp masking
• dynamic range compression – lighten shadow regions without blowing out highlight regions

When a camera saves a raw file it defers most of this processing; typically the only processing performed is the removal of defective pixels (the DNG specification requires that defective pixels are removed before creating the file^[36]). Some camera manufacturers do additional processing before saving raw files; for example, Nikon has been criticized by astrophotographers for applying noise reduction before saving the raw file.^[37]

Some raw formats also allow nonlinear quantization.^[38][39] This nonlinearity allows the compression of the raw data without visible degradation of the image by removing invisible and irrelevant information from the image. Although noise is discarded this has nothing to do with (visible) noise reduction.

Benefits

Nearly all digital cameras can process the image from the sensor into a JPEG file using settings for white balance, colour saturation, contrast, and sharpness that are either selected automatically or entered by the photographer before taking the picture. Cameras that produce raw files save these settings in the file, but defer the processing. This results in an extra step for the photographer, so raw is normally only used when additional computer processing is intended. However, raw has numerous advantages over JPEG such as:

• Many more shades of colors compared to JPEG files - raw files have 12 or 14 bits of intensity information per channel (4096-16384 shades), compared to JPEG's gamma-compressed 8 bits (256 shades).
• Higher image quality. Because all the calculations (such as applying gamma correction, demosaicing, white balance, brightness, contrast, etc...) used to generate pixel values (in RGB format for most images) are performed in one step on the base data, the resultant pixel values will be more accurate and exhibit less posterization.
• Bypassing of undesired steps in the camera's processing, including sharpening and noise reduction
• JPEG images are typically saved using a lossy compression format (though a lossless JPEG compression is now available). Raw formats typically use lossless compression or high-quality lossy compression.
• Finer control. Raw conversion software allows users to manipulate more parameters (such as lightness, white balance, hue, saturation, etc...) and do so with greater variability. For example, the white point can be set to any value, not just discrete preset values like "daylight" or "incandescent". Furthermore, the user can typically see a preview while adjusting these parameters.
• The colour space can be set to whatever is desired.
• Different demosaicing algorithms can be used, not just the one coded into the camera.
• The contents of raw files include more information, and potentially higher quality, than the converted results, in which the rendering parameters are fixed, the colour gamut is clipped, and there may be quantization and compression artifacts.
• Large transformations of the data, such as increasing the exposure of a dramatically under-exposed photo, result in fewer visible artifacts when done from raw data than when done from already rendered image files. Raw data leave more scope for both corrections and artistic manipulations, without resulting in images with visible flaws such as posterization.
• All the changes made on a raw image file are non-destructive; that is, only the metadata that controls the rendering is changed to make different output versions, leaving the original data unchanged.
• To some extent, raw-format photography eliminates the need to use the HDRI technique, allowing a much better control over the mapping of the scene intensity range into the output tonal range, compared to the process of automatically mapping to JPEG or other 8-bit representation.

Drawbacks

• Camera raw file size is typically 2–6 times larger than JPEG file size.^[40] While use of raw formats avoids the compression artifacts inherent in JPEG, fewer images can fit on a given memory card. However, the large sizes and low prices of modern memory cards mitigate this. Burst mode shooting tends to be slower and shorter due to the larger file size.
• Most raw formats implement lossless data compression to reduce the size of the files without affecting image quality. But some others use lossy data compression where quantization and filtering is performed on the image data.^[38][39] Sony’s lossy 11+7 bit delta compression of RAW data causes posterization under certain conditions.^[41] Several Nikon cameras let photographers choose between no compression, lossless compression or lossy compression for their raw images. Red Digital Cinema Camera Company introduced .r3d REDCODE RAW with compression ratio from 3:1 to 18:1 which depends on resolution and frame rates.^[42]
• The standard raw image format (ISO 12234-2, TIFF/EP) is not widely accepted. DNG, the potential candidate for a new standard format, has not been adopted by many major camera companies. (See "Standardization" section). Numerous different raw formats are currently in use and new raw formats keep appearing, while others are abandoned.^[43]
• Because of the lack of widespread adoption of a standard raw format, more specialized software may be required to open raw files than for standardized formats like JPEG or TIFF. Software developers have to frequently update their products to support the raw formats of the latest cameras but open source implementations like dcraw make it easier.
• The time taken in the image workflow is an important factor when choosing between raw and ready-to-use image formats. With modern photo editing software the additional time needed to process raw images has been greatly reduced but it still requires an extra step in workflow in comparison with using out-of-camera JPEGs.

Software support

Cameras that support raw files typically come with proprietary software for conversion of their raw image data into standard RGB images. Other processing and conversion programs and plugins are available from vendors that have either licensed the technology from the camera manufacturer or reverse-engineered the particular raw format and provided their own processing algorithms.

Operating system support

Apple

In 2005, Apple Computer introduced several products which offered raw-file support. In January, Apple released iPhoto 5, which offered basic support for viewing and editing many raw file formats. In April of that year, Apple introduced a new version of its operating system, Mac OS X v10.4, which added raw support directly to the operating system, as part of the ImageIO framework, which adds raw support automatically to the majority of Mac OS X applications both from Apple (such as Preview, Mac OS X's PDF and image viewing application and Aperture, a photo post-production software package for professionals) as well as all third party applications which make use of the ImageIO frameworks.

Semi-regular updates to OS X generally include updated support for new raw formats introduced in the intervening months by camera makers.

Microsoft

Microsoft supplies free software for Windows since Windows XP to integrate viewing and printing into the system's other photo tools.^[44] The Windows Camera Codec pack allows native viewing of raw-format files from 120 digital SLR cameras from multiple manufacturers in Windows Explorer and Windows Live Photo Gallery, in Windows Vista and Windows 7.^[45]

Windows XP and later versions support the WIC codec standard. Products such as Windows Photo Gallery, Windows Live Photo Gallery and FastPictureViewer Professional^[46] can view raw formats for which the necessary WIC codecs are installed. Camera manufacturers Canon, Nikon, Sony, Olympus and Pentax have released WIC codecs, although some manufactures are only providing codec support for the 32-bit versions of Vista.^[47] Commercial DNG codecs are also available from Ardfry Imaging among others.^[48][49]

Android

Android Lollipop 5.0, introduced in late 2014, can allow smartphones to take RAW images, useful in low-light situations.^[50]

Free and open source software

darktable is a raw-workflow tool for Linux and other open Unix-like operating systems. Features native 32-bit floating point processing and a plugin architecture.

dcraw is a program which reads most raw formats and can be made to run on operating systems not supported by most commercial software (such as Unix). Libraw^[51] is an API library based on dcraw, offering a more convenient interface for reading and converting raw files. HDR PhotoStudio and AZImage^[52] are some of the commercial applications that use Libraw. Jrawio is another API library, written in pure Java code and compliant to the standard Java Image I/O API.

digiKam is an advanced digital photo management application for Linux, Windows, and Mac OS X that supports raw processing.

ExifTool supports the reading, writing and editing of metadata in raw image files. ExifTool supports many different types of metadata including Exif, GPS, IPTC, XMP, JFIF, GeoTIFF, ICC Profile, Photoshop IRB, FlashPix, AFCP and ID3, as well as the maker notes of many digital cameras.

ImageMagick, a popular software suite for image manipulation and conversion, reads many different raw file formats.^[53] ImageMagick is available for Linux/Unix, Mac OS, Windows, and other platforms.

LightZone is a photo editing program providing the ability to edit many raw formats natively. Most tools are raw converters, but LightZone allows a user to edit a raw file as if it were TIFF or JPEG. The project was discontinued in September 2011^[54] and reinstated as an open source project in December 2012.

Rawstudio is a raw format developer.

RawTherapee is a raw developer supporting Linux, OS X and Windows operating systems. It features a native 32-bit floating point pipeline.

Shotwell is an image organizer available for all major operating systems with the ability to view and edit raw images and has built-in social networking upload capability.

UFRaw is a frontend which uses dcraw as a backend. It can be used as a GIMP plugin and is available for most operating systems.

Proprietary software

In addition to those listed under operating system support, above, the commercial software described below support raw formats.

Dedicated raw converters

The following products were launched as RAW processing software to process a wide range of raw files, and have this as their main purpose:

• Adobe Photoshop Lightroom
• Bibble Pro (now Corel AfterShot Pro)
• Capture One^[55]
• DxO Optics Pro
• Hasselblad's Phocus relies on operating system support to process non-Hasselblad files
• Photo Ninja
• Silkypix Developer Studio

Others

ACDSee Pro is photo management and editing software that supports the raw formats of 21 camera manufacturers.^[56]

Adobe Photoshop supports raw formats (as of version CS2).

DNG Viewer is a free Windows (32bit) viewer based on dcraw. The very simple viewer is installed as RAW Image Viewer, supports some lossless operations, and can save raw images as BMP, JPEG, PNG, or TIFF.^[57]

FastRawViewer is a dedicated RAW viewer that runs on Mac and Windows, and currently claims to support all RAW formats except Foveon.^[58]

Helicon Filter supports raw formats.

IrfanView is a freeware/shareware basic editor with support for raw files.

Paint Shop Pro contains raw support, although as in the case of most editors updates to the program may be necessary to attain compatibility with newer raw formats as they are released.

PhotoLine supports raw formats.

Picasa is a free editor and organizer from Google. It can read and display many raw formats, but like iPhoto, Picasa provides only limited tools for processing the data in a raw file.

SilverFast supports raw formats.

XnView support for raw formats is mostly based on dcraw.

A new class of raw file processing tools appeared with the development of HTML5 - rich Internet applications. Raw.pics.io is able to render and apply basic adjustments to raw and DNG files in a web browser.

Raw filename extensions and respective camera manufacturers

See also

• List of cameras supporting a raw format

References

External links

• Adobe: Understanding Raw Files"; background on how camera sensors treat raw files
• Open RAW: a working group of photographers, software engineers and other people interested in advocating the open documentation of digital camera raw files
• Atkins, Bob: "Raw, JPEG, and TIFF"; common file formats compared.
• Coupe, Adam: "The benefits of shooting in RAW"; Article with diagrams explaining raw data and its advantages.
• Goldstein, Jim M.: "RAW vs JPEG: Is Shooting RAW Format for Me?"; an editorial.
• Basic Photography lesson in Camera Raw A pros and cons approach to the discussion of shooting in Camera Raw
• Clevy, Laurent: "Inside the Canon RAW format v2: understanding the .CR2 file format"
• Foi, Alessandro: "Signal-dependent noise modeling, estimation, and removal for digital imaging sensors"; with Matlab software and raw-data samples of Canon, Nikon, Fujifilm cameras.

Graphics file formats Raster ANI ANIM APNG ART BMP BPG BSAVE CAL CIN CPC CPT DDS DPX ECW EXR FITS FLIC FLIF FPX GIF HDRi HEVC ICER ICNS ICO / CUR ICS ILBM JBIG JBIG2 JNG JPEG JPEG 2000 JPEG-LS JPEG XR MNG MIFF NRRD PAM PBM / PGM / PPM / PNM PCX PGF PICtor PNG PSD / PSB PSP QTVR RAS RBE JPEG-HDR Logluv TIFF SGI TGA TIFF TIFF/EP TIFF/IT WBMP WebP XBM XCF XPM XWD Raw CIFF DNG Vector AI CDR CGM DXF EVA EMF Gerber HVIF IGES PGML SVG VML WMF Xar Compound CDF DjVu EPS PDF PICT PS SWF XAML Related Exchangeable image file format (Exif) Extensible Metadata Platform (XMP) Category Comparison