VR photography

Last updated
Example of VR photography
(view as a 360deg interactive panorama) MAM y Alfonso X el Sabio.jpg
Example of VR photography
( view as a 360° interactive panorama )

VR photography (after virtual-reality photography) is the interactive viewing of panoramic photographs, generally encompassing a 360-degree circle or a spherical view. The results is known as VR photograph (or VR photo), 360-degree photo, [1] photo sphere, [2] or spherical photo, as well as interactive panorama or immersive panorama.

Contents

VR photography is the art of capturing or creating a complete scene as a single image, as viewed when rotating about a single central position. Normally created by stitching together a number of photographs taken in a multi-row 360-degree rotation or using an omnidirectional camera, the complete virtual reality image can also be a totally computer-generated effect, or a composite of photography and computer generated objects. The history of VR photography is human-computer interaction in which a real or imaginary environment is simulated and users interact with and manipulate that world. [3]

Capture

There are several ways of capturing VR photography.

Rectilinear stitching

This involves the rotation of a digital camera, typically in the portrait (up and down) position and centered directly over the tripod. As the operator manually rotates the camera clockwise, the camera stops or clicks into a detent at regular intervals, such as every 30° of rotation. The rotator can be adjusted by changing the position of "detent ring or bolt," into another slot, to alter the interval of rotation: 40°, 60°, 90° etc.

If a given camera lens supports a wider view, one could select a larger detent value (for example, 60° instead of 30°). With a larger detent interval, fewer images are needed to capture a complete panoramic scene. The photographer may only need to take 6 shots as opposed to 10 shots to capture the same panorama. The combination of a precision rotator and a digital camera allows the photographer to take rectangular "slices" of any scene (indoors or outdoors). With a typical point and shoot digital camera, the photographer will snap 8, 10, 12 or 14 slices of a scene. Using specialized "photo stitching" software, the operator then assembles the "slices" into a single rectangular image, typically 4,500 pixels to 6,000 pixels wide. This technique, while extremely time-consuming, has remained popular even through today as the required equipment, rotator heads and software are relatively inexpensive and easy to learn. A stitched panoramic view is also called "cylindrical"—as the resulting stitched panorama allows panning in a complete 360°, but offers a limited vertical field of about 50° degrees above or below the horizon line.

Spherical stitching

This method requires the use of a "Fisheye lens" equipped digital SLR camera. The 2-shot fish eye camera system was made popular by IPIX in the mid-1990s and a two-shot rotator head that rotated and locked into 0° and 180° positions only. The camera was an Olympus or Nikon CoolPix camera and the lenses used were the Nikon FC-E8 or FC-E9 fish-eye lens. The IPiX 360 camera system enabled photographers to capture a full 360 X 360 floor to ceiling view of any scene with just 4 shots as opposed to the more time-consuming 8, 10, or 12-shot rectilinear produced panoramas described above. This type of virtual tour required more expensive virtual tour camera equipment including (for example) a Sigma 8mm f/3.5 lens which allowed photographers to set their rotator heads to 90° and capture a complete virtual tour of any scene in just 4 shots (0°, 90°, 180°, 270°).

Cubical stitching

This technique was one of the first forms of immersive, floor to ceiling virtual tours. Apple Computer pioneered this with the release of Apple's QuickTime VR in the early 1990s. Free utility software such as Cubic Converter and others allowed photographers to stitch and convert their panoramas into a "cube" like box to achieve a complete 360 X 360 view. Today, this technique is considered rather "old school," and spherical stitching has become more mainstream for producing these types of tours.

One-shot optics

Using one-shot panoramic optics one can create quick and easy panoramic videos and images such as the type used on the iPhone.

Software

Various software products can be used to create virtual tours. While programs such as Adobe Photoshop have new features that allow users to stitch images together, they only support "rectilinear" types of stitching. Photoshop cannot produce them as quickly or accurately as stitching software programs can such as Autodesk Stitcher. This is because there is sophisticated math and camera-lens profiles that are needed to create the desired panorama image which is based on your camera's depth of field (FOV) and the type of lens used. Cameras such as the Nikon D3 or D700 have a full frame digital SLR cameras, whereas the Nikon D90 or Canon T2i (Rebel line of Digital EOS cameras) have a smaller sensor. When full frame digital SLR cameras are used with a fish eye lens such as a Sigma 8mm F/3.5, a full circular image is captured. This allows you to shoot 2 or 3 shots per view to create a 360 X 360 stitched panoramic image. When used with a non full frame digital SLR camera like the Nikon D90 or Canon digital Rebel and similar cameras, 4-shots are required with the camera in the portrait position. The resulting image will have the left and right sides cropped off each of the 4 images and each of the four corners, creating a rounded image.

Hardware

Cameras with one lens

These models are used with a fisheye lens. The lens bends the angle of the shot to take a larger radius of the selected subject. It is not possible to take a complete 360-degree picture with this technique because there is always a dead angle directly behind the lens.

Cameras with two lenses

360-degree cameras with two lenses are probably the most common type, as they can accommodate a full 360-degree angle with two lenses facing each other. A camera takes pictures and videos with an angle of just over 180 degrees, e.g. 220 degrees. These are then converted into a 360-degree object using software. Problems are often caused by stitching errors. This means that an incorrect combination of the images can result in an unclean cut edge that is difficult or impossible to remove.

Cameras with multiple lenses

Depending on the application, manufacturers use more than two camera lenses to produce the images. One of the first cameras was the throwing camera "Panono". It has 36 cameras, which are triggered at the same time at the highest point, if the camera was thrown into the air. The more lenses are installed in the camera, the more difficult it becomes for the software to combine the individual images. The possible stitching problems are less with a good stitching.

Camera rigs

Camera rigs are mostly used for the attachment of 6 conventional Actioncams. GoPro produced one of the first camera rigs. They are available in different versions and connect several single cameras. The cameras are placed in this cube and record the surroundings in all directions.

Mosaic based cameras

If several "normal" cameras are combined in a network, one speaks of mosaic-based cameras. Each of these cameras records a small area of the environment. The individual images are then joined like mosaic stones to form an omnidirectional overall image. The number of cameras to be used depends on the focal length of the lenses used. The smaller the focal length, the larger the angle of view and the fewer cameras are required.

Display

QuickTime VR (QTVR) was the original interactive panorama format, with Apple's QuickTime software acting as the viewer. Recent versions of Microsoft Windows and Microsoft Photos also provide built-in support via the .pano file extension. [4] There are also a growing number of different players and plug-ins. Many of these have been based on Flash, Java, SilverLight, and custom programming using OpenGL and WebGL, but 360 player development is now largely based in HTML5 and JavaScript.

VR photography can also be used for displaying objects in 360 (360 product photography), commonly referred to as 360 Object VR, 360 product photography, 360 product images and 360 product views). These are created by capturing a series of images as the object rotates over a 360 rotation (camera stays in a fixed position). The output will be a series of individual images (typically JPG format) that can then be composed into an interactive 360 view, typically using HTML5 and JavaScript. 360 Object VR is commonly used in ecommerce.

See also

Related Research Articles

<span class="mw-page-title-main">Single-lens reflex camera</span> Camera that typically uses a mirror and prism system

A single-lens reflex camera (SLR) is a camera that typically uses a mirror and prism system that permits the photographer to view through the lens and see exactly what will be captured. With twin lens reflex and rangefinder cameras, the viewed image could be significantly different from the final image. When the shutter button is pressed on most SLRs, the mirror flips out of the light path, allowing light to pass through to the light receptor and the image to be captured.

<span class="mw-page-title-main">Digital camera</span> Camera that captures photographs or video in digital format

A digital camera, also called a digicam, is a camera that captures photographs in digital memory. Most cameras produced today are digital, largely replacing those that capture images on photographic film or film stock. Digital cameras are now widely incorporated into mobile devices like smartphones with the same or more capabilities and features of dedicated cameras. High-end, high-definition dedicated cameras are still commonly used by professionals and those who desire to take higher-quality photographs.

<span class="mw-page-title-main">Panorama</span> Wide-angle view or representation of a physical space

A panorama is any wide-angle view or representation of a physical space, whether in painting, drawing, photography, film, seismic images, or 3D modeling. The word was coined in the 18th century by the English painter Robert Barker to describe his panoramic paintings of Edinburgh and London. The motion-picture term panning is derived from panorama.

<span class="mw-page-title-main">Wide-angle lens</span> Type of lens

In photography and cinematography, a wide-angle lens is a lens covering a large angle of view. Conversely, its focal length is substantially smaller than that of a normal lens for a given film plane. This type of lens allows more of the scene to be included in the photograph, which is useful in architectural, interior, and landscape photography where the photographer may not be able to move farther from the scene to photograph it.

Panoramic photography is a technique of photography, using specialized equipment or software, that captures images with horizontally elongated fields of view. It is sometimes known as wide format photography. The term has also been applied to a photograph that is cropped to a relatively wide aspect ratio, like the familiar letterbox format in wide-screen video.

<span class="mw-page-title-main">Fisheye lens</span> Wide-angle photographic lens with strong barrel distortion

A fisheye lens is an ultra wide-angle lens that produces strong visual distortion intended to create a wide panoramic or hemispherical image. Fisheye lenses achieve extremely wide angles of view, well beyond any rectilinear lens. Instead of producing images with straight lines of perspective, fisheye lenses use a special mapping, which gives images a characteristic convex non-rectilinear appearance.

QuickTime VR is an image file format developed by Apple Inc. for QuickTime, and discontinued along with QuickTime 7. It allows the creation and viewing of VR photography, photographically captured panoramas, and the viewing of objects photographed from multiple angles. It functions as plugins for the QuickTime Player and for the QuickTime Web browser plugin.

<span class="mw-page-title-main">Sigma Corporation</span> Japanese camera and camera lens manufacturer

Sigma Corporation is a Japanese company, manufacturing cameras, lenses, flashes and other photographic accessories. All Sigma products are produced in the company's own Aizu factory in Bandai, Fukushima, Japan. Although Sigma produces several camera models, the company is best known for producing high-quality lenses and other accessories that are compatible with the cameras produced by other companies.

A virtual tour is a simulation of an existing location, usually composed of a sequence of videos, still images or 360-degree images. It may also use other multimedia elements such as sound effects, music, narration, text and floor map. It is distinguished from the use of live television to affect tele-tourism.

<span class="mw-page-title-main">Image stitching</span> Combining multiple photographic images with overlapping fields of view

Image stitching or photo stitching is the process of combining multiple photographic images with overlapping fields of view to produce a segmented panorama or high-resolution image. Commonly performed through the use of computer software, most approaches to image stitching require nearly exact overlaps between images and identical exposures to produce seamless results, although some stitching algorithms actually benefit from differently exposed images by doing high-dynamic-range imaging in regions of overlap. Some digital cameras can stitch their photos internally.

<span class="mw-page-title-main">Image stabilization</span> Techniques used to reduce blurring of images

Image stabilization (IS) is a family of techniques that reduce blurring associated with the motion of a camera or other imaging device during exposure.

<span class="mw-page-title-main">Tilt–shift photography</span> Camera technique

Tilt–shift photography is the use of camera movements that change the orientation or position of the lens with respect to the film or image sensor on cameras.

PTGui is a panorama photo stitching program for Windows and macOS developed by New House Internet Services BV. PTGui was created as a GUI frontend to Helmut Dersch's Panorama Tools. It features its own stitching and blending engine along with compatibility to Panorama Tools. PTGui supports telephoto, normal, wide angle and fisheye lenses to create partial cylindrical up to full spherical panoramas. PTGui can handle multiple rows of images.

<span class="mw-page-title-main">360-degree video</span> Visual arts technique

360-degree videos, also known as surround video, or immersive videos or spherical videos, are video recordings where a view in every direction is recorded at the same time, shot using an omnidirectional camera or a collection of cameras. The term 360x180 can be used to indicate 360° of azimuth and 180° from nadir to zenith. During playback on normal flat display the viewer has control of the viewing direction like a panorama. It can also be played on a display or projectors arranged in a sphere or some part of a sphere.

<span class="mw-page-title-main">Panoramic tripod head</span>

A panoramic tripod head is a piece of photographic equipment, mounted to a tripod, which allows photographers to shoot a sequence of images around the entrance pupil of a lens that can be used to produce a panorama. The primary function of the panoramic head is to precisely set the point of rotation about the entrance pupil for a given lens and focal length, eliminating parallax error.

<span class="mw-page-title-main">Omnidirectional (360-degree) camera</span> Camera that can see in all directions

In photography, an omnidirectional camera, also known as 360-degree camera, is a camera having a field of view that covers approximately the entire sphere or at least a full circle in the horizontal plane. Omnidirectional cameras are important in areas where large visual field coverage is needed, such as in panoramic photography and robotics.

<span class="mw-page-title-main">Brenizer method</span> Photographic technique

The Brenizer method, sometimes referred to as bokeh panorama or bokehrama, is a photographic technique characterized by the creation of a digital image exhibiting a shallow depth of field in tandem with a wide angle of view. Created by use of panoramic stitching techniques applied to portraiture, it was popularized by photographer Ryan Brenizer.

<span class="mw-page-title-main">Panoweaver</span>

Panoweaver is an image stitching app. It supports telephoto, normal, wide angle and fisheye lens images into full 360*180 spherical panoramic image. Panoweaver also supports exporting 360 panoramic images into Flash VR, QuickTime VR, Java-based VR tours and swf, and publish on Facebook.

RoundMe was a virtual tour application which allowed users to create, upload and share 360 degree panoramic photos and multimedia content of real spaces, that users could visit virtually using Google Cardboard or any VR headsets. The app was available on the web, iOS and Android. Roundme was positioned as one of the Best New Apps in the iTunes App Store in 58 countries in 2015. Roundme raised a $3 million round led by April Capital in 2015, reportedly by TechCrunch. The company was also hosting spaces for brands including National Library of Belarus and American Airlines.

References

  1. "IVRPA Virtual Reality Photography and Video: Glossary". IVRPA.
  2. "Create immersive photo experiences with Google Photo Sphere - geojournalism.org". geojournalism.org. 4 February 2015.
  3. "History of VR Photography". Archived from the original on 2012-01-16. Retrieved 2012-01-14.
  4. "James Mackenzie - What are .pano files?". www.jamesfmackenzie.com.

Further reading