RealityCapture

Last updated
RealityCapture
Developer(s) Capturing Reality
Initial release2016 (2016)
Operating system Microsoft Windows
Available inEnglish
Type 3D computer graphics software
License Proprietary
Website www.capturingreality.com

RealityCapture (RC) is photogrammetry software for creating 3D models out of unordered photographs (terrestrial and/or aerial) or laser scans without seams. The most common fields of its current use are cultural heritage (art, archaeology, and architecture), full body scanning, gaming, surveying, mapping, visual effects (VFX) and virtual reality (VR) in general.

Contents

It features include image registration (alignment), automatic calibration, calculating a polygon mesh, colouring, texturing, parallel projections, georeferencing, DSM, coordinate system conversion, simplification, scaling, filtration, smoothing, measurement, inspection, and various exports and imports. [1] The program can be run under the command line. There is also a software developer kit available. [2] RealityCapture is able to mix camera images and laser scans. It is designed to make low demands on hardware. It works linearly, which means if its inputs are doubled, the processing time will be doubled as well. The software is currently available only in English language.

Technical requirements

RealityCapture runs on 64-bit machines with at least 8GB of RAM, 64bit Microsoft Windows 7 / 8 / 8.1 / 10, using a graphics card with an nVidia CUDA 2.0+ GPU and at least 1 GB of RAM. Users can run the application and register images without the nVidia card but will not be able to create a textured mesh. Users must install the Media Feature Pack for Windows, and on Windows Server users must install Media Foundation features.

Each RC software license is limited to 32 CPU cores and 3 GPU cards. For higher configurations, more licenses must be purchased equivalently. A computer with 4 CPU cores, 16 GB RAM and 386 CUDA cores is recommended.

Meshing, coloring and texturing are completely out-of-core in RC, which is intended to avoid RAM performance loss during these processes.

History

The public beta version of RealityCapture was released by Slovak company Capturing Reality (founded in 2013), based in Bratislava, on 2 February 2016. [3] However, there had also been a closed beta running for almost a year. [4] [5] [6] [7]

Staff of Capturing Reality have published in several computer vision and graphics journals and conference papers, and have had hundreds of citations. [8] [9] [10]

Capturing Reality was acquired by Epic Games in March 2021; Epic plans to integrate RealityCapture into the Unreal Engine with the acquisition. The acquisition does not affect Capturing Reality's existing business and allowed them to reduce their pricing model for RealityCapture. [11]

Related Research Articles

<span class="mw-page-title-main">OpenGL</span> Cross-platform graphics API

OpenGL is a cross-language, cross-platform application programming interface (API) for rendering 2D and 3D vector graphics. The API is typically used to interact with a graphics processing unit (GPU), to achieve hardware-accelerated rendering.

<span class="mw-page-title-main">Nvidia</span> American technology company

Nvidia Corporation is an American multinational technology company incorporated in Delaware and based in Santa Clara, California. It is a software and fabless company which designs graphics processing units (GPUs), application programming interface (APIs) for data science and high-performance computing as well as system on a chip units (SoCs) for the mobile computing and automotive market. Nvidia is a global leader in artificial intelligence hard- and software. Its professional line of GPUs are used in workstations for applications in such fields as architecture, engineering and construction, media and entertainment, automotive, scientific research, and manufacturing design.

<span class="mw-page-title-main">GeForce</span> Range of GPUs by Nvidia

GeForce is a brand of graphics processing units (GPUs) designed by Nvidia. As of the GeForce 40 series, there have been eighteen iterations of the design. The first GeForce products were discrete GPUs designed for add-on graphics boards, intended for the high-margin PC gaming market, and later diversification of the product line covered all tiers of the PC graphics market, ranging from cost-sensitive GPUs integrated on motherboards, to mainstream add-in retail boards. Most recently, GeForce technology has been introduced into Nvidia's line of embedded application processors, designed for electronic handhelds and mobile handsets.

<span class="mw-page-title-main">Graphics processing unit</span> Specialized electronic circuit; graphics accelerator

A graphics processing unit (GPU) is a specialized electronic circuit designed to manipulate and alter memory to accelerate the creation of images in a frame buffer intended for output to a display device. GPUs are used in embedded systems, mobile phones, personal computers, workstations, and game consoles.

General-purpose computing on graphics processing units is the use of a graphics processing unit (GPU), which typically handles computation only for computer graphics, to perform computation in applications traditionally handled by the central processing unit (CPU). The use of multiple video cards in one computer, or large numbers of graphics chips, further parallelizes the already parallel nature of graphics processing.

<span class="mw-page-title-main">PhysX</span> Realtime physics engine software

PhysX is an open-source realtime physics engine middleware SDK developed by Nvidia as a part of Nvidia GameWorks software suite.

<span class="mw-page-title-main">RSX Reality Synthesizer</span> GPU for the PlayStation 3

The RSX 'Reality Synthesizer' is a proprietary graphics processing unit (GPU) codeveloped by Nvidia and Sony for the PlayStation 3 game console. It is a GPU based on the Nvidia 7800GTX graphics processor and, according to Nvidia, is a G70/G71 hybrid architecture with some modifications. The RSX has separate vertex and pixel shader pipelines. The GPU makes use of 256 MB GDDR3 RAM clocked at 650 MHz with an effective transmission rate of 1.3 GHz and up to 224 MB of the 3.2 GHz XDR main memory via the CPU . Although it carries the majority of the graphics processing, the Cell Broadband Engine, the console's CPU, is also used complementarily for some graphics-related computational loads of the console.

CoreAVC was a proprietary codec for decoding the H.264/MPEG-4 AVC video format.

<span class="mw-page-title-main">CUDA</span> Parallel computing platform and programming model

CUDA is a parallel computing platform and application programming interface (API) that allows software to use certain types of graphics processing units (GPUs) for general purpose processing, an approach called general-purpose computing on GPUs (GPGPU). CUDA is a software layer that gives direct access to the GPU's virtual instruction set and parallel computational elements, for the execution of compute kernels.

<span class="mw-page-title-main">GeForce 9 series</span> Series of GPUs by Nvidia

The GeForce 9 series is the ninth generation of Nvidia's GeForce series of graphics processing units, the first of which was released on February 21, 2008. Products are based on a slightly repolished Tesla microarchitecture, adding PCIe 2.0 support, improved color and z-compression, and built on a 65 nm process, later using 55 nm process to reduce power consumption and die size.

<span class="mw-page-title-main">Tegra</span> System on a chip by Nvidia

Tegra is a system on a chip (SoC) series developed by Nvidia for mobile devices such as smartphones, personal digital assistants, and mobile Internet devices. The Tegra integrates an ARM architecture central processing unit (CPU), graphics processing unit (GPU), northbridge, southbridge, and memory controller onto one package. Early Tegra SoCs are designed as efficient multimedia processors. The Tegra-line evolved to emphasize performance for gaming and machine learning applications without sacrificing power efficiency, before taking a drastic shift in direction towards platforms that provide vehicular automation with the applied "Drive" brand name on reference boards and its semiconductors; and with the "Jetson" brand name for boards adequate for AI applications within e.g. robots or drones, and for various smart high level automation purposes.

Google Nexus is a discontinued line of consumer electronic devices that run the Android operating system. Google managed the design, development, marketing, and support of these devices, but some development and all manufacturing were carried out by partnering with original equipment manufacturers (OEMs). Alongside the main smartphone products, the line also included tablet computers and streaming media players; the Nexus started out in January 2010 and reached its end in October 2016, replaced by Google Pixel.

<span class="mw-page-title-main">GeForce 900 series</span> Series of GPUs by Nvidia

The GeForce 900 series is a family of graphics processing units developed by Nvidia, succeeding the GeForce 700 series and serving as the high-end introduction to the Maxwell microarchitecture, named after James Clerk Maxwell. They are produced with TSMC's 28 nm process.

<span class="mw-page-title-main">Maxwell (microarchitecture)</span> GPU microarchitecture by Nvidia

Maxwell is the codename for a GPU microarchitecture developed by Nvidia as the successor to the Kepler microarchitecture. The Maxwell architecture was introduced in later models of the GeForce 700 series and is also used in the GeForce 800M series, GeForce 900 series, and Quadro Mxxx series, as well as some Jetson products, all manufactured with TSMC's 28 nm process.

<span class="mw-page-title-main">Pascal (microarchitecture)</span> GPU microarchitecture by Nvidia

Pascal is the codename for a GPU microarchitecture developed by Nvidia, as the successor to the Maxwell architecture. The architecture was first introduced in April 2016 with the release of the Tesla P100 (GP100) on April 5, 2016, and is primarily used in the GeForce 10 series, starting with the GeForce GTX 1080 and GTX 1070, which were released on May 17, 2016 and June 10, 2016 respectively. Pascal was manufactured using TSMC's 16 nm FinFET process, and later Samsung's 14 nm FinFET process.

<span class="mw-page-title-main">Volta (microarchitecture)</span> GPU microarchitecture by Nvidia

Volta is the codename for a GPU microarchitecture developed by Nvidia, succeeding Pascal. It was first announced on a roadmap in March 2013, although the first product was not announced until May 2017. The architecture is named after 18th–19th century Italian chemist and physicist Alessandro Volta. It was NVIDIA's first chip to feature Tensor Cores, specially designed cores that have superior deep learning performance over regular CUDA cores. The architecture is produced with TSMC's 12 nm FinFET process. The Ampere microarchitecture is the successor to Volta.

<span class="mw-page-title-main">Radeon 300 series</span> Series of video cards

The Radeon 300 series is a series of graphics processors developed by AMD. All of the GPUs of the series are produced in 28 nm format and use the Graphics Core Next (GCN) micro-architecture.

Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.

<span class="mw-page-title-main">RenderDoc</span>

RenderDoc is a free and open source frame debugger that can be used to analyze single frames generated by other software programs such as games. RenderDoc can provide in-depth analysis of single frames from any application that uses Vulkan, D3D11, OpenGL & OpenGL ES, or D3D12. RenderDoc also allows the user to manipulate a captured frame to inspect different things such as pipeline stage, commands, texture maps, models, assets, and more. RenderDoc can also capture assets outside the view of the game's camera. RenderDoc supports analyzing frame rendering costs on the graphics processing unit.

References

  1. "RealityCapture". capturingreality.com.
  2. http://developer.download.nvidia.com/assets/gameworks/downloads/regular/GDC17/gdc-photogrammetry-pipelines-2017-03-01.pdf [ bare URL PDF ]
  3. "Capturing Reality releases RealityCapture - CG Channel". cgchannel.com. Retrieved 1 May 2017.
  4. 3DVF. "Photogrammétrie : le modèle économique de RealityCapture se précise - 3DVF.com". 3dvf.com (in French). Retrieved 1 May 2017.
  5. "RealityCapture - Disponible gratuitement jusqu'au 31 Janvier". 3d-station.fr (in French). 30 November 2015. Retrieved 1 May 2017.
  6. "RealityCapture: nyílt bétában a szlovák szomszédok szoftvere". meshmag.hu (in Slovak). 29 December 2015. Retrieved 1 May 2017.
  7. Fred (20 January 2016). "RealityCapture". helicomicro.com. Retrieved 1 May 2017.
  8. "Martin Bujnak - Google Scholar Citations". google.sk. Retrieved 1 May 2017.
  9. "Michal Jancosek - Google Scholar Citations". google.sk. Retrieved 1 May 2017.
  10. "Capturing Reality – spoločnosť budúcnosti zo Slovenska, ktorá ponúka softvér na modelovanie 3D objektov". startitup.sk (in Slovak). 3 August 2016. Retrieved 1 May 2017.
  11. Kerr, Chris (March 9, 2021). "Epic Games acquires photogrammetry software developer Capturing Reality". Gamasutra . Retrieved March 9, 2021.