RealityCapture

Last updated
RealityCapture
Developer(s) Capturing Reality
Initial release2016 (2016)
Operating system Microsoft Windows
Available inEnglish
Type 3D computer graphics software
License Proprietary
Website www.capturingreality.com

RealityCapture (RC) is photogrammetry software for creating 3D models out of unordered photographs (terrestrial and/or aerial) or laser scans without seams. The most common fields of its current use are cultural heritage (art, archaeology, and architecture), full body scanning, gaming, surveying, mapping, visual effects (VFX) and virtual reality (VR) in general.

Contents

It features include image registration (alignment), automatic calibration, calculating a polygon mesh, colouring, texturing, parallel projections, georeferencing, DSM, coordinate system conversion, simplification, scaling, filtration, smoothing, measurement, inspection, and various exports and imports. [1] The program can be run under the command line. There is also a software developer kit available. [2] RealityCapture is able to mix camera images and laser scans. It is designed to make low demands on hardware. It works linearly, which means if its inputs are doubled, the processing time will be doubled as well. The software is currently available only in English language.

Technical requirements

RealityCapture runs on 64-bit machines with at least 8GB of RAM, 64bit Microsoft Windows 7 / 8 / 8.1 / 10, using a graphics card with an Nvidia CUDA 2.0+ GPU and at least 1 GB of RAM. Users can run the application and register images without the Nvidia card but will not be able to create a textured mesh. Users must install the Media Feature Pack for Windows, and on Windows Server users must install Media Foundation features.

Each RC software license is limited to 32 CPU cores and 3 GPU cards. For higher configurations, more licenses must be purchased equivalently. A computer with 4 CPU cores, 16 GB RAM and 386 CUDA cores is recommended.

Meshing, coloring and texturing are completely out-of-core in RC, which is intended to avoid RAM performance loss during these processes.

History

The public beta version of RealityCapture was released by Slovak company Capturing Reality (founded in 2013), based in Bratislava, on 2 February 2016. [3] However, there had also been a closed beta running for almost a year. [4] [5] [6] [7]

Staff of Capturing Reality have published in several computer vision and graphics journals and conference papers, and have had hundreds of citations. [8] [9] [10]

Capturing Reality was acquired by Epic Games in March 2021; Epic plans to integrate RealityCapture into the Unreal Engine with the acquisition. The acquisition does not affect Capturing Reality's existing business and allowed them to reduce their pricing model for RealityCapture. [11]

In late April 2024, Epic Games adjusted pricing allowing for developers making less than $1 million in gross revenue to use it for free, including students. [12]

Related Research Articles

<span class="mw-page-title-main">GeForce</span> Brand of GPUs by Nvidia

GeForce is a brand of graphics processing units (GPUs) designed by Nvidia and marketed for the performance market. As of the GeForce 40 series, there have been eighteen iterations of the design. The first GeForce products were discrete GPUs designed for add-on graphics boards, intended for the high-margin PC gaming market, and later diversification of the product line covered all tiers of the PC graphics market, ranging from cost-sensitive GPUs integrated on motherboards, to mainstream add-in retail boards. Most recently, GeForce technology has been introduced into Nvidia's line of embedded application processors, designed for electronic handhelds and mobile handsets.

<span class="mw-page-title-main">Graphics processing unit</span> Specialized electronic circuit; graphics accelerator

A graphics processing unit (GPU) is a specialized electronic circuit initially designed to accelerate computer graphics and image processing. After their initial design, GPUs were found to be useful for non-graphic calculations involving embarrassingly parallel problems due to their parallel structure. Other non-graphical uses include the training of neural networks and cryptocurrency mining.

<span class="mw-page-title-main">Shader</span> Type of program in a graphical processing unit (GPU)

In computer graphics, a shader is a computer program that calculates the appropriate levels of light, darkness, and color during the rendering of a 3D scene—a process known as shading. Shaders have evolved to perform a variety of specialized functions in computer graphics special effects and video post-processing, as well as general-purpose computing on graphics processing units.

General-purpose computing on graphics processing units is the use of a graphics processing unit (GPU), which typically handles computation only for computer graphics, to perform computation in applications traditionally handled by the central processing unit (CPU). The use of multiple video cards in one computer, or large numbers of graphics chips, further parallelizes the already parallel nature of graphics processing.

<span class="mw-page-title-main">PhysX</span> Realtime physics engine software

PhysX is an open-source realtime physics engine middleware SDK developed by Nvidia as a part of Nvidia GameWorks software suite.

<span class="mw-page-title-main">Free and open-source graphics device driver</span> Software that controls computer-graphics hardware

A free and open-source graphics device driver is a software stack which controls computer-graphics hardware and supports graphics-rendering application programming interfaces (APIs) and is released under a free and open-source software license. Graphics device drivers are written for specific hardware to work within a specific operating system kernel and to support a range of APIs used by applications to access the graphics hardware. They may also control output to the display if the display driver is part of the graphics hardware. Most free and open-source graphics device drivers are developed by the Mesa project. The driver is made up of a compiler, a rendering API, and software which manages access to the graphics hardware.

CoreAVC was a proprietary codec for decoding the H.264/MPEG-4 AVC video format.

<span class="mw-page-title-main">CUDA</span> Parallel computing platform and programming model

In computing, CUDA is a proprietary parallel computing platform and application programming interface (API) that allows software to use certain types of graphics processing units (GPUs) for accelerated general-purpose processing, an approach called general-purpose computing on GPUs (GPGPU). CUDA API and its runtime: The CUDA API is an extension of the C programming language that adds the ability to specify thread-level parallelism in C and also to specify GPU device specific operations. CUDA is a software layer that gives direct access to the GPU's virtual instruction set and parallel computational elements for the execution of compute kernels. In addition to drivers and runtime kernels, the CUDA platform includes compilers, libraries and developer tools to help programmers accelerate their applications.

<span class="mw-page-title-main">Larrabee (microarchitecture)</span> Canceled Intel GPGPU chip

Larrabee is the codename for a cancelled GPGPU chip that Intel was developing separately from its current line of integrated graphics accelerators. It is named after either Mount Larrabee or Larrabee State Park in Whatcom County, Washington, United States, near the town of Bellingham. The chip was to be released in 2010 as the core of a consumer 3D graphics card, but these plans were cancelled due to delays and disappointing early performance figures. The project to produce a GPU retail product directly from the Larrabee research project was terminated in May 2010 and its technology was passed on to the Xeon Phi. The Intel MIC multiprocessor architecture announced in 2010 inherited many design elements from the Larrabee project, but does not function as a graphics processing unit; the product is intended as a co-processor for high performance computing.

AMD FireStream was AMD's brand name for their Radeon-based product line targeting stream processing and/or GPGPU in supercomputers. Originally developed by ATI Technologies around the Radeon X1900 XTX in 2006, the product line was previously branded as both ATI FireSTREAM and AMD Stream Processor. The AMD FireStream can also be used as a floating-point co-processor for offloading CPU calculations, which is part of the Torrenza initiative. The FireStream line has been discontinued since 2012, when GPGPU workloads were entirely folded into the AMD FirePro line.

<span class="mw-page-title-main">Tegra</span> System on a chip by Nvidia

Tegra is a system on a chip (SoC) series developed by Nvidia for mobile devices such as smartphones, personal digital assistants, and mobile Internet devices. The Tegra integrates an ARM architecture central processing unit (CPU), graphics processing unit (GPU), northbridge, southbridge, and memory controller onto one package. Early Tegra SoCs are designed as efficient multimedia processors. The Tegra-line evolved to emphasize performance for gaming and machine learning applications without sacrificing power efficiency, before taking a drastic shift in direction towards platforms that provide vehicular automation with the applied "Nvidia Drive" brand name on reference boards and its semiconductors; and with the "Nvidia Jetson" brand name for boards adequate for AI applications within e.g. robots or drones, and for various smart high level automation purposes.

Nvidia CUDA Compiler (NVCC) is a proprietary compiler by Nvidia intended for use with CUDA.

<span class="mw-page-title-main">Kepler (microarchitecture)</span> GPU microarchitecture by Nvidia

Kepler is the codename for a GPU microarchitecture developed by Nvidia, first introduced at retail in April 2012, as the successor to the Fermi microarchitecture. Kepler was Nvidia's first microarchitecture to focus on energy efficiency. Most GeForce 600 series, most GeForce 700 series, and some GeForce 800M series GPUs were based on Kepler, all manufactured in 28 nm. Kepler found use in the GK20A, the GPU component of the Tegra K1 SoC, and in the Quadro Kxxx series, the Quadro NVS 510, and Tesla computing modules.

<span class="mw-page-title-main">Maxwell (microarchitecture)</span> GPU microarchitecture by Nvidia

Maxwell is the codename for a GPU microarchitecture developed by Nvidia as the successor to the Kepler microarchitecture. The Maxwell architecture was introduced in later models of the GeForce 700 series and is also used in the GeForce 800M series, GeForce 900 series, and Quadro Mxxx series, as well as some Jetson products.

<span class="mw-page-title-main">Volta (microarchitecture)</span> GPU microarchitecture by Nvidia

Volta is the codename, but not the trademark, for a GPU microarchitecture developed by Nvidia, succeeding Pascal. It was first announced on a roadmap in March 2013, although the first product was not announced until May 2017. The architecture is named after 18th–19th century Italian chemist and physicist Alessandro Volta. It was Nvidia's first chip to feature Tensor Cores, specially designed cores that have superior deep learning performance over regular CUDA cores. The architecture is produced with TSMC's 12 nm FinFET process. The Ampere microarchitecture is the successor to Volta.

Stage3D is an Adobe Flash Player API for rendering interactive 3D graphics with GPU-acceleration, within Flash games and applications. Flash Player or AIR applications written in ActionScript 3 may use Stage3D to render 3D graphics, and such applications run natively on Windows, Mac OS X, Linux, Apple iOS and Google Android. Stage3D is similar in purpose and design to WebGL.

Nvidia NVENC is a feature in Nvidia graphics cards that performs video encoding, offloading this compute-intensive task from the CPU to a dedicated part of the GPU. It was introduced with the Kepler-based GeForce 600 series in March 2012.

Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.

Nvidia GTC is a global artificial intelligence (AI) conference for developers that brings together developers, engineers, researchers, inventors, and IT professionals. Topics focus on AI, computer graphics, data science, machine learning and autonomous machines. Each conference begins with a keynote from Nvidia CEO and founder Jensen Huang, followed by a variety of sessions and talks with experts from around the world.

References

  1. "RealityCapture". capturingreality.com.
  2. Photogrammetry for Games. nvidia.com, Retrieved 28 June 2024
  3. "Capturing Reality releases RealityCapture - CG Channel". cgchannel.com. Retrieved 1 May 2017.
  4. "Photogrammétrie : le modèle économique de RealityCapture se précise - 3DVF.com". 3dvf.com (in French). 2 February 2016. Retrieved 1 May 2017.
  5. "RealityCapture - Disponible gratuitement jusqu'au 31 Janvier". 3d-station.fr (in French). 30 November 2015. Retrieved 1 May 2017.
  6. "RealityCapture: nyílt bétában a szlovák szomszédok szoftvere". meshmag.hu (in Slovak). 29 December 2015. Retrieved 1 May 2017.
  7. Fred (20 January 2016). "RealityCapture". helicomicro.com. Retrieved 1 May 2017.
  8. "Martin Bujnak - Google Scholar Citations". google.sk. Retrieved 1 May 2017.
  9. "Michal Jancosek - Google Scholar Citations". google.sk. Retrieved 1 May 2017.
  10. "Capturing Reality – spoločnosť budúcnosti zo Slovenska, ktorá ponúka softvér na modelovanie 3D objektov". startitup.sk (in Slovak). 3 August 2016. Retrieved 1 May 2017.
  11. Kerr, Chris (March 9, 2021). "Epic Games acquires photogrammetry software developer Capturing Reality". Gamasutra . Retrieved March 9, 2021.
  12. Porter, Jon (2024-03-12). "Epic details new Unreal Engine pricing plan for non-game developers". The Verge. Retrieved 2024-05-04.