RealityCapture

Last updated
RealityCapture
Developer(s) Capturing Reality
Initial release2016 (2016)
Operating system Microsoft Windows
Available inEnglish
Type 3D computer graphics software
License Proprietary
Website www.capturingreality.com

RealityCapture (RC) is photogrammetry software for creating 3D models out of unordered photographs (terrestrial and/or aerial) or laser scans without seams. The most common fields of its current use are cultural heritage (art, archaeology, and architecture), full body scanning, gaming, surveying, mapping, visual effects (VFX) and virtual reality (VR) in general.

Contents

It features include image registration (alignment), automatic calibration, calculating a polygon mesh, colouring, texturing, parallel projections, georeferencing, DSM, coordinate system conversion, simplification, scaling, filtration, smoothing, measurement, inspection, and various exports and imports. [1] The program can be run under the command line. There is also a software developer kit available. [2] RealityCapture is able to mix camera images and laser scans. It is designed to make low demands on hardware. It works linearly, which means if its inputs are doubled, the processing time will be doubled as well. The software is currently available only in English language.

Technical requirements

RealityCapture runs on 64-bit machines with at least 8GB of RAM, 64bit Microsoft Windows 7 / 8 / 8.1 / 10, using a graphics card with an nVidia CUDA 2.0+ GPU and at least 1 GB of RAM. Users can run the application and register images without the nVidia card but will not be able to create a textured mesh. Users must install the Media Feature Pack for Windows, and on Windows Server users must install Media Foundation features.

Each RC software license is limited to 32 CPU cores and 3 GPU cards. For higher configurations, more licenses must be purchased equivalently. A computer with 4 CPU cores, 16 GB RAM and 386 CUDA cores is recommended.

Meshing, coloring and texturing are completely out-of-core in RC, which is intended to avoid RAM performance loss during these processes.

History

The public beta version of RealityCapture was released by Slovak company Capturing Reality (founded in 2013), based in Bratislava, on 2 February 2016. [3] However, there had also been a closed beta running for almost a year. [4] [5] [6] [7]

Staff of Capturing Reality have published in several computer vision and graphics journals and conference papers, and have had hundreds of citations. [8] [9] [10]

Capturing Reality was acquired by Epic Games in March 2021; Epic plans to integrate RealityCapture into the Unreal Engine with the acquisition. The acquisition does not affect Capturing Reality's existing business and allowed them to reduce their pricing model for RealityCapture. [11]

In late April 2024, Epic Games adjusted pricing allowing for developers making less than $1 million in gross revenue to use it for free, including students. [12]

Related Research Articles

<span class="mw-page-title-main">GeForce</span> Brand of GPUs by Nvidia

GeForce is a brand of graphics processing units (GPUs) designed by Nvidia and marketed for the performance market. As of the GeForce 40 series, there have been eighteen iterations of the design. The first GeForce products were discrete GPUs designed for add-on graphics boards, intended for the high-margin PC gaming market, and later diversification of the product line covered all tiers of the PC graphics market, ranging from cost-sensitive GPUs integrated on motherboards, to mainstream add-in retail boards. Most recently, GeForce technology has been introduced into Nvidia's line of embedded application processors, designed for electronic handhelds and mobile handsets.

A game engine is a software framework primarily designed for the development of video games and generally includes relevant libraries and support programs such as a level editor. The "engine" terminology is akin to the term "software engine" used more widely in the software industry.

<span class="mw-page-title-main">Graphics processing unit</span> Specialized electronic circuit; graphics accelerator

A graphics processing unit (GPU) is a specialized electronic circuit initially designed to accelerate computer graphics and image processing. After their initial design, GPUs were found to be useful for non-graphic calculations involving embarrassingly parallel problems due to their parallel structure. Other non-graphical uses include the training of neural networks and cryptocurrency mining.

<span class="mw-page-title-main">Unreal Engine</span> Video game engine developed by Epic Games

Unreal Engine (UE) is a series of 3D computer graphics game engines developed by Epic Games, first showcased in the 1998 first-person shooter video game Unreal. Initially developed for PC first-person shooters, it has since been used in a variety of genres of games and has been adopted by other industries, most notably the film and television industry. Unreal Engine is written in C++ and features a high degree of portability, supporting a wide range of desktop, mobile, console, and virtual reality platforms.

<span class="mw-page-title-main">Epic Games</span> American video game company

Epic Games, Inc. is an American video game and software developer and publisher based in Cary, North Carolina. The company was founded by Tim Sweeney as Potomac Computer Systems in 1991, originally located in his parents' house in Potomac, Maryland. Following its first commercial video game release, ZZT (1991), the company became Epic MegaGames, Inc. in early 1992 and brought on Mark Rein, who has been its vice president since. After moving the headquarters to Cary in 1999, the studio changed its name to Epic Games.

General-purpose computing on graphics processing units is the use of a graphics processing unit (GPU), which typically handles computation only for computer graphics, to perform computation in applications traditionally handled by the central processing unit (CPU). The use of multiple video cards in one computer, or large numbers of graphics chips, further parallelizes the already parallel nature of graphics processing.

<span class="mw-page-title-main">PhysX</span> Realtime physics engine software

PhysX is an open-source realtime physics engine middleware SDK developed by Nvidia as a part of Nvidia GameWorks software suite.

<span class="mw-page-title-main">Free and open-source graphics device driver</span> Software that controls computer-graphics hardware

A free and open-source graphics device driver is a software stack which controls computer-graphics hardware and supports graphics-rendering application programming interfaces (APIs) and is released under a free and open-source software license. Graphics device drivers are written for specific hardware to work within a specific operating system kernel and to support a range of APIs used by applications to access the graphics hardware. They may also control output to the display if the display driver is part of the graphics hardware. Most free and open-source graphics device drivers are developed by the Mesa project. The driver is made up of a compiler, a rendering API, and software which manages access to the graphics hardware.

<span class="mw-page-title-main">3D scanning</span> Scanning of an object or environment to collect data on its shape

3D scanning is the process of analyzing a real-world object or environment to collect three dimensional data of its shape and possibly its appearance. The collected data can then be used to construct digital 3D models.

<span class="mw-page-title-main">CUDA</span> Parallel computing platform and programming model

Compute Unified Device Architecture (CUDA) is a proprietary parallel computing platform and application programming interface (API) that allows software to use certain types of graphics processing units (GPUs) for accelerated general-purpose processing, an approach called general-purpose computing on GPUs (GPGPU). CUDA API and its runtime: The CUDA API is an extension of the C programming language that adds the ability to specify thread-level parallelism in C and also to specify GPU device specific operations (like moving data between the CPU and the GPU). CUDA is a software layer that gives direct access to the GPU's virtual instruction set and parallel computational elements for the execution of compute kernels. In addition to drivers and runtime kernels, the CUDA platform includes compilers, libraries and developer tools to help programmers accelerate their applications.

<span class="mw-page-title-main">Larrabee (microarchitecture)</span> Canceled Intel GPGPU chip

Larrabee is the codename for a cancelled GPGPU chip that Intel was developing separately from its current line of integrated graphics accelerators. It is named after either Mount Larrabee or Larrabee State Park in Whatcom County, Washington, near the town of Bellingham. The chip was to be released in 2010 as the core of a consumer 3D graphics card, but these plans were cancelled due to delays and disappointing early performance figures. The project to produce a GPU retail product directly from the Larrabee research project was terminated in May 2010 and its technology was passed on to the Xeon Phi. The Intel MIC multiprocessor architecture announced in 2010 inherited many design elements from the Larrabee project, but does not function as a graphics processing unit; the product is intended as a co-processor for high performance computing.

Simplygon is 3D computer graphics software for automatic 3D optimization, based on proprietary methods for creating levels of detail (LODs) through Polygon mesh reduction and other optimization techniques.

<span class="mw-page-title-main">3D modeling</span> Form of computer-aided engineering

In 3D computer graphics, 3D modeling is the process of developing a mathematical coordinate-based representation of a surface of an object in three dimensions via specialized software by manipulating edges, vertices, and polygons in a simulated 3D space.

RenderScript is a deprecated component of the Android operating system for mobile devices that offers an API for acceleration that takes advantage of heterogeneous hardware. It allows developers to increase the performance of their applications at the cost of writing more complex (lower-level) code.

<span class="mw-page-title-main">Digital outcrop model</span> Digital 3D representation of the outcrop surface

A digital outcrop model (DOM), also called a virtual outcrop model, is a digital 3D representation of the outcrop surface, mostly in a form of textured polygon mesh.

Heterogeneous System Architecture (HSA) is a cross-vendor set of specifications that allow for the integration of central processing units and graphics processors on the same bus, with shared memory and tasks. The HSA is being developed by the HSA Foundation, which includes AMD and ARM. The platform's stated aim is to reduce communication latency between CPUs, GPUs and other compute devices, and make these various devices more compatible from a programmer's perspective, relieving the programmer of the task of planning the moving of data between devices' disjoint memories.

Stage3D is an Adobe Flash Player API for rendering interactive 3D graphics with GPU-acceleration, within Flash games and applications. Flash Player or AIR applications written in ActionScript 3 may use Stage3D to render 3D graphics, and such applications run natively on Windows, Mac OS X, Linux, Apple iOS and Google Android. Stage3D is similar in purpose and design to WebGL.

<span class="mw-page-title-main">Metal (API)</span> iOS, macOS, and tvOS graphics rendering API

Metal is a low-level, low-overhead hardware-accelerated 3D graphic and compute shader API created by Apple, debuting in iOS 8. Metal combines functions similar to OpenGL and OpenCL in one API. It is intended to improve performance by offering low-level access to the GPU hardware for apps on iOS, iPadOS, macOS, and tvOS. It can be compared to low-level APIs on other platforms such as Vulkan and DirectX 12.

Agisoft Metashape is a tool for a photogrammetry pipeline. The software is available in Standard and Pro versions, the standard version is sufficient for interactive media tasks, while the Pro version is designed for authoring GIS content. The software is developed by Agisoft LLC located in St. Petersburg in Russia.

OpenDroneMap is an open source photogrammetry toolkit to process aerial imagery into maps and 3D models. The software is hosted and distributed freely on GitHub.

References

  1. "RealityCapture". capturingreality.com.
  2. http://developer.download.nvidia.com/assets/gameworks/downloads/regular/GDC17/gdc-photogrammetry-pipelines-2017-03-01.pdf [ bare URL PDF ]
  3. "Capturing Reality releases RealityCapture - CG Channel". cgchannel.com. Retrieved 1 May 2017.
  4. 3DVF (2 February 2016). "Photogrammétrie : le modèle économique de RealityCapture se précise - 3DVF.com". 3dvf.com (in French). Retrieved 1 May 2017.{{cite web}}: CS1 maint: numeric names: authors list (link)
  5. "RealityCapture - Disponible gratuitement jusqu'au 31 Janvier". 3d-station.fr (in French). 30 November 2015. Retrieved 1 May 2017.
  6. "RealityCapture: nyílt bétában a szlovák szomszédok szoftvere". meshmag.hu (in Slovak). 29 December 2015. Retrieved 1 May 2017.
  7. Fred (20 January 2016). "RealityCapture". helicomicro.com. Retrieved 1 May 2017.
  8. "Martin Bujnak - Google Scholar Citations". google.sk. Retrieved 1 May 2017.
  9. "Michal Jancosek - Google Scholar Citations". google.sk. Retrieved 1 May 2017.
  10. "Capturing Reality – spoločnosť budúcnosti zo Slovenska, ktorá ponúka softvér na modelovanie 3D objektov". startitup.sk (in Slovak). 3 August 2016. Retrieved 1 May 2017.
  11. Kerr, Chris (March 9, 2021). "Epic Games acquires photogrammetry software developer Capturing Reality". Gamasutra . Retrieved March 9, 2021.
  12. Porter, Jon (2024-03-12). "Epic details new Unreal Engine pricing plan for non-game developers". The Verge. Retrieved 2024-05-04.