Rendering (computer graphics)

Uses your system voice; voice and rate in settings.

Snapshot

≈ 14 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

3.6 Rendering is the process of generating an image from input data such as 3D models. The word "rendering" (in one of its senses) originally meant the task performed by an artist when depicting a real or imaginary thing (the finished artwork is also called a "rendering"). Today, to "render" commonly means to use a computer to generate an image from a precise specification, often created by an artist (or multiple artists) via interactive 3D modeling software. Types of images rendered include both still images and frames for films and video games. In a computer graphics context, in standard usage, the word "rendering" by itself means rendering 3D scenes, but it is sometimes used with a broader meaning. A modifier such as "2D" or "3D" is used when there is potential ambiguity (e.g. 3D rendering). A software application or component that performs rendering is called a rendering engine, render engine, rendering system, graphics engine, or simply a renderer. A distinction is made between real-time rendering, in which images are generated and displayed immediately (ideally fast enough to give the impression of motion or animation), and offline rendering (sometimes called pre-rendering) in which images or film frames, are generated for later viewing. Offline rendering can use a slower and higher-quality renderer.…

3.6 Rendering is the process of generating an image from input data such as 3D models. The word "rendering" (in one of its senses) originally meant the task performed by an artist when depicting a real or imaginary thing (the finished artwork is also called a "rendering"). Today, to "render" commonly means to use a computer to generate an image from a precise specification, often created by an artist (or multiple artists) via interactive 3D modeling software. Types of images rendered include both still images and frames for films and video games. In a computer graphics context, in standard usage, the word "rendering" by itself means rendering 3D scenes, but it is sometimes used with a broader meaning. A modifier such as "2D" or "3D" is used when there is potential ambiguity (e.g. 3D rendering). A software application or component that performs rendering is called a rendering engine, render engine, rendering system, graphics engine, or simply a renderer. A distinction is made between real-time rendering, in which images are generated and displayed immediately (ideally fast enough to give the impression of motion or animation), and offline rendering (sometimes called pre-rendering) in which images or film frames, are generated for later viewing. Offline rendering can use a slower and higher-quality renderer. Interactive applications such as games must primarily use real-time rendering, although they may incorporate pre-rendered content. Rendering produces images of scenes or objects defined using coordinates in 3D space, seen from a particular viewpoint. It uses knowledge and ideas from optics, the study of visual perception, mathematics, and software engineering, and it has applications such as video games, simulators, visual effects for films and television, design visualization, and medical diagnosis. Realistic rendering requires modeling the propagation of light in an environment, e.g. by applying the rendering equation. Real-time rendering uses high-performance rasterization algorithms that process a list of shapes and determine which pixels are covered by each shape. When more realism is required (e.g. for architectural visualization or visual effects) slower pixel-by-pixel algorithms such as ray tracing are used instead. (Ray tracing can also be used selectively during rasterized rendering to improve the realism of lighting and reflections.) A type of ray tracing called path tracing is currently the most common technique for photorealistic rendering. Path tracing is also popular for generating high-quality non-photorealistic images, such as frames for 3D animated films. Both rasterization and ray tracing can be sped up ("accelerated") by specially designed microprocessors called GPUs. Rasterization algorithms are also used to produce images containing only 2D shapes such as polygons and text. This type of rendering is sometimes called 2D rendering, and its applications include digital illustration, graphic design, 2D animation, desktop publishing and the display of user interfaces. Historically, rendering was called image synthesis but today this term is likely to mean AI image generation. The term "neural rendering" is sometimes used when a neural network is the primary means of generating an image but some degree of control over the output image is provided. Neural networks can also assist rendering without replacing traditional algorithms, e.g. by removing noise from path traced images.

Rasterization

from 2009, likely rendered using a combination of techniques The term rasterization (in a broad sense) encompasses many techniques used for 2D rendering and real-time 3D rendering. 3D animated films were rendered by rasterization before ray tracing and path tracing became practical. A renderer combines rasterization with geometry processing (which is not specific to rasterization) and pixel processing which computes the RGB color values to be placed in the framebuffer for display. The main tasks of rasterization (including pixel processing) are: Determining which pixels are covered by each geometric shape in the 3D scene or 2D image (this is the actual rasterization step, in the strictest sense) Blending between colors and depths defined at the vertices of shapes, e.g. using barycentric coordinates (interpolation) Determining if parts of shapes are hidden by other shapes, due to 2D layering or 3D depth (hidden surface removal) Evaluating a function for each pixel covered by a shape (shading) Smoothing edges of shapes so pixels are less visible (anti-aliasing) Blending overlapping transparent shapes (compositing) 3D rasterization is typically part of a graphics pipeline in which an application provides lists of triangles to be rendered, and the rendering system transforms and projects their coordinates, determines which triangles are potentially visible in the viewport, and performs the above rasterization and pixel processing tasks before displaying the final result on the screen. Historically, 3D rasterization used algorithms like the Warnock algorithm and scanline rendering (also called "scan-conversion"), which can handle arbitrary polygons and can rasterize many shapes simultaneously. Although such algorithms are still important for 2D rendering, 3D rendering now usually divides shapes into triangles and rasterizes them individually using simpler methods. High-performance algorithms exist for rasterizing 2D lines, including anti-aliased lines, as well as ellipses and filled triangles. An important special case of 2D rasterization is text rendering, which requires careful anti-aliasing and rounding of coordinates to avoid distorting the letterforms and preserve spacing, density, and sharpness. After 3D coordinates have been projected onto the image plane, rasterization is primarily a 2D problem, but the 3rd dimension necessitates hidden surface removal. Early computer graphics used geometric algorithms or ray casting to remove the hidden portions of shapes, or used the painter's algorithm, which sorts shapes by depth (distance from camera) and renders them from back to front. Depth sorting was later avoided by incorporating depth comparison into the scanline rendering algorithm. The z-buffer algorithm performs the comparisons indirectly by including a depth or "z" value in the framebuffer. A pixel is only covered by a shape if that shape's z value is lower (indicating closer to the camera) than the z value currently in the buffer. The z-buffer requires additional memory (an expensive resource at the time it was invented) but simplifies the rasterization code and permits multiple passes. Memory is now faster and more plentiful, and a z-buffer is almost always used for real-time rendering. A drawback of the basic z-buffer algorithm is that each pixel ends up either entirely covered by a single object or filled with the background color, causing jagged edges in the final image. Early anti-aliasing approaches addressed this by detecting when a pixel is partially covered by a shape, and calculating the covered area. The A-buffer (and other supersampling and multi-sampling techniques) solve the problem less precisely but with higher performance. For real-time 3D graphics, it has become common to use complicated heuristics (and even neural-networks) to perform anti-aliasing. In 3D rasterization, color is usually determined by a pixel shader or fragment shader, a small program that is run for each pixel. The shader does not (or cannot) directly access 3D data for the entire scene (this would be very slow, and would result in an algorithm similar to ray tracing) and a variety of techniques have been developed to render effects like shadows and reflections using only texture mapping and multiple passes. Older and more basic 3D rasterization implementations did not support shaders, and used simple shading techniques such as flat shading (lighting is computed once for each triangle, which is then rendered entirely in one color), Gouraud shading (lighting is computed using normal vectors defined at vertices and then colors are interpolated across each triangle), or Phong shading (normal vectors are interpolated across each triangle and lighting is computed for each pixel). Until relatively recently, Pixar used rasterization for rendering its animated films. Unlike the renderers commonly used for real-time graphics, the Reyes rendering system in Pixar's RenderMan software was optimized for rendering very small (pixel-sized) polygons, and incorporated stochastic sampling techniques more typically associated with ray tracing.

Machine learning

As of 2003, machine learning (ML) techniques were being used in other areas of computer graphics, such as texture synthesis, fitting surfaces to point clouds, and fitting curves to motion capture data. The use of ML for rendering expanded with the availability of GPUs that can evaluate neural networks (especially convolutional neural networks) quickly. Neural networks and Gaussian mixture models have been used in conjunction with rendering techniques such as path tracing to encode bidirectional reflectance distribution functions (BRDFs), or to encode cached radiance at points in space (for biased acceleration of rendering or for path guiding). Neural radiance fields (NeRFs) take the latter approach to an extreme, encoding radiance at all points in a volume, and using evaluation of this approximation as the primary rendering method. One of the most widely used applications of machine learning in rendering is denoising of path traced images (in practice, most path tracing now likely uses such a denoiser). Neural networks trained on pairs of noisy and low-noise images (or sometimes pairs of images with uncorrelated noise) can use data such as surface normal and albedo in addition to the rendered image, to reduce blurring or artifacts and preserve textures, and are effective at removing the scattered bright pixels called "fireflies" that frequently occur in path tracing. Denoisers specialized for real-time rendering can work with very low sample counts and improve temporal coherence to reduce flickering.

Hardware acceleration

Rendering is usually limited by available computing power and memory bandwidth, and so specialized hardware has been developed to speed it up ("accelerate" it), particularly for real-time rendering. Hardware features such as a framebuffer for raster graphics are required to display the output of rendering smoothly in real time. Hardware acceleration does not replace the use of software for rendering, rather it speeds up selected operations or calculations using dedicated circuits, or runs portions of the software's code on a different type of processor.

Hardware and software rendering

Historically, the term hardware rendering (possibly an abbreviation of "hardware accelerated rendering" or "hardware-assisted rendering") was sometimes used to mean rendering using a hardware-accelerated rasterization pipeline (typically for real-time rendering). In contrast, software rendering meant offline rendering using software that was not limited by the capabilities of graphics hardware, and could use more realistic and higher quality techniques. Both hardware and software have evolved, and although these terms are still used, their meaning may now be context-dependent. When OpenGL and Direct3D were introduced in the 1990s, there was a need to use these APIs on computers that did not have hardware acceleration for 3D graphics. "Fallback" rendering implementations were provided that did not require special hardware, and these are sometimes called "software renderers" (today hardware acceleration is almost always available, and these CPU-only implementations are used primarily for testing). More recently, "software rendering" may also mean rendering that does not use graphics APIs such as OpenGL, Metal, Direct3D, or Vulkan. Types of renderers that in the past might have been called "software renderers" (e.g. path tracing renderers used for offline rendering for movies) now commonly use GPU acceleration, often via APIs such as CUDA or OpenCL, which are not graphics-specific. Since these latter APIs allow running C++ code on a GPU, it is now possible to run the same rendering code on either a CPU or GPU.

Chronology of algorithms and techniques

The following is a rough timeline of frequently mentioned rendering techniques, including areas of current research. Note that even in cases where an idea was named in a specific paper, there were almost always multiple researchers or teams working in the same area (including earlier related work). When a method is first proposed it is often very inefficient, and it takes additional research and practical efforts to turn it into a useful technique. The list focuses on academic research and does not include hardware. (For more history see #External links, as well as Computer graphics#History and Golden age of arcade video games#Technology.) 1760 – Lambertian reflectance model 1931 – Standardized RGB representation of color 1967 – Torrance-Sparrow reflectance model 1968 – Ray casting 1968 – Warnock hidden surface removal 1970 – Scanline rendering 1971 – Gouraud shading 1973 – Phong shading 1973 – Phong reflectance model 1974 – Texture mapping 1974 – Z-buffering 1976 – Environment mapping 1977 – Blinn–Phong reflectance model 1977 – Shadow volumes 1978 – Shadow mapping 1978 – Bump mapping 1980 – BSP trees 1980 – Ray tracing 1981 – Cook-Torrance reflectance model 1983 – MIP maps 1984 – Octree ray tracing 1984 – Alpha compositing 1984 – Distributed ray tracing 1984 – Radiosity (method for non-trivial scenes in 1985) 1984 – A-buffer 1985 – Hemicube radiosity 1986 – Light source tracing 1986 – Rendering equation 1986 – Path tracing 1987 – Reyes rendering 1988 – Irradiance caching 1991 – Xiaolin Wu line anti-aliasing 1991 – Hierarchical radiosity 1993 – Oren–Nayar reflectance model 1993 – Tone mapping 1993 – Subsurface scattering 1993 – Bidirectional path tracing (Lafortune & Willems formulation) 1994 – Ambient occlusion 1995 – Photon mapping 1995 – Multiple importance sampling 1997 – Bidirectional path tracing (Veach & Guibas formulation) 1997 – Metropolis light transport 1997 – Instant Radiosity 2002 – Precomputed Radiance Transfer 2002 – Primary sample space Metropolis light transport 2003 – MERL BRDF database 2005 – Lightcuts 2005 – Radiance caching 2009 – Stochastic progressive photon mapping (SPPM) 2012 – Vertex connection and merging (VCM) (also called unified path sampling) 2012 – Manifold exploration 2013 – Gradient-domain rendering 2014 – Multiplexed Metropolis light transport 2014 – Differentiable rendering 2015 – Manifold next event estimation (MNEE) 2017 – Path guiding (using adaptive SD-tree) 2020 – Spatiotemporal reservoir resampling (ReSTIR) 2020 – Neural radiance fields 2023 – 3D Gaussian splatting

Text derived from https://en.wikipedia.org/w/index.php?oldid=1378375091 under CC BY-SA 4.0; modifications have been made.

Provenance

snapshot enwiki-001378375091 · captured 1791082846.0 · version history

Cite this page as: encyclopegia.org, “Rendering (computer graphics)”, snapshot enwiki-001378375091. https://encyclopegia.org/a/rendering-computer-graphics

Sources cited in this revision

26 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.