Received 1 March 2016; accepted 26 March 2016; published 29 March 2016

ABSTRACT

Since the 1980s, various techniques have been used in the field of medicine for the post-proces- sing of medical imaging data from computed tomography (CT) and magnetic resonance (MR). They include multiplanar reformations (MPR), maximum intensity projection (MIP) and Volume Rendering (VR). This paper presents the prototype of a new means of post-processing radiological examinations such as CT and MR, a technique that, for the first time, provides photorealistic visualizations of the human body. This new procedure was inspired by the quality of images achieved by animation software such as programs used in the entertainment industry, particularly to produce animated films. Thus, the name: Cinematic Rendering. It is already foreseeable that this new method of depiction will quickly be incorporated into the set of instruments employed in so-called virtual anatomy (teaching anatomy through the use of radiological depictions of the human body via X-ray, CT and MR in addition to the use of computer animation programs designed especially for human anatomy). Its potential for medical applications will have to be evaluated by future scientific investigations.

Keywords:

Cinematic Rendering, Volume Rendering, Virtual Anatomy, Computed Tomography (CT), Magnetic Resonance (MR)

1. Introduction

In the field of radiology, various methods are employed for the post-processing of the results of imaging procedures such as computed tomography (CT) and magnetic resonance (MR) imaging data sets: multiplanar reformations (MPR), maximum intensity projection (MIP) and Volume Rendering (VR).

During a maximum intensity projection, rays are cast through the 3-D image data volumes and the respective data point with the maximum intensity along the direction of viewing (projection direction) is selected and depicted. Areas of application of MIP include depictions of blood vessels―i.e. CT and MR angiography data sets. MIP was originally developed for clinical use in the field of nuclear medicine; accordingly, the first version was named maximum activity projection (MAP) [1] .

The earliest implementation of a Volume Rendering technique was the outcome of research conducted at the Mayo Clinic in the 1970s [2] . In the mid-80s, advances in image processing hardware and the integration of new data manipulation techniques led to the simultaneous development of Volume Rendering at the University of North Carolina [3] and at Pixar in San Rafael [4] , whereby the latter had originally been an upshot of work by computer specialists in the Computer Graphics Group at Lucasfilm [2] . The work at Pixar culminated in collaboration with the CT research group at Johns Hopkins Hospital [5] [6] . Today, Volume Rendering is an established post-processing technique for 3-D CT and MR data sets, one used routinely in clinical practice.

To do so-called Cinematic Rendering, engineers developed a software prototype that can generate photorealistic depictions of the human body from CT and MR data sets and achieve results that far surpass those of previously available post-processing methods (such as Maximum Intensity Projection, Surface Shaded Display or Volume Rendering). In recognition of the fact that this technique was inspired by the quality of computer animation programs such as those utilized in the entertainment industry and especially to produce big-screen films, the developers named it Cinematic Rendering.

2. The Software

Siemens Healthcare, Medical Imaging Technologies, Princeton, USA recently developed a prototype of new image processing software for radiological data sets that they call Cinematic Rendering. At our institute, we have installed this software on a workstation for scientific purposes (syngo.via Frontier). This new technique delivers a considerably more photorealistic depiction of CT and MR data sets than was possible heretofore with Volume Rendering. Whereas in the case of Volume Rendering, simple ray casting [7] - [9] is performed to compute the images, Cinematic Rendering takes into account the complex interaction of photons with the human anatomy and thus generates highly photorealistic images with an unprecedented degree of realism (Figure 1). The use of clip planes makes it possible―just as in the case of Volume Rendering―to cut into the volume.

Conventional Volume Rendering techniques employ predefined color, turbidity and brightness values, whereby they proceed under the assumption of an artificial light source. Cinematic Rendering performs a physical simulation of the light diffusion, as a result of which effects such as environmental influences, shadowing, refraction, occlusion, dispersion and soft shadows attain a high dynamic range. To achieve this, a so-called spherical panorama is recorded―for example, with a reflecting ball―which registers the actual lighting conditions in

order to apply them to all synthetic elements added later. In comparison to simple ray casting based Volume Rendering, Cinematic Rendering is based on the Monte-Carlo path tracing of volumetric data [10] - [12] . These and other techniques such as variable aperture width and motion blur are also utilized in the film industry. Accordingly, Cinematic Rendering was the name chosen for this new technique.

3. Discussion

Cinematic Rendering makes it possible to achieve higher quality three-dimensional depiction of CT and MR data sets. Due to the considerably more elaborate and thus truer-to-life simulation of the paths of light rays as employed in the animation industry, this new technique produces photorealistic images the likes of which were impossible before with Volume Rendering. Figure 2 shows two visualizations of the musculature of the thorax and abdomen derived from the same CT data set: one with Volume Rendering (a), and the other with Cinematic Rendering (b).

Anatomical structures other than the musculature (e.g. soft tissue, cartilage, bones and blood vessels) are also depicted much more photo-realistically with Cinematic Rendering than was previously possible with Volume Rendering (Figure 3).

Figure 3 is a comparative depiction of Volume Rendering (a) and Cinematic Rendering (b). Both display bony structures and blood vessels, as well as the kidneys that also show up due to the extent of the blood flow to them. Here too, the greater photorealism of Cinematic Rendering delivers a substantially better depiction of the above-named structures than Volume Rendering does.

In the Volume Rendering image, a thoracic aorta graft is hardly recognizable, whereas it is very easy to make out in the depiction produced by Cinematic Rendering (arrow in Figure 3).

It is already obvious that this new technique that delivers photorealistic depictions of the human anatomy will launch a quantum leap in quality in so-called virtual anatomy, as shown below in Figure 4.

For several years now, anatomy instruction has made use of, in addition to conventional teaching involving human cadavers, radiological scans (as obtained with x-ray, computed tomography, magnetic resonance, catheter angiography) as well as images produced by computer animation software packages specifically programmed

for human anatomy that are already commercially available.

These teaching methods are referred to as virtual anatomy to differentiate them from so-called classical anatomy instruction utilizing human cadavers.

The extent to which there emerge new aspects conducive to further potential applications in the field of medicine will have to be evaluated by scientific investigations performed over the next few years.

It would seem to be feasible to apply Cinematic Rendering in the musculoskeletal sector (maxillofacial surgery, trauma surgery, orthopedic medicine) for preoperative three-dimensional examination of fractures and malpositions. This new form of three-dimensional depiction could also be of interest in other surgical disciplines such as abdominal surgery, vascular surgery, gynecology and urology (Figure 5).

As is also the case with the various Volume Rendering programs for medical applications, this Cinematic Rendering prototype features diverse templates with various color combinations and illumination options.

Templates that visualize bones especially well were used for Figure 1. The templates that were used for Figure 2, Figure 4 and Figure 5 are particularly well-suited for the depiction of soft tissue. To generate Figure 3, a palette was used that produces high contrasts and thus does an outstanding job visualizing bones as well as blood vessels filled with a contrast medium.

Already now we use routinely Cinematic Rendering for teaching human anatomy on the base of CT and MR 3D data sets (virtual anatomy), because Cinematic Rendering is able to create photorealistic depictions of the human body from CT and MR data sets achieving results that far surpass those of previously available post-processing methods, such as Maximum Intensity Projection or Volume Rendering.

Other possible applications in medicine have to be evaluated in upcoming studies, as mentioned above. At the moment this prototype is not intended for clinical use. Furthermore, even though the rendering is fully interactive, at that time the rendering of the final image needs some seconds time (5 - 30 seconds depending on the quality of the resulting image). The next step to refine this prototype will be to accelerate the rendering speed to real time high-end quality reconstruction.

4. Conclusions

Cinematic Rendering is a new technique for the 3-D visualization of radiological imaging data such as those provided by computed tomography and magnetic resonance imaging. This new technique now makes it possible to produce photorealistic depictions on the basis of computed tomography and magnetic resonance cross-sec- tional scans, which is not even close to being feasible heretofore with any of the established post-processing techniques.

This has the potential to usher in a new era in the visualization of medical imaging data provided by computed

tomography and magnetic resonance imaging.

Cite this paper

Franz A. Fellner,1 1, (2016) Introducing Cinematic Rendering: A Novel Technique for Post-Processing Medical Imaging Data. Journal of Biomedical Science and Engineering,09,170-175. doi: 10.4236/jbise.2016.93013

References