home |
applications |
research |
people
abstract
Chroma keying, often called blue screening, refers to
classifying a range of colors, commonly in the blue or
green color spectrum, from a captured image to define a
matte for compositing multiple image sources. The problem
is under-constrained and most commonly addressed
through commercial products that require tweaked parameters
and specialized hardware for real-time processing. In
Mixed Reality (MR) applications using video see-through
head-mounted display (HMD) hardware, the problem becomes
more difficult since the poor camera quality within
the HMDs, interactive processing requirements of MR, and
multiple camera sources demand a robust, fast, and affordable
solution. In our approach, we precondition the chroma
key by using principal component analysis (PCA) to obtain
high fidelity mattes from video streams in real-time on commodity
graphics processing units (GPUs). In addition, we
demonstrate how our method compares to offline commercial
keying tools and how it performs with respect to signal
noise within the video stream.
people
publications
- Patent Disclosure Submitted