Tech Transfer

My past research at Adobe has been transferred into a number of Adobe products:

After Effects CC: Camera Shake Deblur (2017)

A new effect, Camera-Shake Deblur, reduces motion blur artifacts resulting from camera shake. This effect can save shots that might not otherwise be usable due to slight camera bumps or camera motion blur that remains after stabilization.

Watch a video demo here.

ae-camerashake

Lightroom CC: Boundary Warp (2016)

Boundary Warp is designed to solve the issue of irregular boundaries when creating stitched panoramas. It analyzes the boundary of your panorama and then warps the image so the edges fit nicely inside a rectangular frame.

Watch a video demo here.

Photshop & Lightroom CC: Image Dehazing (2015)

The Dehaze tool helps you easily reduce or remove haze, common in many outdoor photos like landscapes. It can also add haze in a realitisic way into your photo as an artistic effect.

You can watch a demo here.

dehaze

Photshop CC: Shake Reduction (2013)

It’s finally here. Shake Reduction is a tool that can take a photo that’s blurry due to camera shake, calculate the movements that caused the blur, and “reverse it” to create a sharper photo. It also has a completely automatic workflow that no one has ever seen before: meaning that the tool is smart enough to adapt itself to a new input image in order to create a good result. It does not work in every case, but when it works, it is amazing!

You can watch a demo here.

Lightroom 5: Upright Adjustment (2013)

Upright tool analyzes an image to automatically level horizons and straighten objects like buildings to correct a keystone effect, by rotating the image in 3D. It actually does camera calibration: extracting 3D camera orientation from the image content. It’s based on this research paper.

Watch the popular youtube tutorial here.

After Effects CC: Refine Edge (2013)

We used to call it “hair brush” internally, and I still like this name. It is a video matting tool that keeps the details when separating complicated foreground elements like frizzy hair or motion-blurred edges from complex backgrounds. This means you can create natural-looking composites without keying specially shot footage. When combined with Roto Brush we developed earlier, they give you a powerful, brand new workflow for rotoscoping.

Watch the demonstration here.

Photoshop Touch: Scribble Selection (2012)

Scribble Selection is one of the shinning features of Adobe Photoshop Touch App, available for both iPad and Android Tablets. I designed and developed the main algorithm behind this feature.

Let’s say how John Nack, former Product Manger of Photoshop Touch commented on this feature: “If I had to boil the app down to one feature, it’s this: Take two images, remove the background from one, and then blend the two images together to create a new scene. The Scribble Selection tool lets you use your finger or a stylus to quickly draw on the foreground object you want to keep and the background you want to delete. Then tap Extract, and the background disappears.”

A popular Youtube video demo of the tool is here.

After Effects CS5.5: Warp Stabilizer (2011)

Perhaps the most exciting new feature in After Effects CS5.5 is the Warp Stabilizer effect. This effect automatically stabilizes a shot, removing unwanted motion. It is based on our research on subspace video stabilization, presented at SIGGRAPH 2011.

Chris and Trish Meyer reviewed the Warp Stabilizer effect on the ProVideo Coalition website.

This feature was recently used by the VFX team behind the Oscar winner Hugo. Watch the Hugo interview here.

After Effects CS5: Roto Brushroto brush (2010)

The all-new Roto Brush tool in After Effects CS5 is largely based on our research on video SnapCut, and my previous research on image and video matting.

A great tutorial video is here.

Some reviews:
PCWorld – After Effects CS5 Features New Roto Brush
Life Talking – AE CS5 has a rotobrush!
Macworld – Review: After Effects CS5

Photoshop CS5: Refine Edgerefine edge (2010)

The Refine Edge is an advanced image matting tool that improves the quality of selection edges, letting you extract objects with ease. I am one of the major contributors behind this much improved feature in Photoshop CS5.

A great Youtube tutorial video is here.

The review by PCWorld :
“The Refine Edge selection dialog box has been redesigned to allow more accurate selections, especially of difficult textured edges, such as wooly clothes or flyaway hair. This isn’t to say that creating such masks are now child’s play, but with the Refine Radius and Erase Refinements brushes, along with Smart Radius analyzing the edges, the task of working on such difficult subjects isn’t as grueling. In addition, the Color Decontaminant option helps remove excess background that you might have inadvertently included in your mask–though as with all such tools, your original picture must have some differentiation in color and contrast between the background and the subject.”

Photoshop CS5: New Sharpen Tool (2010)

I gave the classic sharpen tool in Photoshop a new twist! The Protect Detail option will allow you to faithfully sharp a region without the annoying pixelation artifact.

Watch the offical Adobe tutorial video here.

Photoshop CS4: New Color Range Selection (2008)

Color range selection has been a classic in Photoshop for many years. Again, I gave it a new twist on using localized color models. By localizing the color selection both in the spatial space and color space, it allows the user to create more accurate and controllable color masks.

Photoshop Guru Martin Evening says:
“Color Range has been improved. There is new option called ‘Enable Localizes Clusters’ , which when selected can carry out more advanced calculations when you add and subtract using the selection eyedropper tools to refine a Color Range Selection. The net result is that Color Range has now become a very powerful color selection tool. When you link this with the new Masks panel feature, it is possible to build masks based on color that are much more accurate than anything you could have achieved before using Color Range.”

Photoshop CS4: Content-Aware Resizing (2008)

My contributed to the great content-aware resizing feature in Photoshop CS4. It resizes an image without changing important visual content such as people, buildings, animals, and so forth.

A popular Youtube video is here.

The review by PCWord:
“Content-Aware Scaling automatically recognizes skin tones to keep people from being squeezed out of the shot. As a user resizes the image, people in the shot may become closer together or farther apart, but they will remain in the image properly proportioned while background elements disappear. ”