|Megvii: SuperIQ (2019)|
SuperIQ is a revolutionary low-light imaging solution on Android devices. It provides ultra-clean,
detail-rich imagery in dark environments, providing an exceptional photography experience for
consumers. At its core lies our efficient, mobile-friendly RAW image denoising technique based on deep neural networks, which won the NTIRE 2019 Challenge on Real Image Denoising. It has been
shipped with millions of Android smart phones since 2019.
|Megvii: 3D Face Reshaping (2018)|
We shipped this brand-new face-transforming feature to Lenovo mobile phones announced on
March 20, 2018. We trained a network that analyzes a huge collection of “beautiful faces” and generates a 3D face model that transforms the input image. The algorithm runs at 60 fps on a
|After Effects CC: Camera Shake Deblur (2017)|
A new effect, Camera-Shake Deblur, reduces motion blur artifacts resulting from camera shake.
This effect can save shots that might not otherwise be usable due to slight camera bumps or
camera motion blur that remains after stabilization.
Watch a video demo here.
|Lightroom CC: Boundary Warp (2016)|
Boundary Warp is designed to solve the issue of irregular boundaries when creating stitched
panoramas. It analyzes the boundary of your panorama and then warps the image so the edges
fit nicely inside a rectangular frame.
Watch a video demo here. Or, look at this GIF.
|Photshop & Lightroom CC: Image Dehazing (2015)|
The Dehaze tool helps you easily reduce or remove haze, common in many outdoor photos
like landscapes. It can also add haze in a realitisic way into your photo as an artistic effect.
You can watch a demo here.
|Photshop CC: Shake Reduction (2013)|
It’s finally here. Shake Reduction is a tool that can take a photo that’s blurry due to camera
shake, calculate the movements that caused the blur, and “reverse it” to create a sharper
photo. It also has a completely automatic workflow that no one has ever seen before:
meaning that the tool is smart enough to adapt itself to a new input image in order to
create a good result. It does not work in every case, but when it works, it is amazing!
You can watch a demo here.
|Lightroom 5: Upright Adjustment (2013)|
Upright tool analyzes an image to automatically level horizons and straighten objects like
buildings to correct a keystone effect, by rotating the image in 3D. It actually does camera
calibration: extracting 3D camera orientation from the image content. It’s based on this
Watch the popular youtube tutorial here.
|After Effects CC: Refine Edge (2013)|
We used to call it “hair brush” internally, and I still like this name. It is a video matting tool
that keeps the details when separating complicated foreground elements like frizzy hair or
motion-blurred edges from complex backgrounds. This means you can create natural-looking
composites without keying specially shot footage. When combined with Roto Brush we
developed earlier, they give you a powerful, brand new workflow for rotoscoping.
Watch the demonstration here.
|Photoshop Touch: Scribble Selection (2012)|
Scribble Selection is one of the shinning features of Adobe Photoshop Touch App, available for
both iPad and Android Tablets. I designed and developed the main algorithm behind this feature.
Let’s say how John Nack, former Product Manger of Photoshop Touch commented on this feature:
“If I had to boil the app down to one feature, it’s this: Take two images, remove the background
from one, and then blend the two images together to create a new scene. The Scribble Selection
tool lets you use your finger or a stylus to quickly draw on the foreground object you want to keep and the background you want to delete. Then tap Extract, and the background disappears.”
A popular Youtube video demo of the tool is here.
|After Effects CS5.5: Warp Stabilizer (2011)|
Perhaps the most exciting new feature in After Effects CS5.5 is the Warp Stabilizer effect. This effect automatically stabilizes a shot, removing unwanted motion. It is based on our research on subspace video stabilization, presented at SIGGRAPH 2011.
Chris and Trish Meyer reviewed the Warp Stabilizer effect on the ProVideo Coalition website.
This feature was recently used by the VFX team behind the Oscar winner Hugo. Watch the Hugo interview here.
|After Effects CS5: Roto Brush (2010)|
The all-new Roto Brush tool in After Effects CS5 is largely based on our research on video SnapCut, and my previous research on image and video matting.
A great tutorial video is here.
PCWorld – After Effects CS5 Features New Roto Brush
Life Talking – AE CS5 has a rotobrush!
Macworld – Review: After Effects CS5
|Photoshop CS5: Refine Edge (2010)|
The Refine Edge is an advanced image matting tool that improves the quality of selection edges, letting you extract objects with ease. I am one of the major contributors behind this much improved feature in Photoshop CS5.
A great Youtube tutorial video is here.
|Photoshop CS5: New Sharpen Tool (2010)|
I gave the classic sharpen tool in Photoshop a new twist! The Protect Detail option will allow you
to faithfully sharp a region without the annoying pixelation artifact.
Watch the offical Adobe tutorial video here.
|Photoshop CS4: New Color Range Selection (2008)|
Color range selection has been a classic in Photoshop for many years. Again, I gave it a new twist on using localized color models. By localizing the color selection both in the spatial space and color
space, it allows the user to create more accurate and controllable color masks.
| Photoshop CS4: Content-Aware Resizing (2008)|
My contributed to the great content-aware resizing feature in Photoshop CS4. It resizes an image without changing important visual content such as people, buildings, animals, and so forth.
A popular Youtube video is here.