For my Innovations Project I did a painterly motion blur for moving images.
I got inspired to do this from images by the artist Bill Hall.


Creating through trial and error
I started by looking into ways of manipulating motion vectors, rendered from a short clip of animation. I tested different masks made from both moving and still images, such as smoke and elephant skin. The idea was to mask out areas that wouldn’t be affected by the motion blur and therefore get an interesting pattern for where the detail would appear. I also tested different inputs to change the shape of the motion vectors. On its own this turned out to give a too random result.
Later tests were done with displacements. I started out by doing tests on still images by experimenting with distortion filters in Photoshop. By following an article in Computer Arts Magazine by Pete Harrison, Photoshop Displacement Effects, I produced the following images.

Original image displaced with a black and white image. (Black and white image from Pete Harrison.)

Original image layered with the displaced image where parts have been erased.
I later tried to get the same results for moving images by using moving images as input for the displacement, in Shake instead of Photoshop. I tested a number of different pieces of footage as displacement, both 3D and video. The conclusion was that high contrasted footage, such as coloured liquid on dark backgrounds, gave more of a trailing effect than smoother images, such as smoke. I also noticed how much easier it is to create something that looks nice for a still image rather than moving ones.

A test where two pieces of footage of different kinds of liquid (filmed) were used as displacement in two layers. (The middle image is from footage shot by students on the MA Digital Effects Course.)
Mixing and layering different tests lead to the latest image sequence.
How to create the motion blur
In the following 5 steps, Maya and Shake have been used, though other 3D and post production software with similar functions can be used.
Step 1 – Animated sequence
To create this kind of motion blur, an animated sequence with a subject moving relative to the camera is needed. The images generated from this sequence should not have any kind of blur due to motion (other kinds of blur, such as depth of field, are acceptable). This is the base pass.
Step 2 – Exaggerated “natural?? motion blur
This step can be done in one of two ways. The second pass can be rendered out with motion vectors (using Reel Smart Motion Blur). Motion vectors allow you to interactively change the amount of motion blur in post production software (assuming you have the Reel Smart Motion Blur plugin). This makes it easier to see how much “natural?? motion blur is needed to fit with the later passes, without having to render out more than the base pass (image below).Exaggerating it slightly will give a more dramatic effect and will enable this pass to fit better with the subsequent stages of this process. Alternatively the animated sequence can be rendered out with “natural?? motion blur already added. However, bear in mind that if this pass does not fit with later passes it will have to be rendered out again with different motion blur settings.

Base pass combined with motion vector pass giving, with the right settings, the exaggerated “natural?? motion blur pass.
Step 3 – Displacement with irregular background
The next pass is generated using an IDisplace node. The IDisplace node has two inputs. The first is the image to be displaced and the second is the source of the displacement. The IDisplace node distorts the images of the first input in x and y according to the colour channels specified of the source of the displacement, the second input. Using different colour channels for the distortion in x and in y can create a slightly asymmetric distortion.
The first input used for this pass is the base pass. The second is a filmed grainy irregular background, where the red channel is specified to distort in x and the green channel in y (image below). This creates a slightly irregular distortion of the base pass that works well as a merger of the passes produced in previous and following step.

Base pass displaced with a grainy image as source.
Step 4 – Displacement with filmed liquid
This step also uses the IDisplace node. First create three instances of the base pass fileIn node, A, B and C. Leave A unchanged, but reposition nodes B and C by -1 and -2 frames respectively. Nodes B and C now appear behind A as a trail when the sequence is played back. The fileIn nodes are then plugged in to the first input of three separate IDisplace nodes.
The source of displacement is footage of a liquid running down a pane of glass. Depending on the quality of the footage, this fileIn node may need to have its contrast increased.
The filmed footage should be rotated and skewed to fit the direction and the perspective of the object in motion (image below). The output is then plugged into all three secondary inputs of the three IDisplace nodes and again the red channel is set to distort in x and the green in y.

Base pass displaced with filmed footage of liquid. Here the three displaced images are layered, with different opacities, into one.
Step 5 – Mixing and layering the different passes together
Now the different passes can be added together. First mix the exaggerated “natural?? motion blur pass of step 2, with the displacement pass of step 3 and leave the opacity at 50% to show the two passes equally. To achieve a blurry effect on top of this, layer the output of the mix layer with the “natural?? motion blur again in a max layer.
Combine B and C with a second mix layer, B as input one and C as input two. Use this output in a third mix layer together with A. Adjust the opacity of these two mix layers so that A is more visible than B and B more than C, to give an effect of the displacement fading away when played back.
To complete the last step of creating the painterly motion blur, combine the output of the max layer and the output of the third mix layer in a new max layer.