Note: this FAQ was produced with the help of Yoni Cohen, Oliver Zeller and Keith Chamberlain.

Download Links and Documentation for the Mental Ray Shader Plugin

1. The Mental Ray download will contain a file named lm_2DMV.dll. Copy this file to the 3DSMax\mentalray\shaders directory.
2. A Mental Ray shader declaration file needs to be created in the include directory. Copy the code below into a text file. Save it as 3DSMax\mentalray\include directory\lm_2DMV.mi
   

   # MI declarations for Guy Rabiller's lm_2DMV 1.3p Mental Ray shader
   # by Horvátth Szabolcs (szabolcs@impresszio.hu)
   
   declare shader
   	color "lm_2DMV"
   		(
   			integer		"Target", #: default 1
   			integer		"Normalize" #: default 16
   		)
   	version 1
   	apply material
   end declare
   

3. In 3ds Max and make sure that the renderer assigned to render the scene is the Mental Ray renderer (see the 3ds Max manual for details).
4. Open the Material Editor from within 3ds Max.
   
   1. Create a material that uses the lm_2DMV shader as the diffuse color map.
   2. Set the Self Illumination to 100.
   3. Set the 'Target' value of the lm_2DMV shader to 1 (this essentially means "make motion vectors that are compatible with RE:Vision Effects' products.") The default is 0, so make sure to change the value to 1.
   4. If you are rendering 16-bit files (we STRONGLY suggest that you do), then you'll probably set the shader's Normalize value to '7', which translates to a MaxDisplace for use in RE:Vision Effects' products of 2048. The value you should use for MaxDisplace is described here.
   

   (click to enlarge)

5. Make sure that the camera being used and the objects being rendered have the Motion Blur turned on in their Object Properties:
   
   

   (click to enlarge)

6. Make sure that the in the Renderer settings that in the Camera Effects that Motion Blur is enabled, that the Shutter is set to 0.0 (otherwise the motion vectors themselves would be blurred, and that is not what is desired) and that Motion Segments is set to 1.
   
   

   (click to enlarge)

7. You need to make sure that all objects are rendered with the motion vector material we set up above. Instead of changing each object's material, you can simply overried the material used, by setting the Material Override of the Processing panel of the Render Scene settings is enabled and the Material is set to the motion vector shader material we set up at the start of this tutorial.
   
   

   (click to enlarge)

8. Now you can render out a regular pass which will represent your motion vector data. When animating your scene consider that one to two start/end frames may lack proper motion vector data, dependent on your object motion.

There is a bug in Max 6: The motion blur options (in the object properties) for lights and cameras are disabled, so you cannot enable them directly. There are two ways to enabled them:

• Through Maxscript
• By selecting both a camera and a geometric object, you can change the motion blur property for both of them

Unfortunately, because of changes in the pipeline architecture for 3ds Max 7, there is no proper way to get out motion vectors from Max using the La Maison shader. Using the La Maision shader will produce a) motion vectors that are either near zero at each pixel; or b) motion vectors that are themselves motion blurred. Both situations produce unusable motion vectors.

The only way to get motion vectors out of 3ds Max is to output RPF files with the velocity channel (GBuffer). There exists two ways to spit out RPF files, directly as a Max RPF file by checking the Velocity checkbox which will do something in Combustion and Digital Fusion. The other way is via Sven Fabian's VelocityToBitmap which converts the RPF files to standard image files so programs like After Effects and Shake can read them.

Note that the velocities stored in RPF files are "Instantaneous" rather than representing a full frame interval of motion as happens with the La Maison Mental Ray shader (for Max 6) or the Max Velocity Render Element (for Max 8). For ReelSmart Motion Blur this may or may not be what you want. These velocities will not work with Twixtor.

You should also note that the VelocityToBitmap has a scaling factor of 2 for the Motion Vectors compared to Combustion. Our math tells us the VelocityToBitmap translation is correct, but all you need to know that you might need to apply an additional scaling of 2 to MaxDisplace to recover the same result if you compare one against the other. If you use this you will have to twiddle with the sliders a bit more until you figure out works. We are also told that the Y in Digital Fusion 4 is inverted (so you need to set ScaleY to -1). As well, you will need to insert a Coverage Matte in the alpha channel if the render does not cover the full image.

Note: this FAQ was produced with the help of Yoni Cohen, Oliver Zeller and Keith Chamberlain.

This technique writes out image files that are to be used as motion vectors for use with RE:Vision Effects plugins. The x-displacement is encoded in the red channel of the image and the green channel encodes the y displacement. Alpha information is also important. You can read more about our vector image format here.

Max 8 now has a new render element which eliminates the need for the La Maison shader (which does not work in Max 8) or Sven Fabian's Max Script.

1. Open the Render dialog by selectin Render... from Max's Rendering menu.
   

   (click to enlarge)

2. Go to the Render Elements tab in the Render dialog box and add a Velocity Render Element by clicking Add... in the Render Elements section of the Render dialog box. Then another dialog box comes up and you should choose to add a Velocity Render Element.
   

   (click to enlarge)

3. Scroll down to the bottom of the Render Element settings and you will see the settings available for the Velocity Render Element. You'll see a setting for Max Velocity; this setting corresponds to the Max Displace value seen in RE:Vision Effects' products= The default Max Velocity is set to 1.0, which means the maximum that can be encoded in the output file is 1.0 pixel in either the X or Y direction which is not very useful . You should change this to a value that encompasses the maximum motion, in pixels, for any object in the scene. If you don't know what this may be, a good value to start with is 2048.0. You also need to specify what the output file sequence is for the velocity-encoded images. Make sure to use a 16 bit or floating point image format that does no compression or lossless compression (for example: 16 bit TIFF files with no compression, or 16 bit SGI files).

   IMPORTANT NOTE: 3ds Max renders out velocity images assuming that the y index for pixels of an image increases as you go down the image, and our plugins assume that the y index of images increasses as you go UP the image. As such you will want to use a Vec Scale Y of -1 when using our plugins when rendering out velocity images from Max 8.

   

   (click to enlarge)

4. In a perfect world, we would be done now. However, some materials (like texture shaders) are incompatible with the Velocity Render Element that Max 8 provides. As such, the next few steps describe a workaround you will need to use. In the Common tab of the Render dialog, set the Production and Materia Editor renderers to the Mental Ray Renderer.
   

   (click to enlarge)

5. As was said previously, some material shaders for writing vector image files are not compatible with Max's Velocity Render Element. To make sure that you have a material that will work properly with this process, create a new material in the material editor and simply assign the Standard shader to it (we use the Standard material because this one is known to work with the Velocity Render Element). Leave all the settings at their defaults and do not assign any maps to any of the settings.
   

   (click to enlarge)

   In the figure above we have created a new material in the material editor (the one circled in red) and have assigned the Standard material shader.

6. At this point you are probably wondering how much work it will take to replace all your materials with this material. Luckily, it's easy. With the Mental Ray renderer, Max 8 allows you to override all the materials by enabling and setting the Override Material in the Processing tab of the Render dialog. So you don't need to replace the materials on each object. Note that you can drag the material from the material editor onto the place that specifies the override material to be used.

   

   (click to enlarge)

That's it. Now you are ready to render out images that represent vectors of motion for the objects. Unfortunately, since you need to override the materials, you'll have to render your color images in one render pass, with whatever renderer you choose to use and the Material Override turned off and the Velocity Render Element disabled. ( If you are going to post mostion-blur with ReelSmart Motion Blur, remember to turn off motion blurring in Max). Then, in another pass, you render out your motion vectors by enabling the Velocity Render Element, use the Mental Ray renderer, and set the Override Material to the special Standard material we made in the last step above.

(click to enlarge)

BONUS: Keith Chamberlain from Discreet provides the following tip. If you have portions of your animation coming on and/or off screen you will probably want to render a larger image than ultimately needed, then process with our plugin, then crop using your favorite compositing package. You can find the overscan script here, and scroll until you find the overscan script.

Cinema 4D 9.6 now has a Motion Vectors Render element. The Motion Vectors element should always be rendered at 16 bit or float. Please Note that this Pass will require to be usable in Shake, After Effects, Combustion or Fusion etc... an alpha to be added in the Motion Vectors Alpha channel once you load the Motion Vectors source. In After Effects this will require a pre-comp. The MV alpha should be the C4D Object Buffer alpha or simply the color (RGBA) alpha. Now upon inspection there appears to be a slight mismatch between the pixels covered by the MV render pass and the object coverage hinted by the Object Buffers result (or the color pass alpha).

Please read about how alpha is encoded in our motion vector files.

Read the general FAQ about RE:Vision Effects products and Cinema 4D for workarounds.

The free Vixol software for C4D 9 is not available anymore.

Early on, we did some tests with Kenneth Woodruff and it appeared that the PhotoShop layer output of Lightwave can be used to render motion vectors in 16bpc. More tests might be needed. We noticed that it is very important to turn OFF the antialiasing setting for the Motion Vector output render pass, otherwise the Motion Vectors are incorrectly composited when two objects intersect which will cause bad artifacts at the edges of objects. Many applications seem to have problems reading PSD layers image sequences. So instead why not just generate standard image sequences:

Richard Nichols has made available a Lightwave plugin. Go here for more information.

Sven from HouseOfSecrets has been working on this plugin http://www.houseofsecrets.nl/downloads/plugins.htm

mental ray plugin in Maya

First: download the Maya files from Horvatth Szabolcs' site here. Of particular interest in the .zip package is the .mi file and the .mel template. For the shaders themselves (the .so files) follow the instructions listed here:

• Windows (32 and 64 bit): Download the mental ray vector shader, provided by La Maison. The docs on the La Maison mental ray shader page talk about Softimage|XSI, but simply download the shader and follow the directions below in the Recommended Settings for Maya" section below.
• Linux 32 bit: Download the mental ray vector shader, provided by La Maison. The docs on the La Maison mental ray shader page talk about Softimage|XSI, but simply download the shader and follow the directions below in the "Recommended Settings for Maya" section below.
• Linux 64 bit: Download the compiled mental ray shader .so file from Haarm-Pieter Duiker's site here. From the author: Fedora Core 7 was used to compile the Linux 64-bit shader. This may cause some problem for people running mental ray on other platforms. The makefile is there next to the source if it there is a problem.
  Note: this download only includes the .so files for various OS's, so you still need to download the .mi and .mel files from this site.
• Mac OS 32 bit: Download the shader, .mi and .mel files needed, plus instructions for installation from Evil Eye Pictures free download here.
• Other OSs, or problems with shaders provided. Download source and makefiles from Haarm-Pieter Duiker's site here. The makefiles provided should allow you to modify them for your particular situation.

Turtle For Maya

Turtle for Maya from Illuminate Labs now has support to render Motion Vectors which conforms to our Motion Vectors documentation. Tests and Documentation in preparation.

AIR for Maya (via MayaMan)

AIR from SiTex Graphics has a motion vector pass option. We have not tested it ourselves, but clients report that their motion vector pass works with our plugins that use motion vectors as intput.

This FAQ was produced with the help of Horvatth Szabolcs; the information he originally posted can be found here. These settings have only been tested witht the La Maison vector shader and not the unsupported mip_motion_vector shader by Mental Images.

In Maya you can save all this as a reusable Render Setting so don't feel overwhelmed by the level of things that can be changed.

Shutter Angle: It is recommended you use a shutter angle value of 180 degree in Maya. The shutter value in Maya (unlike the other controls mentioned here) is in the Camera settings (under effects). Note: It is important to understand that Maya scales motion vectors based on that value. It defaults to 144 in Maya. The net effect is a tool like RSMB Blur Amount for example is internally scaled to a full Motion Vector Length meaning 360 degree so Amount of 0.5 means 180 degree. As people have reported some issues with setting shutter to 360 degrees in Maya, then you can consider setting the shutter angle to 180 but then you have to compensate somewhere by a factor of 2, either the relationship of the shader Normalize param and our plugins MaxDisplace value OR in the case of RSMB by setting the amount to 1.0 instead of 0.5 as below. Furthermore in the Mental Ray Render Settings, the "Motion Blur Calculation" parameter scales that as well.

Quick Install Recap: (trust Horvatth's page quoted above more then us for that).

1. Download the Maya files from Horvatth's page Maya Files (zip file also includes an icon for HyperShade) and Copy the lm_2DMV.mi file to the `mayaX.0/mentalray/include` directory.
2. As well, copy the AElm_2DMVTemplate.mel file to a maya script directory
3. Copy the DLL (or .so) to the `mayaX.0/mentalray/lib` directory.
4. Add the following lines after similar declarations in the maya.rayrc file. The rayrc file is in the MayaX.0/mentalray directory in Maya X.0.
   • for Windows:
     link "{MAYABASE}/lib/lm_2DMV.dll" mi "{MAYABASE}/include/lm_2DMV.mi"
   • for Linux and Mac:
     link "{MAYABASE}/lib/lm_2DMV.so" mi "{MAYABASE}/include/lm_2DMV.mi"
   • for Mac only:
     if you are not familiar with such installation, you access this by right click to show package content.

   Do not rename an installed Maya (eg maya7dot1) as you risk breaking links to shaders

5. The lines added to maya.rayrc initializes the shader for Mental Ray. If they do not exist then the shader will only in Maya, but not in Mental Ray, and the following error messages will appear in the output window:
   API 0.0 error 301031: call to undeclared function "lm_2DMV"
   API 0.0 error 301036: undefined shader "lm_2DMV1"

6. The shader will appear in MentalRay Materials.

   

7. lm_2DMV appears in the HyperShade at the `Create mental ray Nodes/Materials` tab. (If you don't have this tab then create an environmental variable called MAYA_MRFM_SHOW_CUSTOM_SHADERS set it to 1 and restart Maya. It will enable the display of Mental Ray nodes.)

You should refer to this FAQ for Mental Ray Shader settings

How La Maison's Mental Ray plugin works with RE:Vision Effects plugins

Much like Guy explains for the use of the shader within XSI on the La Maison site, make sure that the Maya is rendering with motion blur on, but with the shutter effectively zeroed. For such, we recommand to set "shutter" and "shutter Delay" values to be both 0.5, 0.5 OR the smallest value you dare to type e.g. 0.000001.Both of these values will ensure that you do not motion blur the motion vectors themselves if they are set to the same value.

There seems to be an issue matching MB off and MB "exact deformation" with shutter of 0.5 0.5 in Maya. Thus one cannot apparently simply take the alpha of the beauty pass and make it in post the alpha of the MV pass without creating artifacts. It's been recommanded to us to set your whole pipeline to always work at 0.5 shutter delay in Maya so a beauty pass without MB, an MV pass and a 3D MB passes all matches as best can be. Some rudimentary tests seem to indicate no real effect on rendering speed (MB off vs MB 0.5 0.5). Alternatively if you don't mix and match 2D and 3D motion blur, you can work at a real tiny value like 0.000001 for the MV pass and MB off (you would be at worst in a 1000 image res pass, 1000/1000000 (or 1/1000) pixel off). Maya UI won't show values below 0.001 but will pass them correctly to the renderer. Furthermore if one forgets and leave at 0.000 by copying without seeing, then they will get flat zero motion so it will be obvious.

To get an alpha from the shader, one has to check in Custom Entities in the Render Settings the "Pass Current Alpha Channel" option. Do not try to use the beauty pass alpha in Maya. It won't perfectly align.

The samples values (Anti-Aliasing in Render Settings) will have an effect on your result, the minimal setting (which is minimal anti-aliasing) would be (min0/max0, filter : triangle 1/1). You might prefer a bit of anti-aliasing, particularly for warping tasks (as opposed to blurring ones) as on some odd shapes you could otherwise create small artifacts.

It is not possible in Maya to set shutter to 0.0 0.0 as Maya in that case does not set "-motion on" thus motion vectors are not passed to the shader.

If working on a MAC, you must first apply a surface shader to the object you want to render with the lm2dmv shader then in the surface shader color channel link it to the lm2dmv node and it will work both in the render view and in batch... otherwise on the mac batch loses connection to the shader somehow. On Windows, both will work if you just drop the node on the object.

When rendering the Motion Vectors pass a number of things can be turned off to speed up that pass. For example, lights can be hidden as they have no impact. We were told that turning off raytracing and setting time contrast to 1 1 1 1 could speed up that pass render as well, but have not extensively tested and presume that perhaps it would come into play only if shutter and shutter delay are not set to same value. We have not been able to find any use for the Custom Motion Offsets in the Mental Ray Render Settings of Maya.

RE:Vision Effects products and XSI.

Download Links and Documentation for the Mental Ray Shader Plugin

You can use La Maison's Mental Ray Shader Plugin with XSI to render motion vectors.

lm_2DMV V2.0

Download the La Maison Mental Ray shader and read additional information on its use. The La Maison page documents using the shade in XSI.

Video Tutorial

Select all the objects in a scene to make a render pass with lm2Dmv (press here for movie). Courtesy of Luc Froehlicher.