NNFlowVector is an optical flow plugin for Foundry’s Nuke. It’s using state of the art AI/deep learning technology to produce really accurate motion vectors. It’s able to produce classic motion vectors (free version), but also the more advanced type smart vectors (paid/licensed version). To test it out for yourself, please use the downloads page. You are also welcome to request a free trial license to run the full version for a limited time period.
Here is an interactive example comparing the output from Nuke’s normal VectorGenerator to the motion vector output of NNFlowVector:
Features
- Produce high quality motion vectors (“forward” and “backward” layers that together make up the “motion” layer in Nuke).
- Produce high quality smart vectors, to be able to be used with our new node NNFlowVectorWarp (which is an optimized alternative to NukeX’s VectorDistort).
- The smart vectors are compatible with all NukeX’s tools like VectorDistort, VectorCornerPin and GridWarpTracker.
- Native overscan handling (i.e. it handles larger bounding boxes than the image frame/format). Please note that the bounding boxes can’t be animated, i.e. it can’t be different from frame to frame.
- GPU accelerated using CUDA by NVIDIA (requires a NVIDIA graphics card).
- Internal stitching of several inference/image patches (to be able to process high resolution images to produce the motion vectors without having that much VRAM available on the GPU).
- Supports Nuke 13.1+ on Linux, Nuke14.1+ on Windows and Nuke15.1+ on macOS.
- Supports Nuke Indie.
- Production friendly sandboxed solution that doesn’t need an internet connection to run.
The algorithm that generates the optical flow motion vectors is based on modern state of the art neural network technology (also commonly referred to as deep learning, machine learning or artificial intelligence). This makes it possible to produce more accurate and cleaner vectors than what has been previously possible to do using more traditional mathematical methods.
Documentation
You always get the latest documentation as a PDF in the download zips (in the “docs” folder). You can also access the NNFlowVector documentation PDF directly using this link.
Knob reference
To read the documentation for all the plugin’s knobs, please visit the dedicated knob reference page.
NNFlowVectorWarp
One of the big news in v3.0 is the addition of the node NNFlowVectorWarp. This is our own take on a node with similar abilities to NukeX’s VectorDistort, but being tailor made and optimized for the vectors produced by the NNFlowVector node (especially the new “AAA” model variant). With the NNFlowVectorWarp node you can track/warp patches onto live action footage, you can stabilize live action footage as well as warp stabilized footage back to it’s original motion. You can also output STMaps of the warps produced, to be able to apply the warps in a very efficient and optimized way using the classic STMap node (part of Nuke’s default toolset). Click here to read more about the included NNFlowVectorWarp.
NNFlowVector Utils
NNFlowVector comes bundled with a few utility gizmos/tools, collectively called “NNFlowVector Utils”. These tools use the vector output of NNFlowVector to help you with certain compositing tasks. The tools are meant to encourage artists to use good quality motion vectors for more than adding motion blur to material, to show the vast possibility of things that are doable. Click here to read more about the included NNFlowVector Utils.
Video demo
Frequently Asked Questions
We have gathered the most common questions about the plugin on a separate Frequently Asked Questions page.
Downloads
All the downloads are available on the dedicated downloads page.
Licensing
To buy a license, please visit our shop. If you want to request a time limited trial license, please use the form on the Request a trial license page.
