|
<< Click to Display Table of Contents >> Navigation: Nodes > Tasks > VR Tools > Stitch Align Mesh |
To apply automatic image warping to remove Stereo3D vertical disparities and other distortion artifacts, in order to automate VR production.
Currently it only supports VR180, not VR360.
Equivalent to using Position->Align Mesh in Mistika VR product, but done automatically via this node.
When this node is used, it should be the last step of the stitching process, typically after using stitching improvement nodes such as Stitch Refiner. This is because having a improved stitch will help this node to obtain better results.
Given a .rnd file describing an stereo3D pair (already stitched), this node will warp the resulting left and right images as needed in order to remove vertical miss-alignments (a same feature should always be at the same height in both eyes). Those vertical miss alignments are known to cause visual fatigue or even extreme discomfort (basically because we do not have one eye higher than the other, so only horizontal parallax is meaningful for the brain...).
To achieve this, it will identify the pixel correspondences between the images of both eyes, and it will then warp the images as needed in order to remove lenses distortions and other optical artifacts and forcing all the identified features to align vertically.
The warped mesh pattern applied to the images can also be exported to other applications as a mesh file.
If you want to automate the whole process for incoming camera files automatically, an example workflow could be like this:
Folder (or Watcher) containing incoming camera footage-> VR Input Bunches -> RNDfile -(load rnd containing your VR preset) > Stitch Refine > Stitch Align Mesh -> MistikaRender
Inputs
rnd: An .rnd file containing the VR images (already stitched). The initial .rnd files are normally created in Mistika VR or Mistika Boutique products. Then used as templates in Mistika Workflows by nodes supporting them
rnd: The .rnd file with the warping applied. You can render it by connecting this output to a MistikaRender node downstream.
Export mesh: It will export the warped mesh applied to the images to a separate file in Misitka .vrmesh format (at render time). For usage in other applications understanding this format. This provides a non destructive integration with other applications, as they can still load the original images and apply the mesh warp pattern created by this tool, rather than being forced to use intermediate renders.
In the Mistika VR product, this is equivalent to the File -> Export -> Export mesh metadata menu.
The .vrmesh format is described in this github project, also including libraries to read it: https://github.com/SGODeveloper/VRMeshLibrary
Density (High, Medium, Low): Mesh density
Reference frame: Reference frame number to use for the analysis. In some cases you may want to skip the first seconds where people are still preparing the camera
Property Label |
Property ID |
exportMesh |
exportMesh |
density |
density |
referenceFrame |
referenceFrame |