Plugin assigning face point pose to a scene node
Plugin attaches provided node to the face point. Pose of the node (translation + rotation + scale) continuously updates according to pose estimation by FaceProcessor. Children nodes inherently include this transform. The node can be seen as a virtual placeholder for real object. It's recommended to attach top-level nodes that don't include transforms relative to parent, otherwise head transform that is a pose in the world frame will be applied on top of them (will be treated as relative instead of absolute). Optionally anisotropic fine-tuning of the scale can be applied. In this case model will additionally adapt to shape of the face. If face isn't detected by FaceProcessor plugin recursively hides the node. One of approaches to accurately align meshes with a face point when modeling a scene is to make them children of a node which origin coincide with the corresponding vertex of the reference face mesh, set their relative transforms using base mesh as the reference, then instantiate FaceTrackPlugin for this scene node. You can also apply relative transforms of children of the face-attached parent node programmatically. It's useful to add occluder model (base mesh of a head) as a child of the node. This can be handy when parts are stored separately.
• new FaceTrackPlugin(
|Scene node to attach|
|Index of the face vertex|
|Tune scale according to shape of the face|
Dispose render plugin
Prepares or modifies the attached node if required. Reference to the scene object is cached and used by plugin on update() and unload(). You need to reload plugin if you want to change scene it's attached to. Overridden by derived classes for particular task.
|Scene this plugin is attached to|
Promise resolving when initialization is finished
Releases all resources/instances created in load(). Overridden by derived classes for particular task.
Update pose of the model
Updates node's pose (translation + rotation + scale) according to to the estimation from FaceProcessor. If face isn't detected plugin recursively hides the attached node.
|Results of video processing|
|Captured video frame|
Promise resolving when update is finished