SceneRenderer
Generic scene renderer
Extends VideoRenderer to be used with the particular WebGL engine e.g. Babylon.js or Three.js. Type of the scene is additional parametrization of generic. ScenePlugin written for WebGL engine can be attached to a SceneRenderer. Usually they perform simple scene tasks that can be separated from the main context into atomic building blocks, for example control node of a scene to follow (be attached to) user’s head or replace its geometry with detected face mesh (mask effect).
Extends
ShaderRenderer<ResultT>
Extended by
Type Parameters
• ResultT extends object = object
Type of processing results
• SceneT = undefined
Type of renderer’s scene
Constructors
new SceneRenderer()
new SceneRenderer<
ResultT,SceneT>(params):SceneRenderer<ResultT,SceneT>
Constructor
Parameters
• params: CanvasParams
Parameters of responsive canvas
Returns
SceneRenderer<ResultT, SceneT>
Inherited from
Properties
cameraAngle
protectedcameraAngle:number
Camera vertical angle in radians
Inherited from
cameraRatio
protectedcameraRatio:number
Camera aspect ratio
Inherited from
canvas
canvas:
ResponsiveCanvas
Responsive canvas
Inherited from
current
current:
null|WebGLTexture=null
Current image texture
Inherited from
input?
optionalinput:ImageTexture
Input image texture
Inherited from
loaded
protectedloaded:boolean=false
Loaded state
Inherited from
padCtx
protectedpadCtx: [null|CanvasRenderingContext2D,null|CanvasRenderingContext2D]
Drawing context of padding canvases
Inherited from
plugins
protectedplugins:Plugin<ResultT>[] =[]
Attached plugins
Inherited from
scene?
optionalscene:SceneT
Renderer scene
shader?
protectedoptionalshader:ShaderProgram
Rendering shader
Inherited from
shaderCtx
shaderCtx:
null|WebGL2RenderingContext=null
Context of the video canvas layer
Inherited from
videoRatio
protectedvideoRatio:number
Aspect ratio of input video
Inherited from
videoSize
protectedvideoSize:Size
Resolution of input video
Inherited from
Methods
addListener()
addListener<
E>(event,listener):this
Adds the listener function to the end of the listeners array
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
This EventEmitter
Inherited from
addPlugin()
addPlugin(
plugin):Promise<void>
Add render plugin
Initializes the plugin if it’s not loaded yet but renderer is ready. Renderer takes ownership of the plugin instance meaning it will release it when plugin is detached or renderer is disposed itself.
Parameters
• plugin: Plugin<ResultT>
Returns
Promise<void>
Inherited from
dispose()
dispose():
void
Dispose renderer object
Extended to dispose scene object.
Returns
void
Overrides
emit()
emit<
E>(event, …args):boolean
Synchronously calls each of the listeners registered for the event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• …args: Args<RendererEvents[E]>
Arguments passed to the listeners
Returns
boolean
True if the event had listeners, False otherwise
Inherited from
eventNames()
eventNames(): (
string|symbol)[]
List of emitter’s events
Returns
(string | symbol)[]
List of emitter’s events
Inherited from
getMaxListeners()
getMaxListeners():
number
Maximum number of listeners per event
Returns
number
Maximum number of listeners per event
Inherited from
ShaderRenderer.getMaxListeners
listenerCount()
listenerCount<
E>(event):number
The number of listeners listening to the event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
Returns
number
Number of listeners
Inherited from
listeners()
listeners<
E>(event):Function[]
Copy of the array of listeners for the event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
Returns
Function[]
Copy of the listeners array
Inherited from
load()
load():
Promise<void>
Initialize renderer
Initializes rendering context, shader program and buffers.
Returns
Promise<void>
Promise resolving when initialization is finished
Inherited from
off()
off<
E>(event,listener):this
Removes the listener from the listener array for the event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
This EventEmitter
Inherited from
on()
on<
E>(event,listener):this
Adds the listener function to the event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
This EventEmitter
Inherited from
once()
once<
E>(event,listener):this
Adds a one-time listener function for the event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
This EventEmitter
Inherited from
prependListener()
prependListener<
E>(event,listener):this
Adds the listener function to the beginning of the listeners array
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
This EventEmitter
Inherited from
ShaderRenderer.prependListener
prependOnceListener()
prependOnceListener<
E>(event,listener):this
Adds a one-time listener function to the beginning of the listeners array
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
Inherited from
ShaderRenderer.prependOnceListener
rawListeners()
rawListeners<
E>(event):Function[]
Copy of the array of listeners for the event including wrappers
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
Returns
Function[]
Copy of the listeners array
Inherited from
removeAllListeners()
removeAllListeners<
E>(event?):this
Removes all listeners, or those of the specified event
Type Parameters
• E extends keyof RendererEvents
Parameters
• event?: E
The name of the event
Returns
this
This EventEmitter
Inherited from
ShaderRenderer.removeAllListeners
removeAllPlugins()
removeAllPlugins():
void
Remove all render plugins
Renderer will dispose all plugins before detaching them.
Returns
void
Inherited from
ShaderRenderer.removeAllPlugins
removeListener()
removeListener<
E>(event,listener):this
Removes the specified listener from the listener array
Type Parameters
• E extends keyof RendererEvents
Parameters
• event: E
The name of the event
• listener: RendererEvents[E]
The callback function
Returns
this
This EventEmitter
Inherited from
removePlugin()
removePlugin(
plugin):void
Remove render plugin
Renderer will dispose the plugin before detaching it.
Parameters
• plugin: Plugin<ResultT>
Returns
void
Inherited from
setMaxListeners()
setMaxListeners(
n):this
Sets maximum number of listeners per event
Parameters
• n: number
Maximum number of listeners
Returns
this
This EventEmitter
Inherited from
ShaderRenderer.setMaxListeners
setMirror()
setMirror(
mirror):void
Set mirror mode
CanvasRenderer sets mirror mode of ResponsiveCanvas.
Parameters
• mirror: boolean
Mirror the output
Returns
void
Inherited from
setMode()
setMode(
mode):void
Set fitting mode
CanvasRenderer sets fitting mode of ResponsiveCanvas.
Parameters
• mode: CanvasMode
Fitting mode
Returns
void
Inherited from
setupCamera()
setupCamera(
ratio,angle):void
Set camera parameters
Callback sets up all attached plugins.
Parameters
• ratio: number
Camera aspect ratio
• angle: number
Camera vertical angle in radians
Returns
void
Inherited from
setupPadding()
protectedsetupPadding():void
Setup padding canvases
Callback sets up size of padding canvases.
Returns
void
Inherited from
setupVideo()
setupVideo(
size,ratio?):void
Set video parameters
Callback sets up size of video canvas layer, resizes texture and allocates new storage.
Parameters
• size: Size
Resolution of input video
• ratio?: number
Aspect ration of input video
Returns
void
Inherited from
unload()
unload():
void
Reset renderer
Releases all resources and instances created in load(). Releases rendering context, shader program and buffers.
Returns
void
Inherited from
update()
update(
result,stream):Promise<void>
Update the scene
Renderers input video frame on corresponding canvas layer.
Parameters
• result: ResultT
Results of video processing
• stream: HTMLCanvasElement
Captured video frame
Returns
Promise<void>
Promise resolving when update is finished
Inherited from
updatePads()
protectedupdatePads(stream):void
Update padding canvases
Updates padding canvases using portions of video frame.
Parameters
• stream: HTMLCanvasElement
Captured video frame
Returns
void
Inherited from
updatePlugins()
protectedupdatePlugins(result,stream):Promise<void>
Update attached plugins
Calls update() of all attached plugins.
Parameters
• result: ResultT
Results of video processing
• stream: HTMLCanvasElement
Captured video frame
Returns
Promise<void>
Promise resolving when update is finished
Inherited from
updateScene()
protectedupdateScene():void
Update and render the scene
Virtual method updating and rendering the scene. Overridden by implementation of derived renderer.
Returns
void
Inherited from
updateVideo()
protectedupdateVideo(stream):void
Update the video layer
Calls rendering shaders with current input texture.
Parameters
• stream: HTMLCanvasElement
Captured video frame
Returns
void