Class: BabylonRenderer<ResultT>
@geenee/bodyrenderers-babylon.BabylonRenderer
Generic babylon.js renderer
Extends @geenee/armature!SceneRenderer for the babylon.js rendering engine. BabylonRenderer does basic initialization of engine, scene, and camera. It's a generic class that should be parameterized by type of processing results to build an app using particular implementation of @geenee/armature!Processor.
Type parameters
Name | Type | Description |
---|---|---|
ResultT | extends Object = | Type of processing results |
Hierarchy
-
SceneRenderer
<ResultT
,Scene
>↳
BabylonRenderer
Constructors
constructor
• new BabylonRenderer<ResultT
>(container
, mode?
, mirror?
)
Constructor
Type parameters
Name | Type |
---|---|
ResultT | extends Object = |
Parameters
Name | Type | Description |
---|---|---|
container | HTMLElement | Container of @geenee/armature!ResponsiveCanvas |
mode? | CanvasMode | Fitting mode |
mirror? | boolean | Mirror the output |
Overrides
Properties
camera
• Protected
camera: UniversalCamera
Camera instance
cameraAngle
• Protected
cameraAngle: number
Camera vertical angle in radians
Inherited from
cameraRatio
• Protected
cameraRatio: number
Camera aspect ratio
Inherited from
canvas
• canvas: ResponsiveCanvas
Responsive canvas
Inherited from
current
• current: null
| WebGLTexture
Current image texture
Inherited from
input
• Optional
input: ImageTexture
Input image texture
Inherited from
loaded
• Protected
loaded: boolean
Loaded state
Inherited from
padCtx
• Protected
padCtx: [null
| CanvasRenderingContext2D
, null
| CanvasRenderingContext2D
]
Drawing context of padding canvases
Inherited from
plugins
• Protected
plugins: Plugin
<ResultT
>[]
Attached plugins
Inherited from
renderer
• Protected
renderer: Engine
Rendering engine
scene
• Optional
scene: Scene
Renderer scene
Inherited from
setupPadding
• Protected
setupPadding: () => void
Type declaration
▸ (): void
Setup padding canvases
Callback sets up size of padding canvases.
Returns
void
Inherited from
shader
• Protected
Optional
shader: ShaderProgram
Rendering shader
Inherited from
shaderCtx
• shaderCtx: null
| WebGL2RenderingContext
Context of the video canvas layer
Inherited from
videoRatio
• Protected
videoRatio: number
Aspect ratio of input video
Inherited from
videoSize
• Protected
videoSize: Size
Resolution of input video
Inherited from
Methods
addListener
▸ addListener<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Adds the listener function to the end of the listeners array
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
addPlugin
▸ addPlugin(plugin
): Promise
<void
>
Add render plugin
Initializes the plugin if it's not loaded yet but renderer is ready. Renderer takes ownership of the plugin instance meaning it will release it when plugin is detached or renderer is disposed itself.
Parameters
Name | Type |
---|---|
plugin | Plugin <ResultT > |
Returns
Promise
<void
>
Inherited from
dispose
▸ dispose(): void
Dispose renderer object
Extended to dispose scene and engine.
Returns
void
Overrides
emit
▸ emit<E
>(event
, ...args
): boolean
Synchronously calls each of the listeners registered for the event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
...args | Args <RendererEvents [E ]> | Arguments passed to the listeners |
Returns
boolean
True if the event had listeners, False otherwise
Inherited from
eventNames
▸ eventNames(): (string
| symbol
)[]
List of emitter's events
Returns
(string
| symbol
)[]
List of emitter's events
Inherited from
getMaxListeners
▸ getMaxListeners(): number
Maximum number of listeners per event
Returns
number
Maximum number of listeners per event
Inherited from
listenerCount
▸ listenerCount<E
>(event
): number
The number of listeners listening to the event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
Returns
number
Number of listeners
Inherited from
listeners
▸ listeners<E
>(event
): Function
[]
Copy of the array of listeners for the event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
Returns
Function
[]
Copy of the listeners array
Inherited from
load
▸ load(): Promise
<void
>
Initialize renderer
Initializes rendering context, shader program and buffers.
Returns
Promise
<void
>
Promise resolving when initialization is finished
Inherited from
off
▸ off<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Removes the listener from the listener array for the event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
on
▸ on<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Adds the listener function to the event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
once
▸ once<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Adds a one-time listener function for the event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
prependListener
▸ prependListener<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Adds the listener function to the beginning of the listeners array
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
prependOnceListener
▸ prependOnceListener<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Adds a one-time listener function to the beginning of the listeners array
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
Inherited from
SceneRenderer.prependOnceListener
rawListeners
▸ rawListeners<E
>(event
): Function
[]
Copy of the array of listeners for the event including wrappers
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
Returns
Function
[]
Copy of the listeners array
Inherited from
removeAllListeners
▸ removeAllListeners<E
>(event?
): BabylonRenderer
<ResultT
>
Removes all listeners, or those of the specified event
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event? | E | The name of the event |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
SceneRenderer.removeAllListeners
removeAllPlugins
▸ removeAllPlugins(): void
Remove all render plugins
Renderer will dispose all plugins before detaching them.
Returns
void
Inherited from
SceneRenderer.removeAllPlugins
removeListener
▸ removeListener<E
>(event
, listener
): BabylonRenderer
<ResultT
>
Removes the specified listener from the listener array
Type parameters
Name | Type |
---|---|
E | extends keyof RendererEvents |
Parameters
Name | Type | Description |
---|---|---|
event | E | The name of the event |
listener | RendererEvents [E ] | The callback function |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
removePlugin
▸ removePlugin(plugin
): void
Remove render plugin
Renderer will dispose the plugin before detaching it.
Parameters
Name | Type |
---|---|
plugin | Plugin <ResultT > |
Returns
void
Inherited from
setMaxListeners
▸ setMaxListeners(n
): BabylonRenderer
<ResultT
>
Sets maximum number of listeners per event
Parameters
Name | Type | Description |
---|---|---|
n | number | Maximum number of listeners |
Returns
BabylonRenderer
<ResultT
>
This EventEmitter
Inherited from
setMirror
▸ setMirror(mirror
): void
Set mirror mode
CanvasRenderer sets mirror mode of ResponsiveCanvas.
Parameters
Name | Type | Description |
---|---|---|
mirror | boolean | Mirror the output |
Returns
void
Inherited from
setMode
▸ setMode(mode
): void
Set fitting mode
CanvasRenderer sets fitting mode of ResponsiveCanvas.
Parameters
Name | Type | Description |
---|---|---|
mode | CanvasMode | Fitting mode |
Returns
void
Inherited from
setupCamera
▸ setupCamera(ratio
, angle
): void
Set camera parameters
Setups BabylonRenderer#camera instance according to parameters provided by @geenee/armature!Processor.
Parameters
Name | Type | Description |
---|---|---|
ratio | number | Aspect ration of input video |
angle | number | Vertical field of view in radians |
Returns
void
Overrides
setupVideo
▸ setupVideo(size
, ratio?
): void
Set video parameters
Callback sets up size of video canvas layer, resizes texture and allocates new storage.
Parameters
Name | Type | Description |
---|---|---|
size | Size | Resolution of input video |
ratio? | number | Aspect ration of input video |
Returns
void
Inherited from
unload
▸ unload(): void
Reset renderer
Releases all resources and instances created in load(). Releases rendering context, shader program and buffers.
Returns
void
Inherited from
update
▸ update(result
, stream
): Promise
<void
>
Update the scene
Renderers input video frame on corresponding canvas layer.
Parameters
Name | Type | Description |
---|---|---|
result | ResultT | Results of video processing |
stream | HTMLCanvasElement | Captured video frame |
Returns
Promise
<void
>
Promise resolving when update is finished
Inherited from
updatePads
▸ Protected
updatePads(stream
): void
Update padding canvases
Updates padding canvases using portions of video frame.
Parameters
Name | Type | Description |
---|---|---|
stream | HTMLCanvasElement | Captured video frame |
Returns
void
Inherited from
updatePlugins
▸ Protected
updatePlugins(result
, stream
): Promise
<void
>
Update attached plugins
Calls update() of all attached plugins.
Parameters
Name | Type | Description |
---|---|---|
result | ResultT | Results of video processing |
stream | HTMLCanvasElement | Captured video frame |
Returns
Promise
<void
>
Promise resolving when update is finished
Inherited from
updateScene
▸ Protected
updateScene(): void
Update and render the scene
Virtual method updating and rendering 3D scene.
For babylon.js engine calls this.scene.render()
.
Returns
void
Overrides
updateVideo
▸ Protected
updateVideo(stream
): void
Update the video layer
Calls rendering shaders with current input texture.
Parameters
Name | Type | Description |
---|---|---|
stream | HTMLCanvasElement | Captured video frame |
Returns
void