Skip to content

ThreeRenderer

Generic three.js renderer

Extends @geenee/armature!SceneRenderer for the three.js rendering engine. ThreeRenderer does basic initialization of engine, scene, and camera. It’s a generic class that should be parameterized by type of processing results to build an app using particular implementation of @geenee/armature!Processor.

ResultT extends object = { }

Type of processing results

new ThreeRenderer<ResultT>(container, mode?, mirror?, options?): ThreeRenderer<ResultT>

Constructor

HTMLElement

Container of @geenee/armature!ResponsiveCanvas

CanvasMode

Fitting mode

boolean

Mirror the output

WebGLRendererParameters

ThreeRenderer<ResultT>

SceneRenderer.constructor

protected camera: Camera

Camera instance


protected cameraAngle: number

Camera vertical angle in radians

SceneRenderer.cameraAngle


protected cameraRatio: number

Camera aspect ratio

SceneRenderer.cameraRatio


canvas: ResponsiveCanvas

Responsive canvas

SceneRenderer.canvas


current: null | WebGLTexture

Current image texture

SceneRenderer.current


optional input: ImageTexture

Input image texture

SceneRenderer.input


protected loaded: boolean

Loaded state

SceneRenderer.loaded


protected padCtx: [null | CanvasRenderingContext2D, null | CanvasRenderingContext2D]

Drawing context of padding canvases

SceneRenderer.padCtx


protected plugins: Plugin<ResultT>[]

Attached plugins

SceneRenderer.plugins


protected renderer: WebGLRenderer

Rendering engine


optional scene: Scene

Renderer scene

SceneRenderer.scene


protected setupPadding: () => void

Setup padding canvases

Callback sets up size of padding canvases.

void

SceneRenderer.setupPadding


protected optional shader: ShaderProgram

Rendering shader

SceneRenderer.shader


shaderCtx: null | WebGL2RenderingContext

Context of the video canvas layer

SceneRenderer.shaderCtx


protected videoRatio: number

Aspect ratio of input video

SceneRenderer.videoRatio


protected videoSize: Size

Resolution of input video

SceneRenderer.videoSize

addListener<E>(event, listener): this

Adds the listener function to the end of the listeners array

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

This EventEmitter

SceneRenderer.addListener


addPlugin(plugin): Promise<void>

Add render plugin

Initializes the plugin if it’s not loaded yet but renderer is ready. Renderer takes ownership of the plugin instance meaning it will release it when plugin is detached or renderer is disposed itself.

Plugin<ResultT>

Promise<void>

SceneRenderer.addPlugin


dispose(): void

Dispose renderer object

Extended to dispose scene object.

void

SceneRenderer.dispose


protected disposeObject(object): void

Dispose object

Helper method to remove object from the scene and recursively dispose it with all its children and allocated resources like materials and textures.

Object3D

Object to dispose

void


emit<E>(event, …args): boolean

Synchronously calls each of the listeners registered for the event

E extends keyof RendererEvents

E

The name of the event

Args<RendererEvents[E]>

Arguments passed to the listeners

boolean

True if the event had listeners, False otherwise

SceneRenderer.emit


eventNames(): (string | symbol)[]

List of emitter’s events

(string | symbol)[]

List of emitter’s events

SceneRenderer.eventNames


getMaxListeners(): number

Maximum number of listeners per event

number

Maximum number of listeners per event

SceneRenderer.getMaxListeners


listenerCount<E>(event): number

The number of listeners listening to the event

E extends keyof RendererEvents

E

The name of the event

number

Number of listeners

SceneRenderer.listenerCount


listeners<E>(event): Function[]

Copy of the array of listeners for the event

E extends keyof RendererEvents

E

The name of the event

Function[]

Copy of the listeners array

SceneRenderer.listeners


load(): Promise<void>

Initialize renderer

Initializes rendering context, shader program and buffers.

Promise<void>

Promise resolving when initialization is finished

SceneRenderer.load


off<E>(event, listener): this

Removes the listener from the listener array for the event

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

This EventEmitter

SceneRenderer.off


on<E>(event, listener): this

Adds the listener function to the event

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

This EventEmitter

SceneRenderer.on


once<E>(event, listener): this

Adds a one-time listener function for the event

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

This EventEmitter

SceneRenderer.once


prependListener<E>(event, listener): this

Adds the listener function to the beginning of the listeners array

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

This EventEmitter

SceneRenderer.prependListener


prependOnceListener<E>(event, listener): this

Adds a one-time listener function to the beginning of the listeners array

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

SceneRenderer.prependOnceListener


rawListeners<E>(event): Function[]

Copy of the array of listeners for the event including wrappers

E extends keyof RendererEvents

E

The name of the event

Function[]

Copy of the listeners array

SceneRenderer.rawListeners


removeAllListeners<E>(event?): this

Removes all listeners, or those of the specified event

E extends keyof RendererEvents

E

The name of the event

this

This EventEmitter

SceneRenderer.removeAllListeners


removeAllPlugins(): void

Remove all render plugins

Renderer will dispose all plugins before detaching them.

void

SceneRenderer.removeAllPlugins


removeListener<E>(event, listener): this

Removes the specified listener from the listener array

E extends keyof RendererEvents

E

The name of the event

RendererEvents[E]

The callback function

this

This EventEmitter

SceneRenderer.removeListener


removePlugin(plugin): void

Remove render plugin

Renderer will dispose the plugin before detaching it.

Plugin<ResultT>

void

SceneRenderer.removePlugin


setMaxListeners(n): this

Sets maximum number of listeners per event

number

Maximum number of listeners

this

This EventEmitter

SceneRenderer.setMaxListeners


setMirror(mirror): void

Set mirror mode

CanvasRenderer sets mirror mode of ResponsiveCanvas.

boolean

Mirror the output

void

SceneRenderer.setMirror


setMode(mode): void

Set fitting mode

CanvasRenderer sets fitting mode of ResponsiveCanvas.

CanvasMode

Fitting mode

void

SceneRenderer.setMode


setupCamera(ratio, angle): void

Set camera parameters

Setups ThreeRenderer#camera instance according to parameters provided by @geenee/armature!Processor.

number

Aspect ration of input video

number

Vertical field of view in radians

void

SceneRenderer.setupCamera


setupVideo(size, ratio?): void

Set camera parameters

If ThreeRenderer#camera is OrthographicCamera sets orthographic projection according to resolution of video.

Size

Resolution of input video

number

Aspect ration of input video

void

SceneRenderer.setupVideo


unload(): void

Reset renderer

Releases all resources and instances created in load(). Releases rendering context, shader program and buffers.

void

SceneRenderer.unload


update(result, stream): Promise<void>

Update the scene

Renderers input video frame on corresponding canvas layer.

ResultT

Results of video processing

HTMLCanvasElement

Captured video frame

Promise<void>

Promise resolving when update is finished

SceneRenderer.update


protected updatePads(stream): void

Update padding canvases

Updates padding canvases using portions of video frame.

HTMLCanvasElement

Captured video frame

void

SceneRenderer.updatePads


protected updatePlugins(result, stream): Promise<void>

Update attached plugins

Calls update() of all attached plugins.

ResultT

Results of video processing

HTMLCanvasElement

Captured video frame

Promise<void>

Promise resolving when update is finished

SceneRenderer.updatePlugins


protected updateScene(): void

Update and render the scene

Virtual method updating and rendering 3D scene. Basic implementation for three.js engine calls this.renderer.render(this.scene, this.camera).

void

SceneRenderer.updateScene


protected updateVideo(stream): void

Update the video layer

Calls rendering shaders with current input texture.

HTMLCanvasElement

Captured video frame

void

SceneRenderer.updateVideo