VideoProcessor support for LocalVideoTrack / CameraCaptureOptions

[rsysganeshpatwa]

[dganzella]

+1, I justr checked the code as well and Im so confused. Did you manager to implement a blur processor, @rsysganeshpatwa ?

[yashdeepsingh-create]

@dganzella and did you manage to implement any custom processor?

[dganzella]

@dganzella and did you manage to implement any custom processor?

yes. not me but a friend of mine. we used an open source paid library as reference, ping me in dm

[dganzella]

@dganzella and did you manage to implement any custom processor?

yes. not me but a friend of mine. we used an open source paid library as reference, ping me in dm

@yashdeepsingh-create check this out

livekit/client-sdk-android#388 (comment)

this diff is the code that needs to be adjusted:

main...EffectsSDK:livekit-client-sdk-flutter:main

the magic happens in:

extension VideoEffectsSDKExt on LocalVideoTrack

and then, later

  LocalVideoTrack._(
    TrackSource source,
    rtc.MediaStream stream,
    rtc.MediaStreamTrack track,
    this.currentOptions,
  ) : super(TrackType.VIDEO, source, stream, track);
  /// Creates a LocalVideoTrack from camera input.
  static Future<LocalVideoTrack> createCameraTrack([
    CameraCaptureOptions? options,
  ]) async {
    options ??= const CameraCaptureOptions();
    bool needWrapStream = options.effectsSdkRequired ?? false;

    final stream_ = await LocalTrack.createStream(options);
    final stream = needWrapStream? await rtc.VideoEffectsSdk.wrapStream(stream_) : stream_;

instead of adding an extension we simply adjsuted the Client SDK and removed the private constructors. so we extended LocalVideoTrack to implement our own, and we re implemented all the methods, wrapping the stream in the blurred stream

[yashdeepsingh-create]

@dganzella Thanks for the help! I really appreciate your guidance.