Re: [Linphone-developers] Problem with camera on Android with Samsung ta

it turns out the reason the webcam is not started on the Samsung tablets is because Camera.setPreviewDisplay()/Camera.setPreviewTexture() is never called. Indeed, the case of providing a Surface object is not covered by this code:

https://github.com/BelledonneCommunications/mediastreamer2/blob/master/java/src/org/linphone/mediastream/video/capture/AndroidVideoApi5JniWrapper.java#L129-L148

For the Android-x86 device, having a preview surface is not a requirement, but for the Samsung tablets, it's a no-go.

Given that Camera.setPreviewDisplay(surfaceHolder) is just the same as Camera.setPreviewSurface(surfaceHolder.getSurface()), but the latter is hidden API, I worked around the issue with the attached patch, which implements a trivial SurfaceHolder just for the sake of going through the Camera API.

With this change, the Samsung tablet webcam started to work. However, I noticed a huge amount of EGL errors generated (on the Android-x86 device). After tracing the code, I realized that there seemed to be 2 components trying to draw on the same Surface object:

- the Camera preview

- the MSAndroidTextureDisplay filter

Honestly, I don't know why this is happening. It doesn't make sense to have the MSAndroidTextureDisplay filter trying to draw on the Surface, as the Camera API will take care of that. As a temporary ugly hack, I came up with the second part of the patch, which disable the filter for the webcam stream. It's unlikely to be the right solution, in particular this piece of code makes me think there shouldn't be a MSAndroidTextureDisplay filter installed:

https://github.com/BelledonneCommunications/mediastreamer2/blob/master/src/voip/videostream.c#L1814-L1817

Could any linphone dev comment on the above?

Thanks,

Michael.

On Wed, Apr 15, 2020 at 1:53 PM Michael Goffioul <address@hidden> wrote:

Hi,

I'm using linphone-android SDK (org.linphone:linphone-sdk-android:4.3+) to build an audio/video SIP app, and I'm having problems with the webcam feed on Samsung tablets.

Linphone is used in an Android service. A client application binds to the service and interact with it through Android IPC. When the call is initially connected, video is disabled, and no native WindowId has been set yet. When the clients request to turn on video, the service executes the following:

  linphoneCall.enableCamera(true);
  CallParams params = mLinphoneCore.createCallParams(linphoneCall);
  params.enableVideo(true);
  linphoneCall.update(params);

The service then notifies the client (through IPC) that video is now active. The client creates 2 SurfaceView, and provides the underlying Surface objects to the service (again through IPC, Surface is parcelable). When the service receives the Surface objects, it executes:

  mLinphoneCore.setNativeVideoWindowId(remoteSurface);
mLinphoneCore.setNativePreviewWindowId(localSsurface);

AFAIK AndroidPlatformHelper can deal with raw surfaces provided.

This constructs works fine on an Intel device running Android-x86 (webcam is started, displayed locally and sent to remote party). But it doesn't work on 2 Samsung tablets I have: TabE/Android-7.1.1 and TabA/Android-8.1. I can see in the logs that the camera is initialized, but no preview starts and no data is sent to remote party.

I can provide full logs, if it helps. Any idea or suggestion would be welcome.

Michael.

From:	Michael Goffioul
Subject:	Re: [Linphone-developers] Problem with camera on Android with Samsung tablets
Date:	Thu, 16 Apr 2020 17:01:41 -0400