Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Getting a frame from SurfaceView

The difficulty I am having now is to take a screenshot of the SurfaceView. Could anyone please help?

My team is doing an Android project where we use MediaCodec to decode the video feed and render the feed onto a Surface. The activity implements

SurfaceHolder.Callback

Then we created a SurfaceView and add the Callback:

mySurfaveView.getHolder().addCallback(this);

Then we start decode the video feed in (we have a method that does the decode)

surfaceChanged(SurfaceHolder holder, int format, int width, int height)

The video work fine, now I want to take screenshot of what gets rendered onto the SurfaceView. I have tried several ways to do this, but I didn't succeed. Following are what I have tried:

  1. I have tired getting rootView's drawingcache.
  2. Tried getting the frame directly from MediaCodec.
  3. Tried the draw() method to draw on a canvas.

As of now I am tring to create a custom SurfaceView and override the onDraw method there. However, I have never created a custom SurfaceView. Am I on the right direction?

Help please. Thank you!

like image 911
Chen Avatar asked Feb 11 '23 10:02

Chen


1 Answers

You can't capture a SurfaceView, as explained in this other question.

SurfaceViews will rarely want to override onDraw(). Generally the View part of the SurfaceView is a transparent hole.

For the specific case of MediaCodec output, you have a couple of choices. You can direct the output to a SurfaceTexture, and then render the video frame twice using OpenGL ES. Once to the SurfaceView for display, once to an off-screen buffer from which you can capture the pixels.

Another approach is to replace the SurfaceView with a TextureView, and then use the getBitmap() call to grab video frames.

Various examples can be found in Grafika.

like image 126
fadden Avatar answered Feb 13 '23 00:02

fadden