Search found 18 matches

Go to advanced search

by jldeon
Mon Jun 16, 2014 1:05 pm
Forum: Graphics programming
Topic: MMAL resizer?
Replies: 11
Views: 5892

Re: MMAL resizer?

Nope, I eventually gave up on it. I think the code in the library just doesn't exist to make it work.
by jldeon
Wed Jun 05, 2013 2:48 pm
Forum: Graphics programming
Topic: MMAL resizer?
Replies: 11
Views: 5892

MMAL resizer?

I'm trying to do some realtime video scaling in my RPi app. I'm using the MMAL library to interface with the RPi camera as part of the project as well. Right now I'm taking the camera output and piping it into a video splitter component, which I then plan to attach multiple encoder elements to in or...
by jldeon
Tue Jun 04, 2013 6:53 pm
Forum: Camera board
Topic: Capturing multiple video streams?
Replies: 2
Views: 1725

Re: Capturing multiple video streams?

Darn, if I could just link into the camera ports that would be simple. I'm not planning on encoding multiple 1080p30 streams, I'd like to do 720p30 + 360p30 + 180p30 if I can. The overall bitrate should be less than 1080p30, but there's overhead and so forth, so it will be more a matter of seeing wh...
by jldeon
Tue Jun 04, 2013 2:48 pm
Forum: Camera board
Topic: Capturing multiple video streams?
Replies: 2
Views: 1725

Capturing multiple video streams?

I'm trying to grab three simultaneous video streams off the RPi camera, each at a different resolution, as part of a video streaming app. I've come up with a couple of ways this could be done: Method #1 is to introduce some additional components into the pipeline to split the camera output at the ma...
by jldeon
Tue May 21, 2013 2:38 pm
Forum: OpenMAX
Topic: is real-time decoding possible?
Replies: 23
Views: 13385

Re: is real-time decoding possible?

I think I've driven the latency down to "good enough for the time being." I'll leave this thread with a few notes: I didn't see any difference in pulling the scheduler and clock out. Maybe 10's of milliseconds, but nothing significant. If you're going to write a VUI structure into the SPS at the dec...
by jldeon
Wed May 08, 2013 9:04 pm
Forum: OpenMAX
Topic: is real-time decoding possible?
Replies: 23
Views: 13385

Re: is real-time decoding possible?

The 2.7 seconds number is for a 180p, 7.5fps stream (not 1080p). With the VUI changed, it drops to ~600-700 msec. I stripped the RTP data off the stream, and the first three NALs are SPS, PPS, and then an IDR. I've got a scheduler/clock in there, I could potentially rip it out if it was causing my i...
by jldeon
Wed May 08, 2013 7:14 pm
Forum: OpenMAX
Topic: is real-time decoding possible?
Replies: 23
Views: 13385

Re: is real-time decoding possible?

In my code, I've added some instrumentation to measure the time the first buffer arrives, and then measure the time again when the first frame is rendered, and that's the measurement I'm using to gauge the latency. It's short enough now that it could appear instantaneous (or nearly so) to the naked ...
by jldeon
Wed May 08, 2013 5:40 pm
Forum: OpenMAX
Topic: is real-time decoding possible?
Replies: 23
Views: 13385

Re: is real-time decoding possible?

mpr, How were you measuring your first-frame delay? I modified the incoming SPS packet(s) to add a VUI+bitstream restriction fields, and set them as you had in your example. While the first frame delay got better, I'm still seeing 6-10 frames worth of latency at startup. I'm wondering what else I co...
by jldeon
Thu May 02, 2013 8:46 pm
Forum: Graphics programming
Topic: Horizontal & vertical flipping with egl_render
Replies: 3
Views: 2326

Re: Horizontal & vertical flipping with egl_render

I managed to reproduce the inconsistent behavior I'm observing in the hello_videocube demo code, so I submitted an issue and a Gist with the example code:

https://github.com/raspberrypi/firmware/issues/176
by jldeon
Thu May 02, 2013 8:05 pm
Forum: OpenMAX
Topic: OMX_IndexParamPortDefinition on video_decode port 130
Replies: 4
Views: 2364

Re: OMX_IndexParamPortDefinition on video_decode port 130

Changing the parameters and configs is very order-sensitive. Components have to be in certain states, events have to be sent at certain times, etc. I find this document gives me some clues as to how things should be ordered: http://www.khronos.org/registry/omxil/specs/OpenMAX_IL_1_2_0_Specification...
by jldeon
Thu May 02, 2013 7:58 pm
Forum: OpenMAX
Topic: is real-time decoding possible?
Replies: 23
Views: 13385

Re: is real-time decoding possible?

Just to add some hard numbers to this discussion... I've got a set of test videos that I'm attempting to play back with my Pi. The video is being streamed over RTP, so the frames should be arriving in real-time. I'm measuring the time between when the first buffer arrives at the decoder's input port...
by jldeon
Thu May 02, 2013 6:54 pm
Forum: OpenMAX
Topic: Changing the eglImage used by egl_render
Replies: 2
Views: 2936

Re: Changing the eglImage used by egl_render

I've managed to make some progress with this, although occasionally I end up with corrupted video after the port settings change and the new texture is in use. I consulted the OpenMAX IL spec and found Figure 3-23 "Dynamic Port Reconfiguration" which I used as a guide to write my code. However, the ...
by jldeon
Sat Apr 27, 2013 2:08 pm
Forum: OpenMAX
Topic: Changing the eglImage used by egl_render
Replies: 2
Views: 2936

Changing the eglImage used by egl_render

From testing, it appears that the egl_render OMX component will only render to a texture that is the same resolution as the data being passed into it. (Otherwise it renders nothing, which seems kind of odd...) I'm working on a streaming video receiver app, and the problem that I'm having is that I n...
by jldeon
Sat Apr 27, 2013 1:54 pm
Forum: Graphics programming
Topic: Horizontal & vertical flipping with egl_render
Replies: 3
Views: 2326

Re: Horizontal & vertical flipping with egl_render

It does appear that there is a performance impact for disabling these tunnels. I measured it at around 3-4fps on a particular sample 1080p30 video, although I believe the h.264 decoder behaves somewhat differently depending on the bitrate of the incoming encoded video stream, so your mileage may var...
by jldeon
Thu Apr 18, 2013 5:57 pm
Forum: OpenMAX
Topic: OMX_IndexParamPortDefinition on video_decode port 130
Replies: 4
Views: 2364

Re: OMX_IndexParamPortDefinition on video_decode port 130

Hmm, I must be doing something differently then. I'll take a look at the way they're calling it and compare against my code.
by jldeon
Thu Apr 18, 2013 4:33 pm
Forum: OpenMAX
Topic: OMX_IndexParamPortDefinition on video_decode port 130
Replies: 4
Views: 2364

OMX_IndexParamPortDefinition on video_decode port 130

I'm working on a video decode pipeline using the Raspberry Pi and OMX/ilclient. I'm experiencing a bottleneck in that I need to be able to accept a large number of small buffers and feed them into the video_decode component. I noticed that the default allocation is 20 buffers of 80k, which is a smal...
by jldeon
Thu Apr 18, 2013 3:12 pm
Forum: Graphics programming
Topic: Horizontal & vertical flipping with egl_render
Replies: 3
Views: 2326

Re: Horizontal & vertical flipping with egl_render

Here's another wrinkle - if I use OMX_IndexParamBrcmDisableProprietaryTunnels to set bUseBuffers to 1, the video renders to the texture in the correct orientation. Is this potentially a bug or issue with the way the proprietary tunnels are implemented? Are there any performance implications for disa...
by jldeon
Thu Apr 18, 2013 2:56 pm
Forum: Graphics programming
Topic: Horizontal & vertical flipping with egl_render
Replies: 3
Views: 2326

Horizontal & vertical flipping with egl_render

I've been attempting to render a video to a GL texture using the ilclient library and the OMX calls, as the example code shows (hello_pi/hello_video/video.c). However, instead of the video cube, I'm rendering to a texture created by Clutter/COGL. Everything works pretty well, except that the video i...

Go to advanced search