gstreamer mp4 not working

Alexander Berndt · Oct 5th 2017

Hello Experts,

I´ve problems streaming an mp4 videofile.
Aim is to play the video from QML, but the problems started by trying to play the videofile without QML. I tried

Code

# gst-launch-1.0 playbin uri=file:///Core/Videos/Testvideo20komp.mp4

and got this error message:

Code

Missing element: MPEG-4 AAC decoder

Code

Missing decoder: MPEG-4 AAC

Code

ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
Freeing pipeline ...

Talking to one of your collegues, I added

Code

Target packages -> Audio and video applications -> gst1-plugins-bad -> openh264
Target packages -> Audio and video applications -> gst1-plugins-bad -> voaacenc

to the menuconfig, did a make clean and builded the rootfs again.
Trying to play the videofile, I got almost the same error-output:

Code

# gst-launch-1.0 playbin uri=file:///mnt/Testvideo20komp.mp4
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
====== AIUR: 4.0.9 build on Oct 4 2017 13:34:15. ======
Core: MPEG4PARSER_06.09.22 build on Jan 12 2016 13:29:32
file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.2
------------------------
Track 00 [video_0] Enabled
Duration: 0:01:30.023000000
Language: und
Mime:
video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format=(string)avc, width=(int)480, height=(int)242, framerate=(fraction)30000/1001, codec_data=(buffer)014d4028ffe1001c674d4028eca0f043f1180b506010640000030004000afc803c60c65801000568eae1b2c8
------------------------
Missing element: H.264 decoder
WARNING: from element /GstPlayBin:playbin0/GstURIDecodeBin:uridecodebin0: No decoder available for type 'video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format=(string)avc, width=(int)480, height=(int)242, framerate=(fraction)30000/1001, codec_data=(buffer)014d4028ffe1001c674d4028eca0f043f1180b506010640000030004000afc803c60c65801000568eae1b2c8'.
Additional debug info:
gsturidecodebin.c(939): unknown_type_cb (): /GstPlayBin:playbin0/GstURIDecodeBin:uridecodebin0
------------------------
Track 01 [audio_0] Enabled
Duration: 0:01:30.069000000
Language: eng
Mime:
audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)48000, bitrate=(int)0, stream-format=(string)raw, codec_data=(buffer)119056e500
------------------------
Missing element: MPEG-4 AAC decoder
ERROR: from element /GstPlayBin:playbin0/GstURIDecodeBin:uridecodebin0: Your GStreamer installation is missing a plug-in.
Additional debug info:
gsturidecodebin.c(1006): no_more_pads_full (): /GstPlayBin:playbin0/GstURIDecodeBin:uridecodebin0:
no suitable plugins found:
gstdecodebin2.c(4565): gst_decode_bin_expose (): /GstPlayBin:playbin0/GstURIDecodeBin:uridecodebin0/GstDecodeBin:decodebin0:
no suitable plugins found:
Missing decoder: MPEG-4 AAC (audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)48000, bitrate=(int)0, stream-format=(string)raw, codec_data=(buffer)119056e500, framed=(boolean)true, level=(string)2, base-profile=(string)lc, profile=(string)lc)
Missing decoder: H.264 (video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format=(string)avc, width=(int)480, height=(int)242, framerate=(fraction)30000/1001, codec_data=(buffer)014d4028ffe1001c674d4028eca0f043f1180b506010640000030004000afc803c60c65801000568eae1b2c8)
ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
Freeing pipeline ...

Display More

Can you please give me the minimum needed package configuration to play a videofile including sound with gstreamer. I did understand, that I first need to be able to run the video without QML, before trying to play with QML MediaPlayer oder QML Video.

Hope you can help me, as Iam not experienced with gstreamer.

Alexander Berndt · Oct 9th 2017

I took more time installing some things packages like opencv, opencv2.4 and ended with libav.
After another make clean, I got this message:

Code

# gst-launch-1.0 playbin uri=file:///mnt/Testvideo20komp.mp4
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...
====== AIUR: 4.0.9 build on Oct 9 2017 13:10:46. ======
Core: MPEG4PARSER_06.09.22 build on Jan 12 2016 13:29:32
file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.2
------------------------
Track 00 [video_0] Enabled
Duration: 0:01:30.023000000
Language: und
Mime:
video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format=(string)avc, width=(int)480, height=(int)242, framerate=(fraction)30000/1001, codec_data=(buffer)014d4028ffe1001c674d4028eca0f043f1180b506010640000030004000afc803c60c65801000568eae1b2c8
------------------------
display(/dev/fb0) resolution is (480x272).
====== OVERLAYSINK: 4.0.9 build on Oct 9 2017 13:10:52. ======
display(/dev/fb0) resolution is (480x272).
------------------------
Track 01 [audio_0] Enabled
Duration: 0:01:30.069000000
Language: eng
Mime:
audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)48000, bitrate=(int)0, stream-format=(string)raw, codec_data=(buffer)119056e500
------------------------
Redistribute latency...
Redistribute latency...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
ERROR: pipeline doesn't want to play.
Setting pipeline to NULL ...
Freeing pipeline ...

Display More

So far, I see that the missing ecoders/decoders are found now, but the pipeline is not played.
However, no sign whats wrong now.
I would be happy if someone can help me.

fs-support_HK · Nov 22nd 2017

The i.MX6-SoloX CPU (and therefore the efusA9X) does not have a hardware video processing unit (VPU). So all video processing must be done in software. But H.264 (MPEG-4 AVC) decoding in software does not make sense. The computing required to do this is so intense that the result will not have an acceptable frame rate. This is why we did not add any MPEG-4 codecs to our standard configuration in the first place. You can try MPEG-2, there the computation is less complex. But I would guess that even there a full-screen video with smooth playback is not possible.

In your later examples, you seem to have added the i.MX6 video libraries. But these libraries fail because the VPU hardware that they expect is not present on this CPU. For example the AIUR demuxer is a hardware demuxer that does not work on i.MX6-SoloX. As a fact this SoloX CPU is unfortunately not suited well for audio/video processing.

So MPEG-4 (either H.263 or H.264) is too complex for this CPU. If MPEG-4 is a prerequisite, then you have a big problem. MPEG-2 may work, so if you can move to MPEG-2, then you may have a chance. You also have to look at the audio codecs. MP2 or MP3 may work, more complex stream types (like MPEG-4 AAC) also produce a much higher CPU load, which is probably not necessary just for having audio.

By the way, many of these formats require licenses from the MPEG License Association (MPEG-LA) or other entities (e.g. Dolby Laboratories for AC3 a.k.a. Dolby Digital). You are responsible for yourself to request and pay for these licenses. There are no audio or video licenses included with the module.

Your F&S Support Team

gstreamer mp4 not working

Share

Similar Threads

UART interfaces refuse to set baudrate to 1 Mbps

Lcd Display driver

Build Kernel Error

GStreamer H.264 FullHD bad performance

Qt and gstreamer - video decoding