U4 crash playing H.265 files created using latest handbrake

[gtwundke]

I've successfully used Handbrake v1.1.x to create MKVs with HEVC-encoded video for quite a while now. All of these files have played fine on my U4 (running the latest Beta firmware).

However, a week or two ago I noticed Handbrake v1.2.0 was out and updated it. Now, whenever I play a HEVC-encoded video created using this version, my U4 immediately reboots, usually creating a crash log, but not always. Oddly enough, a lot of the time as the beyonwiz reboots I can hear the audio of the file playing while the boot background image and spinner is showing, right up until the DVB broadcast kicks in.

I've pinpointed the cause to be the H.265 video by creating all manner of different versions of the same video (i.e. different container, different video codec, different video options, no audio/subtitles, remuxing the mkv, etc, etc).

The problem is likely caused by the x265 library being updated from v2.6 to v2.9 in the newest version of Handbrake, although I have no idea what's changed in x265 to cause this breakage. All of the files play fine on my Windows PC, and there doesn't seem to be anything amiss in MediaInfo.

I was reading Playing 4k media files causing crashes and wondered whether perhaps the profile had somehow changed, but they're all encoded using the Main profile, level 3.

If you want to test this yourself, here's a link to two files (about 3mb each), both using the same encoding settings, but one encoded with Handbrake 1.1.2 (works) and one encoded with Handbrake 1.2.0 (crashes):
https://www.dropbox.com/s/ogsjj75inx44b ... 2.mkv?dl=0
https://www.dropbox.com/s/q0sg1v84t82tj ... 0.mkv?dl=0

I've also attached a crash log, although unfortunately it doesn't show much.

Here's a MediaInfo report for the non-working file:

Code: Select all

General
Unique ID                                : 267524928873198334742255735585000026567 (0xC9436D58F6295BBA7D7A51D62AF271C7)
Complete name                            : Y:\Video\Test\ScrubsTest-1.2.0.mkv
Format                                   : Matroska
Format version                           : Version 4
File size                                : 2.73 MiB
Duration                                 : 33 s 784 ms
Overall bit rate                         : 678 kb/s
Encoded date                             : UTC 2019-01-04 16:24:02
Writing application                      : HandBrake 1.2.0 2018121700
Writing library                          : Lavf58.20.100
ErrorDetectionType                       : Per level 1

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main@L3@Main
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 33 s 600 ms
Bit rate                                 : 472 kb/s
Width                                    : 704 pixels
Height                                   : 570 pixels
Display aspect ratio                     : 4:3
Frame rate mode                          : Constant
Frame rate                               : 25.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Bits/(Pixel*Frame)                       : 0.047
Stream size                              : 1.89 MiB (69%)
Writing library                          : x265 2.9:[Windows][GCC 7.1.0][64 bit] 8bit+10bit+12bit
Encoding settings                        : cpuid=1049583 / frame-threads=3 / numa-pools=8 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=704x570 / interlace=0 / total-frames=0 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=25 / keyint=250 / gop-lookahead=0 / bframes=4 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=0 / scenecut=40 / radl=0 / no-intra-refresh / ctu=64 / min-cu-size=8 / no-rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / no-strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=57 / temporal-mvp / weightp / no-weightb / no-analyze-src-pics / deblock=0:0 / sao / no-sao-non-deblock / rd=4 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / psy-rdoq=1.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=21.0 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / ipratio=1.40 / pbratio=1.30 / aq-mode=1 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=255 / sar-width / : / sar-height=16:15 / overscan=0 / videoformat=5 / range=0 / colorprim=5 / transfer=1 / colormatrix=6 / chromaloc=0 / display-window=0 / max-cll=0,0 / min-luma=0 / max-luma=255 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / no-opt-cu-delta-qp / no-aq-motion / no-hdr / no-hdr-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=5 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-mv-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei
Default                                  : Yes
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.601 PAL
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.601

Audio
ID                                       : 2
Format                                   : AC-3
Format/Info                              : Audio Coding 3
Commercial name                          : Dolby Digital
Codec ID                                 : A_AC3
Duration                                 : 33 s 728 ms
Bit rate mode                            : Constant
Bit rate                                 : 192 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Delay relative to video                  : -184 ms
Stream size                              : 791 KiB (28%)
Title                                    : Stereo
Language                                 : English
Service kind                             : Complete Main
Default                                  : Yes
Forced                                   : No

Text #1
ID                                       : 3
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Language                                 : English
Default                                  : No
Forced                                   : No

Text #2
ID                                       : 4
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Language                                 : English
Default                                  : No
Forced                                   : No

Menu
00:00:00.184                             : :Chapter 4

And for reference, here's one for the working file:

Code: Select all

General
Unique ID                                : 141961638937526219259647801994786581681 (0x6ACCD12FFB8EAED391D2ADD6AB172CB1)
Complete name                            : Y:\Video\Test\ScrubsTest-1.1.2.mkv
Format                                   : Matroska
Format version                           : Version 4
File size                                : 2.73 MiB
Duration                                 : 33 s 784 ms
Overall bit rate                         : 678 kb/s
Encoded date                             : UTC 2019-01-04T17:07:27Z
Writing application                      : HandBrake 1.1.2 2018090500
Writing library                          : Lavf57.7.2

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main@L3@Main
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 33 s 800 ms
Bit rate                                 : 472 kb/s
Width                                    : 704 pixels
Height                                   : 570 pixels
Display aspect ratio                     : 4:3
Original display aspect ratio            : 4:3
Frame rate mode                          : Constant
Frame rate                               : 25.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Bits/(Pixel*Frame)                       : 0.047
Stream size                              : 1.90 MiB (70%)
Writing library                          : x265 2.6:[Windows][GCC 7.3.0][64 bit] 8bit+10bit+12bit
Encoding settings                        : cpuid=1050111 / frame-threads=3 / numa-pools=8 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=704x570 / interlace=0 / total-frames=0 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=25 / keyint=250 / bframes=4 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=0 / scenecut=40 / no-intra-refresh / ctu=64 / min-cu-size=8 / no-rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / no-strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=57 / temporal-mvp / weightp / no-weightb / no-analyze-src-pics / deblock=0:0 / sao / no-sao-non-deblock / rd=4 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / psy-rdoq=1.00 / no-rd-refine / analysis-reuse-mode=0 / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=crf / crf=21.0 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / ipratio=1.40 / pbratio=1.30 / aq-mode=1 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=255 / sar-width / : / sar-height=16:15 / overscan=0 / videoformat=5 / range=0 / colorprim=5 / transfer=1 / colormatrix=6 / chromaloc=0 / display-window=0 / max-cll=0,0 / min-luma=0 / max-luma=255 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / no-opt-cu-delta-qp / no-aq-motion / no-hdr / no-hdr-opt / no-dhdr10-opt / analysis-reuse-level=5 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-mv-type=0 / copy-pic=1
Default                                  : Yes
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.601 PAL
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.601

Audio
ID                                       : 2
Format                                   : AC-3
Format/Info                              : Audio Coding 3
Commercial name                          : Dolby Digital
Codec ID                                 : A_AC3
Duration                                 : 33 s 784 ms
Bit rate mode                            : Constant
Bit rate                                 : 192 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Delay relative to video                  : -184 ms
Stream size                              : 792 KiB (28%)
Title                                    : Stereo
Language                                 : English
Service kind                             : Complete Main
Default                                  : Yes
Forced                                   : No

Text #1
ID                                       : 3
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Language                                 : English
Default                                  : No
Forced                                   : No

Text #2
ID                                       : 4
Format                                   : VobSub
Codec ID                                 : S_VOBSUB
Codec ID/Info                            : Picture based subtitle format used on DVDs
Language                                 : English
Default                                  : No
Forced                                   : No

I'm guessing there's not much that can be done in the short term, but it would be helpful to at least have someone else confirm that the same issue happens on their U4.

Tim

[prl]

I can confirm that ScrubsTest-1.2.0.mkv crashes my test U4. The information in the crash log is meagre, but the final line says that the cause of the crash is a SIGSEGV (signal 11), which means that the program accessed a location that's outside of the program's valid address range(s), for example, it accessed memory via a NULL pointer.

By guess would be that the problem happened in the GStreamer library, but there's no direct evidence in the crash log that that's where the crash happened.

[Paul_oz53]

Actually, this bug affects webm files too. I had a crash a few days ago playing a webm encoded with the Lavc57.107.100 libvpx-vp9 writing library. I chose to ignore it at the time. Here are the mediainfo and crash logs. I note prl's comment that it is probably in the gstreamer library that the crash occurred. My crash log is similarly devoid of details.

Code: Select all

General
Complete name                            : E:\Beyonwiz\.Trash\Download.webm
Format                                   : WebM
Format version                           : Version 4
File size                                : 43.7 MiB
Duration                                 : 17 min 45 s
Overall bit rate                         : 344 kb/s
Writing application                      : Lavf57.83.100
Writing library                          : Lavf57.83.100

Video
ID                                       : 1
Format                                   : VP9
Codec ID                                 : V_VP9
Duration                                 : 17 min 44 s
Width                                    : 468 pixels
Height                                   : 240 pixels
Display aspect ratio                     : 1.950
Frame rate mode                          : Constant
Frame rate                               : 30.000 FPS
Writing library                          : Lavc57.107.100 libvpx-vp9
Default                                  : Yes
Forced                                   : No

Audio
ID                                       : 2
Format                                   : Opus
Codec ID                                 : A_OPUS
Duration                                 : 17 min 45 s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Bit depth                                : 32 bits
Compression mode                         : Lossy
Writing library                          : Lavc57.107.100 libopus
Default                                  : Yes
Forced                                   : No

[glen]

Glad I saw this. Just checked the stuff I had been reencoding over the holidays (the free up space on my NAS). None of it works. All okay on my PC though.

I have been using FFmpeg Batch A/V for the reencoding. Not sure what version of FFmpeg it uses. I did upgrade to v1.6.4 this morning and it did indicate that it contained a new version of FFmpeg but I wasn't paying attention to the version. That said files that I had encoded on an earlier version are not playing either.

This is a major issue for me.

[Twizzle]

Sorry for the ignorance but what is Handbrake and do you have to call on it or is it part of U4s firmware?

[netmask]

Sorry for the ignorance but what is Handbrake and do you have to call on it or is it part of U4s firmware?

https://handbrake.fr/

[gtwundke]

I can confirm that ScrubsTest-1.2.0.mkv crashes my test U4.

Thanks for the confirmation Peter.

The information in the crash log is meagre, but the final line says that the cause of the crash is a SIGSEGV (signal 11), which means that the program accessed a location that's outside of the program's valid address range(s), for example, it accessed memory via a NULL pointer.

Can we get the U4 to dump a core file when a segfault occurs? We could at least then examine that and get more information.

By guess would be that the problem happened in the GStreamer library, but there's no direct evidence in the crash log that that's where the crash happened.

Yeah, my guess was GStreamer as well. I wonder what's involved with updating the version of GStreamer...? My guess is only peteru would be able to do it, and it would potentially be a huge pain.

Tim.

[gtwundke]

Glad I saw this. Just checked the stuff I had been reencoding over the holidays (the free up space on my NAS). No of it works. All okay on my PC though.

Sorry to hear that Glen! I'm glad that I just happened to want to watch the first thing that I encoded with the new version, and so saw the issue straight away.

I have been using FFmpeg Batch A/V for the reencoding. Not sure what version of FFmpeg it uses. I did upgrade to v1.6.4 this morning and it did indicate that it contained a new version of FFmpeg but I wasn't paying attention to the version. That said files that I had encoded on an earlier version are not playing either.

Your mention of FFmpeg actually gives me an idea. Assuming that FFmpeg stays relatively up-to-date with x265 releases, it may be easy enough to track down which version causes issues by encoding a file with different FFmpeg releases. I'll perhaps give this a try during the week sometime.

Tim.

[glen]

Sorry to hear that Glen! I'm glad that I just happened to want to watch the first thing that I encoded with the new version, and so saw the issue straight away.

Yeah I am pretty unhappy. I have probably encoded up to 70 - 80 files over the last fortnight. All of it archival stuff so I didn't have any reason to watch it on the U4. I just check it was okay on my PC and then deleted the original.

So now I have a lot of stuff I can't watch on my U4. Damn. At least my Sony TV can still play it with the Kodi app so that is something. I am pretty annoyed with myself though.

I thought that we were reasonably up to date with the GStreamer, I doubt we are more than about 6 months behind. IanSav normally keeps a close eye on the GStreamer versions, he probably knows what is the latest available version and what version is in the current U4 firmware.

Until PeterU is able to build new firmware versions again I doubt that there is much that can be done.

Prl is there any way of updating the GStreamer version manually? This assumes that an appropriately compiled version is available from somewhere which may not even be a given.

[IanSav]

Hi Glen,

I thought that we were reasonably up to date with the GStreamer, I doubt we are more than about 6 months behind. IanSav normally keeps a close eye on the GStreamer versions, he probably knows what is the latest available version and what version is in the current U4 firmware.

Until PeterU is able to build new firmware versions again I doubt that there is much that can be done.

Beyonwiz is using Gstreamer 1.15.0. The latest build is 1.14.4. (The 1.15.x series is a development branch while the 1.14.x series is the maintained / updated production code.) I tried to find what the latest 1.15.x series build was but didn't find it in the time I had available. It appears that 1.15.0 was built earlier in 2018 while 1.14.4 was built in October 2018.

Regards,
Ian.

[glen]

IanSav, thanks for that info. That makes it harder if we are on a dev version that is ahead of prod.

I had a quick look on the GStreamer website and couldn't find any reference to 1.15.x at all. Access to it must be restricted.

[IanSav]

Hi Glen,

OpenViX are using 1.14.4.

I assume that 1.15.x is being developed but it will NEVER be a released version. When work on 1.15.x is completed then version 1.16.0 will be released.

Regards,
Ian.

[glen]

Looks like there may be a 1.15.0.1.

IanSav your assumption appears to be correct that 1.15 will never be released, this doc https://github.com/GStreamer/gstreamer/ ... er/RELEASE says

"This is GStreamer core 1.15.0.1. GStreamer 1.15 is the development version leading up to the next major stable version which will be 1.16."

That document for 1.15.0.1 was dated 20 Mar 2018 so 1.15.0 would be older again.

1.14.4 was released in Oct 2018, so it is a new version than 1.15.0 (despite the version numbers).

PeterU can we go/revert to 1.14.4 in the next firmware given that 1.15.0 and 1.15.1 appear pretty old, or are there other considerations that required 1.15.0?

[sub3R]

After reading this topic I was concerned that the current version of VidCoder 3.16 (64 bit) I have, which is based on HandBrake, could also cause a crash.

So using the H.265 MKV 720p30 preset in the up to date version of VidCoder 3.16 (64 bit) which is based on HandBrake 1.1.2, I encoded gtwundke’s sample that is reported as crashing a U4.

When played back on our U4 over the LAN it plays fine & doesn’t crash. I haven’t tried to compare video quality though.

... I have probably encoded up to 70 - 80 files over the last fortnight. All of it archival stuff so I didn't have any reason to watch it on the U4. I just check it was okay on my PC and then deleted the original.

So now I have a lot of stuff I can't watch on my U4.

Glen, would it be worthwhile re-encoding those videos using suitable settings in VidCoder so you can at least watch those videos on your U4?

[Grumpy_Geoff]

Prl is there any way of updating the GStreamer version manually? This assumes that an appropriately compiled version is available from somewhere which may not even be a given.

Rollback to 20180417 and try that version as it has GStreamer 1.14.0 included.
Don't forget to backup your settings first.

[glen]

Hi Geoff

Problem is, if it is a recent change as a result of FFmpeg being update then chances are only the latest 1.14.x version, which is 1.14.4, may be compatible.

Pure guesses though.

Glen

[glen]

Glen, would it be worthwhile re-encoding those videos using suitable settings in VidCoder so you can at least watch those videos on your U4?

It would be a lot of work, and I don't have the originals anymore so I would recoding a reencoded file so there would be another loss in quality.

For the moment I can play them using Kodi on my Sony TV so I have alternatives but I would like the U4 to be fixed though.

[gtwundke]

Hi Glen,
Beyonwiz is using Gstreamer 1.15.0. The latest build is 1.14.4. (The 1.15.x series is a development branch while the 1.14.x series is the maintained / updated production code.) I tried to find what the latest 1.15.x series build was but didn't find it in the time I had available. It appears that 1.15.0 was built earlier in 2018 while 1.14.4 was built in October 2018.

Hmm, I just used `opkg` on my beyonwiz to see what was installed, and it only mentions gstreamer 1.14.3. I may well be missing something with how that is all deployed though.

Note that 1.14.3 seems to have been released in mid September 2018, so it's pretty new.

Tim.

[prl]

Hmm, I just used `opkg` on my beyonwiz to see what was installed, and it only mentions gstreamer 1.14.3. I may well be missing something with how that is all deployed though.

That's what I see, too:

Code: Select all

root@beyonwizu4:~# opkg list-installed gstreamer1.0
gstreamer1.0 - 1.14.3+git18285+c81b2f6-r0.0
root@beyonwizu4:~#

[gtwundke]

After reading this topic I was concerned that the current version of VidCoder 3.16 (64 bit) I have, which is based on HandBrake, could also cause a crash.

So using the H.265 MKV 720p30 preset in the up to date version of VidCoder 3.16 (64 bit) which is based on HandBrake 1.1.2, I encoded gtwundke’s sample that is reported as crashing a U4.

Handbrake 1.1.2 works as expected; it's only Handbrake 1.2.0 that has the issue. Looking at the release notes for VidCoder it would seem they only updated to Handbrake 1.2.0 in VidCoder 4.25 Beta (on Dec 23 2018), so I wouldn't expect that you'd have any problems.

Tim.

[gtwundke]

Well, after much (much!) faffing around, I've finally managed to get enigma2 to dump a core file (although having just now worked out to do remote debugging, kinda wish I'd discovered that first!).

Obviously, without debug symbols, the backtrace is not as useful as it might otherwise be. Still, here's what it shows:

Code: Select all

#0  0x6e696664 in ?? ()
#1  0xaf533500 in ?? () from /usr/lib/gstreamer-1.0/libgstdvbvideosink.so
Backtrace stopped: previous frame identical to this frame (corrupt stack?)

So, it would seem that we're indeed in gstreamer land, but I'm not familiar enough with gdb to go much further at the moment.

Tim.

[sub3R]

... Looking at the release notes for VidCoder it would seem they only updated to Handbrake 1.2.0 in VidCoder 4.25 Beta (on Dec 23 2018), ...

Until this is fixed I must remember not to update to the next release version of VidCoder which will probably include HandBrake 1.2.0.

Hopefully the info in your last post will be helpful to someone in sorting this out.

The main reason for my earlier post was to let anyone who has been unfortunate to get caught with this to know that by re-encoding with VidCoder 3.16 (or HandBrake 1.1.2) the video that re-boots/crashes the U4 (that was encoded with Handbrake 1.2.0) can be made playable on the U4 at probably some expense of quality.

[gtwundke]

I know it's been quite a while since I posted this, but I just wanted to confirm that this issue has been fixed with the latest update that came through the beta feed (probably a month or so ago now... I've only just got around to testing it).