Warning for NTFS disks

Moderators: Gully, peteru

Post Reply
User avatar
peteru
Uber Wizard
Posts: 9741
Joined: Tue Jun 12, 2007 23:06
Location: Sydney, Australia
Contact:

Warning for NTFS disks

Post by peteru » Mon Oct 05, 2020 20:18

It has become apparent that allowing the use of NTFS as the primary drive is causing a lot of grief to people. This problem is compounded by the fact that a lot of drives being hooked up to the V2 appear to be left at factory default partitioning and formatting which is NTFS. The drive appears to work for a while. Eventually, the filesystem will require a check / repair and at that point the Beyonwiz firmware can not deal with NTFS and the user will experience a series of cascading issues. These will range from unreliable operation to boot loops and even complete data loss on the NTFS drive.

The only robust filesystem that is proven to work as reliably as possible is ext4. As much as I'd like to give the users a choice of filesystem, at the end of the day the Beyonwiz devices need to behave like appliances and have reliable operation. Filesystems other than ext4 have numerous shortcomings. The next best alternative is NFS from a reliable server connected using wired Ethernet, but even that can present some challenges.

I propose that the firmware needs to implement a warning system and caution the user that using NTFS for the primary drive is known to have problems. This check should be performed on every enigma2 start and the warning should give the user the option to ignore until next enigma 2 restart or format the HDD using ext4. I thought about also providing a never warn again option in the GUI, but I think that is too dangerous. Such an option may make sense as a manual setting, that can be added to the configuration by expert users that know what they are doing and are technically savvy.

Opinions / feedback?

"Beauty lies in the hands of the beer holder."
Blog.

User avatar
MrQuade
Uber Wizard
Posts: 11844
Joined: Sun Jun 24, 2007 13:40
Location: Perth

Re: Warning for NTFS disks

Post by MrQuade » Mon Oct 05, 2020 20:32

Agreed to all. Including the addition of the manual ignore setting.

Your right that it is pretty clear that it can't be relied upon given the lack of ability to fix errors.
Logitech Harmony Ultimate+Elite RCs
Beyonwiz T2/3/U4/V2, DP-S1 PVRs
Denon AVR-X3400h, LG OLED65C7T TV
QNAP TS-410 NAS, Centos File Server (Hosted under KVM)
Ubiquiti UniFi Managed LAN/WLAN, Draytek Vigor130/Asus RT-AC86U Internet
Pixel 4,5&6, iPad 3 Mobile Devices

prl
Wizard God
Posts: 32709
Joined: Tue Sep 04, 2007 13:49
Location: Canberra; Black Mountain Tower transmitters

Re: Warning for NTFS disks

Post by prl » Mon Oct 05, 2020 21:55

peteru wrote:
Mon Oct 05, 2020 20:18
I propose that the firmware needs to implement a warning system and caution the user that using NTFS for the primary drive is known to have problems. This check should be performed on every enigma2 start and the warning should give the user the option to ignore until next enigma 2 restart or format the HDD using ext4. I thought about also providing a never warn again option in the GUI, but I think that is too dangerous. Such an option may make sense as a manual setting, that can be added to the configuration by expert users that know what they are doing and are technically savvy.

That is pretty much all there, but it was designed with internal HDDs in mind. There may be some issues making it work correctly given the uncertainty about USB device mount order and naming.
Peter
T4 HDMI
U4, T4, T3, T2, V2 test/development machines
Sony BDV-9200W HT system
LG OLED55C9PTA 55" OLED TV

User avatar
MrQuade
Uber Wizard
Posts: 11844
Joined: Sun Jun 24, 2007 13:40
Location: Perth

Re: Warning for NTFS disks

Post by MrQuade » Mon Oct 05, 2020 22:22

My assumption would be that it brings to the warning for anything that is mounted as /hdd.

That will cover the basics for the average novice user with a single drive.

The warning might also benefit from displaying some info about the disk such as size and volume label of available so the user can identify the drive if they have perhaps accidentally booted up with a drive that they didn't intend to become /hdd..

Maybe something even smarter that checks against the configured location of the recording and timeshift directories.
Logitech Harmony Ultimate+Elite RCs
Beyonwiz T2/3/U4/V2, DP-S1 PVRs
Denon AVR-X3400h, LG OLED65C7T TV
QNAP TS-410 NAS, Centos File Server (Hosted under KVM)
Ubiquiti UniFi Managed LAN/WLAN, Draytek Vigor130/Asus RT-AC86U Internet
Pixel 4,5&6, iPad 3 Mobile Devices

Grumpy_Geoff
Uber Wizard
Posts: 6490
Joined: Thu Mar 05, 2009 22:54
Location: Perth

Re: Warning for NTFS disks

Post by Grumpy_Geoff » Mon Oct 05, 2020 22:49

MrQuade wrote:
Mon Oct 05, 2020 22:22
My assumption would be that it brings to the warning for anything that is mounted as /hdd.

That will cover the basics for the average novice user with a single drive.

That would miss the users with a microSD card for time shifting and backups and an external drive for recordings; a setup often recommended.
MrQuade wrote:
Mon Oct 05, 2020 22:22
Maybe something even smarter that checks against the configured location of the recording and timeshift directories.

Though that may not work on initial set up.

User avatar
MrQuade
Uber Wizard
Posts: 11844
Joined: Sun Jun 24, 2007 13:40
Location: Perth

Re: Warning for NTFS disks

Post by MrQuade » Mon Oct 05, 2020 23:01

Grumpy_Geoff wrote:
Mon Oct 05, 2020 22:49
That would miss the users with a microSD card for time shifting and backups and an external drive for recordings; a setup often recommended.
Not if it also checked the movie recording and timeshift locations.

Besides, I also said that it covers off the most basic setups for specifically this scenario (being a non basic setup). I'd normally say that anyone running microSD and hdd would be more advanced users, but our recent encounters on Whirlpool pretty much proved that otherwise.
Grumpy_Geoff wrote:
Mon Oct 05, 2020 22:49
MrQuade wrote:
Mon Oct 05, 2020 22:22
Maybe something even smarter that checks against the configured location of the recording and timeshift directories.

Though that may not work on initial set up.
Doesn't matter at initital startup. As soon as those locations are configured, then the warning can be displayed. And if not then, then on the next reboot. The user doesn't necessarily need to be told immediately, but nice if they can be.
Logitech Harmony Ultimate+Elite RCs
Beyonwiz T2/3/U4/V2, DP-S1 PVRs
Denon AVR-X3400h, LG OLED65C7T TV
QNAP TS-410 NAS, Centos File Server (Hosted under KVM)
Ubiquiti UniFi Managed LAN/WLAN, Draytek Vigor130/Asus RT-AC86U Internet
Pixel 4,5&6, iPad 3 Mobile Devices

Grumpy_Geoff
Uber Wizard
Posts: 6490
Joined: Thu Mar 05, 2009 22:54
Location: Perth

Re: Warning for NTFS disks

Post by Grumpy_Geoff » Mon Oct 05, 2020 23:13

MrQuade wrote:
Mon Oct 05, 2020 23:01
Doesn't matter at initital startup. As soon as those locations are configured, then the warning can be displayed. And if not then, then on the next reboot. The user doesn't necessarily need to be told immediately, but nice if they can be.

And be pissed off because they'd lose their new recordings :cry:
Much better if it could be caught at set up time.

User avatar
MrQuade
Uber Wizard
Posts: 11844
Joined: Sun Jun 24, 2007 13:40
Location: Perth

Re: Warning for NTFS disks

Post by MrQuade » Mon Oct 05, 2020 23:23

Grumpy_Geoff wrote:
Mon Oct 05, 2020 23:13
And be pissed off because they'd lose their new recordings :cry:
God forbid!

In any case, on first boot it will more than likely be mounted as /hdd and will be caught anyway.
Logitech Harmony Ultimate+Elite RCs
Beyonwiz T2/3/U4/V2, DP-S1 PVRs
Denon AVR-X3400h, LG OLED65C7T TV
QNAP TS-410 NAS, Centos File Server (Hosted under KVM)
Ubiquiti UniFi Managed LAN/WLAN, Draytek Vigor130/Asus RT-AC86U Internet
Pixel 4,5&6, iPad 3 Mobile Devices

Grumpy_Geoff
Uber Wizard
Posts: 6490
Joined: Thu Mar 05, 2009 22:54
Location: Perth

Re: Warning for NTFS disks

Post by Grumpy_Geoff » Mon Oct 05, 2020 23:28

MrQuade wrote:
Mon Oct 05, 2020 23:23
In any case, on first boot it will more than likely be mounted as /hdd and will be caught anyway.

Assuming no microSD card and no other USB drive attached :)

User avatar
MrQuade
Uber Wizard
Posts: 11844
Joined: Sun Jun 24, 2007 13:40
Location: Perth

Re: Warning for NTFS disks

Post by MrQuade » Mon Oct 05, 2020 23:59

Grumpy_Geoff wrote:
Mon Oct 05, 2020 23:28
Assuming no microSD card and no other USB drive attached :)
Then it gets caught later as soon as the user configures the directory for recording. I am really not following your line of thought here?
Logitech Harmony Ultimate+Elite RCs
Beyonwiz T2/3/U4/V2, DP-S1 PVRs
Denon AVR-X3400h, LG OLED65C7T TV
QNAP TS-410 NAS, Centos File Server (Hosted under KVM)
Ubiquiti UniFi Managed LAN/WLAN, Draytek Vigor130/Asus RT-AC86U Internet
Pixel 4,5&6, iPad 3 Mobile Devices

Grumpy_Geoff
Uber Wizard
Posts: 6490
Joined: Thu Mar 05, 2009 22:54
Location: Perth

Re: Warning for NTFS disks

Post by Grumpy_Geoff » Tue Oct 06, 2020 00:07

MrQuade wrote:
Mon Oct 05, 2020 23:59
Grumpy_Geoff wrote:
Mon Oct 05, 2020 23:28
Assuming no microSD card and no other USB drive attached :)
Then it gets caught later as soon as the user configures the directory for recording. I am really not following your line of thought here?

Well, it won't be mounted as /media/hdd. If it's detected when changing settings to assign /media/usb (or /media/sdc{n] e.t.c) as the recording drive then I imagine that'd suffice.

This has mostly been an issue since Beyonwiz apparently stopped reformatting the drives before shipping.
If they included a shipping note to warn the purchaser to reformat the drive before use then likely we'd not be hearing much of this issue, if at all.

User avatar
MrQuade
Uber Wizard
Posts: 11844
Joined: Sun Jun 24, 2007 13:40
Location: Perth

Re: Warning for NTFS disks

Post by MrQuade » Tue Oct 06, 2020 00:14

Grumpy_Geoff wrote:
Tue Oct 06, 2020 00:07
Well, it won't be mounted as /media/hdd. If it's detected when changing settings to assign /media/usb (or /media/sdc{n] e.t.c) as the recording drive then I imagine that'd suffice.
Did I not say that way back?
MrQuade wrote:
Mon Oct 05, 2020 23:01
As soon as those locations are configured, then the warning can be displayed. And if not then, then on the next reboot. The user doesn't necessarily need to be told immediately, but nice if they can be.
Logitech Harmony Ultimate+Elite RCs
Beyonwiz T2/3/U4/V2, DP-S1 PVRs
Denon AVR-X3400h, LG OLED65C7T TV
QNAP TS-410 NAS, Centos File Server (Hosted under KVM)
Ubiquiti UniFi Managed LAN/WLAN, Draytek Vigor130/Asus RT-AC86U Internet
Pixel 4,5&6, iPad 3 Mobile Devices

Grumpy_Geoff
Uber Wizard
Posts: 6490
Joined: Thu Mar 05, 2009 22:54
Location: Perth

Re: Warning for NTFS disks

Post by Grumpy_Geoff » Tue Oct 06, 2020 00:46

MrQuade wrote:
Tue Oct 06, 2020 00:14
Grumpy_Geoff wrote:
Tue Oct 06, 2020 00:07
Well, it won't be mounted as /media/hdd. If it's detected when changing settings to assign /media/usb (or /media/sdc{n] e.t.c) as the recording drive then I imagine that'd suffice.
Did I not say that way back?

But you said this...
MrQuade wrote:
Mon Oct 05, 2020 22:22
My assumption would be that it brings to the warning for anything that is mounted as /hdd.

Which as I point out, wouldn't be great, but what you said here is better...
MrQuade wrote:
Mon Oct 05, 2020 22:22
Maybe something even smarter that checks against the configured location of the recording and timeshift directories.
MrQuade wrote:
Tue Oct 06, 2020 00:14
MrQuade wrote:
Mon Oct 05, 2020 23:01
As soon as those locations are configured, then the warning can be displayed. And if not then, then on the next reboot. The user doesn't necessarily need to be told immediately, but nice if they can be.

I don't think it should be on the next reboot, as that may be unattended. You could then end up with recordings present.
It'd be much better to detect before that, for example at shut down, or when setting a timer, or similar.

prl
Wizard God
Posts: 32709
Joined: Tue Sep 04, 2007 13:49
Location: Canberra; Black Mountain Tower transmitters

Re: Warning for NTFS disks

Post by prl » Tue Oct 06, 2020 09:23

The current checks on the internal HDD are done at initial startup time. If the HDD isn't formatted as ext4, the user is offered the opportunity to format before proceeding.

The whole thing is rather more complicated when all the storage is external, and the recording HDD may not even be present, or if present, not mounted as /mnt/hdd, at initial startup (e.g. after a USB update).
Peter
T4 HDMI
U4, T4, T3, T2, V2 test/development machines
Sony BDV-9200W HT system
LG OLED55C9PTA 55" OLED TV

Post Reply

Return to “Developers Community”