not all files deleted from movie folder

[gra]

I have noticed when looking in the \\BEYONWIZT3\Movie folder and the \BEYONWIZT4\Movie folder from windows file explorer there were a lot of *.ts.cuts files of programs that were deleted in the past.
my settings

setup-TV-Recording settings.jpg (11.81 KiB) Viewed 2089 times

This problem is across firmware 16.1.20170310 and 17.5.20170808.

I have tried 3 different ways to try and find the problem.
I have found that one of those way leaves the *.ts.cuts file in the \\BEYONWIZT3\Movie folder.

1. Most of the time we watch a program and then delete at the end of viewing it,
When i press the media button and play a program and by pressing the stop button and option 4

yes delete this movie and return to the movie list.jpg (8.09 KiB) Viewed 2089 times

this leaves a *.ts.cuts file in the \\BEYONWIZT3\Movie folder that has a time stamp of that time of deleting,
and the six files *.eit, *.ts, *.ts.ap, *.ts.cuts, *.ts.meta, *.ts.sc are moved to the \\BEYONWIZT3\Movie\.Trash folder and that *.ts.cuts file has an earlier time stamp.

2. When i press the media button and play a program and then press stop and then use option 3, Yes, and delete this movie, all six file are moved to the \\BEYONWIZT3\Movie\.Trash folder.

3. When i press the media button, select a program and the press the RED Delete button all six files are moved to the \\BEYONWIZT3\Movie\.Trash folder.

Thanks

[MrQuade]

This problem is across firmware 16.1.20170310 and 17.5.20170808.

Do you know if it was present in 4.4 too? or new to 16.1?

Just speculating if it could have anything to do with prl's enhancement that enabled the event markers to show in recordings while chaseplaying, or one of the other marker enhancements? Seems doubtful though.

[gra]

That I don't know.

[Grumpy_Geoff]

This problem is across firmware 16.1.20170310 and 17.5.20170808.

Do you know if it was present in 4.4 too? or new to 16.1?

Just speculating if it could have anything to do with prl's enhancement that enabled the event markers to show in recordings while chaseplaying, or one of the other marker enhancements? Seems doubtful though.

Are you thinking of issue #520 Start / End bookmarks missing on recordings? If so, the fix for that issue was committed in late May, well after 20170310 (16.1 General Release) that GRA states has the problem.

[MrQuade]

Are you thinking of issue #520 Start / End bookmarks missing on recordings? If so, the fix for that issue was committed in late May, well after 20170310 (16.1 General Release) that GRA states has the problem.

If that was the fix that enabled the start / end bookmarks to appear live during chaseplay then yes. The timeline of when that was introduced was not clear to me due to the extended time it was available in alpha form as a manual patch (I recalled the feature being available in 16.1).

If so, then that probably rules that out then.

[Grumpy_Geoff]

...
I have found that one of those way leaves the *.ts.cuts file in the \\BEYONWIZT3\Movie folder.

1. Most of the time we watch a program and then delete at the end of viewing it,
When i press the media button and play a program and by pressing the stop button and option 4
yes delete this movie and return to the movie list.jpg
this leaves a *.ts.cuts file in the \\BEYONWIZT3\Movie folder that has a time stamp of that time of deleting,
and the six files *.eit, *.ts, *.ts.ap, *.ts.cuts, *.ts.meta, *.ts.sc are moved to the \\BEYONWIZT3\Movie\.Trash folder and that *.ts.cuts file has an earlier time stamp.
...

I normally have 'Behaviour when a movie is stopped' as "Return to movie list" (the default value). As a test, I set it to your "Ask user" setting (config.usage.on_movie_stop=ask).
I played a movie, then pressed STOP, then selected 4 - Yes, delete this movie and return to the movie list. I don't have a stray *.ts.cuts file being left in /media/hdd/movie.
I've tried this three times.
Possibly another setting is causing this.

[gra]

I'll do a beta firmware refresh from USB later tonight on the T3 and run defaults and test it again.

[prl]

...
Just speculating if it could have anything to do with prl's enhancement that enabled the event markers to show in recordings while chaseplaying, or one of the other marker enhancements? Seems doubtful though.

It seems possible to me. If you're chase-playing a recording the .cuts file may get written after the files are moved in the delete operation. What I've done in that fix may change the relative timing.

If it can be verified, could someone please write up an issue and I'll have a look at it hen I'm back on board.

[Grumpy_Geoff]

It seems possible to me. If you're chase-playing a recording the .cuts file may get written after the files are moved in the delete operation. What I've done in that fix may change the relative timing.

I wasn't chaseplaying when I first tried the 'Ask user' value.

I have tested 'Ask user' when chaseplaying an active recording -
Still recording, no cuts file present:

Code: Select all

root@beyonwizt2:/media/hdd/movie# ls -altr '20170809 1718'*
-rw-r--r--    1 root     root           291 Aug  9 17:18 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.eit
-rw-r--r--    1 root     root           170 Aug  9 17:18 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.meta
-rw-r--r--    1 root     root        275312 Aug  9 17:29 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.sc
-rw-r--r--    1 root     root     259815060 Aug  9 17:29 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts
root@beyonwizt2:/media/hdd/movie#

Chaseplay the recording, then STOP and choose option "4: delete...", leaves a cuts file behind

Code: Select all

root@beyonwizt2:/media/hdd/movie#
root@beyonwizt2:/media/hdd/movie#
root@beyonwizt2:/media/hdd/movie# ls -altr '20170809 1718'*
-rw-r--r--    1 root     root            24 Aug  9 17:32 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.cuts
root@beyonwizt2:/media/hdd/movie#

This doesn't quite match what gra was reporting, as he mentions all six files of the recording fileset get moved and a copy of the cuts file with a later timestamp is present in /media/hdd/movie


Now looking later, I can see an orphaned access points file too (and the recording continued on being produced in .trash [timer end was 17:55])

Code: Select all

root@beyonwizt2:/media/hdd/movie# ls -altr ./.Trash/'20170809 1718'*
-rw-r--r--    1 root     root           291 Aug  9 17:18 ./.Trash/20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.eit
-rw-r--r--    1 root     root           172 Aug  9 17:32 ./.Trash/20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.meta
-rw-r--r--    1 root     root        926224 Aug  9 17:55 ./.Trash/20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.sc
-rw-r--r--    1 root     root     876937092 Aug  9 17:55 ./.Trash/20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts
root@beyonwizt2:/media/hdd/movie# ls -altr '20170809 1718'*
-rw-r--r--    1 root     root            24 Aug  9 17:32 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.cuts
-rw-r--r--    1 root     root         42096 Aug  9 17:55 20170809 1718 - 7TWO Perth - [R] Hell's Kitchen Australia.ts.ap
root@beyonwizt2:/media/hdd/movie#

[gra]

I've flashed the beta firmware 20170808 from USB and did not restore, did initial setup no plugins no other changes
1 i then recorded a program
then when the recording was finished i pressed the media button and played the program play a minute or more then stopped play
then back at the play list i deleted the file with the red button.
check the \\BEYONWIZT3\Movie folder and there was NO *.ts.cuts file
i then went to Menu>setup>tv>recording settings and changed the 'Behavior when a movie is stopped' to Ask user and saved
i then went back to press media button pressed on trash and highlighted the deleted program and green button moved it back to option 2 /media/hdd/movie which moved the program back to he movie list,
2 i then played the program from /media/hdd/movie folder and pressed the stop button and then option 4 Yes, delete this movie and return to movie list. i check the pc and this was the result

3 i rebooted the T3 and recorded another program finished the recording then played the program from /media/hdd/movie folder and pressed the stop button and then option 4 Yes, delete this movie and return to movie list. i check the pc and there was the *.ts.cuts file still in the /media/hdd/movie folder.

[MrQuade]

This doesn't quite match what gra was reporting, as he mentions all six files of the recording fileset get moved and a copy of the cuts file with a later timestamp is present in /media/hdd/movie

Does it make a difference if you select the delete option using the appropriate number button, or alternatively using the arrow buttons and OK?

I have observed at least one other instance in the Wiz GUI where the behaviour is slightly different when using the shortcut buttons vs the arrow and OK buttons.

[gra]

i normally use the arrow down method
i just tried using number 4 and the file is still there no change

[MrQuade]

i normally use the arrow down method
i just tried using number 4 and the file is still there no change

I was thinking more in terms of the slight difference that Grumpy_Geoff observed regarding the file dates.

[gra]

the time stamp on the file in the movie folder was the time of deletion

[prl]

The cuts file is normally written when 5he recording ends. If you chaseplay, it is written when the recording stops and then again when the chase play finishes, no matter in which order they happen.

[Grumpy_Geoff]

Recording and playback setting 'Behavior when a movie is stopped' set to "Ask user" -

Code: Select all

root@beyonwizt2:/media/hdd/movie# grep ask /etc/enigma2/settings
config.usage.on_movie_stop=ask

Recording present -

Code: Select all

root@beyonwizt2:/media/hdd/movie# ls -altr '20170802 2035'*
-rw-r--r--    1 root     root           188 Aug  2 20:34 20170802 2035 - Channel 9 Perth - Britain's Got Talent.eit
-rw-r--r--    1 root     root       4729184 Aug  2 23:24 20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.sc
-rw-r--r--    1 root     root            24 Aug  2 23:24 20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.cuts
-rw-r--r--    1 root     root        336688 Aug  2 23:24 20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.ap
-rw-r--r--    1 root     root     6291965952 Aug  2 23:24 20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts
-rw-r--r--    1 root     root           164 Aug  3 15:47 20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.meta
root@beyonwizt2:/media/hdd/movie#

Play the recording, STOP, cursor select option 4/Yes delete this movie and return to the movie list.
Orphaned cuts file remains, with different size and timestamp.
Trash now contains the complete fileset, cuts file is as per originally written -

Code: Select all

root@beyonwizt2:/media/hdd/movie# ls -altr '20170802 2035'*
-rw-r--r--    1 root     root            36 Aug 10 11:17 20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.cuts
root@beyonwizt2:/media/hdd/movie#
root@beyonwizt2:/media/hdd/movie#
root@beyonwizt2:/media/hdd/movie# ls -altr ./.Trash/'20170802 2035'*
-rw-r--r--    1 root     root           188 Aug  2 20:34 ./.Trash/20170802 2035 - Channel 9 Perth - Britain's Got Talent.eit
-rw-r--r--    1 root     root       4729184 Aug  2 23:24 ./.Trash/20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.sc
-rw-r--r--    1 root     root            24 Aug  2 23:24 ./.Trash/20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.cuts
-rw-r--r--    1 root     root        336688 Aug  2 23:24 ./.Trash/20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.ap
-rw-r--r--    1 root     root     6291965952 Aug  2 23:24 ./.Trash/20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts
-rw-r--r--    1 root     root           164 Aug  3 15:47 ./.Trash/20170802 2035 - Channel 9 Perth - Britain's Got Talent.ts.meta
root@beyonwizt2:/media/hdd/movie#

Move recording back to /media/hdd/movie
Test again, this time direct entry of "4" to select option 4/Yes delete this movie and return to the movie list
Same result
__________________________________________________________________________________

I don't know why this differs from my test of yesterday, apart from using the T4 y'day and the T2 today, and playing from a sub-directory?
So, try from a sub-directory. Move recording from trash to a sub-directory.
Test again - still have an updated orphaned cuts file.

Okay, let's try from the T4 then to check my sanity
Set setting as 'Ask'
Restore recording back to movie -

Code: Select all

root@beyonwizt4:/media/hdd/movie# ls -altr '20170801 1920'*
-rw-r--r--    1 root     root           202 Aug  1 19:19 20170801 1920 - 9HD Perth - The Block_ Street.eit
-rw-r--r--    1 root     root       5038624 Aug  1 21:05 20170801 1920 - 9HD Perth - The Block_ Street.ts.sc
-rw-r--r--    1 root     root        104176 Aug  1 21:05 20170801 1920 - 9HD Perth - The Block_ Street.ts.ap
-rw-r--r--    1 root     root     3490489780 Aug  1 21:05 20170801 1920 - 9HD Perth - The Block_ Street.ts
-rw-r--r--    1 root     root           184 Aug  3 21:05 20170801 1920 - 9HD Perth - The Block_ Street.ts.meta
-rw-r--r--    1 root     root            36 Aug  3 21:05 20170801 1920 - 9HD Perth - The Block_ Street.ts.cuts
root@beyonwizt4:/media/hdd/movie#

Play the recording, STOP, cursor select option 4/Yes delete this movie and return to the movie list.
No orphaned file present.
Trash now contains the complete fileset -

Code: Select all

root@beyonwizt4:/media/hdd/movie# ls -altr '20170801 1920'*
ls: 20170801 1920*: No such file or directory
root@beyonwizt4:/media/hdd/movie#
root@beyonwizt4:/media/hdd/movie# ls -altr ./.Trash/'20170801 1920'*
-rw-r--r--    1 root     root           202 Aug  1 19:19 ./.Trash/20170801 1920 - 9HD Perth - The Block_ Street.eit
-rw-r--r--    1 root     root       5038624 Aug  1 21:05 ./.Trash/20170801 1920 - 9HD Perth - The Block_ Street.ts.sc
-rw-r--r--    1 root     root        104176 Aug  1 21:05 ./.Trash/20170801 1920 - 9HD Perth - The Block_ Street.ts.ap
-rw-r--r--    1 root     root     3490489780 Aug  1 21:05 ./.Trash/20170801 1920 - 9HD Perth - The Block_ Street.ts
-rw-r--r--    1 root     root           184 Aug  3 21:05 ./.Trash/20170801 1920 - 9HD Perth - The Block_ Street.ts.meta
-rw-r--r--    1 root     root            36 Aug  3 21:05 ./.Trash/20170801 1920 - 9HD Perth - The Block_ Street.ts.cuts
root@beyonwizt4:/media/hdd/movie#

I'll see if I can spot any significant difference in settings between the units. I know there are usage differences as the T2 is primarily used by Mr. 8yo so is setup with that in mind.

[Grumpy_Geoff]

I didn't see anything obviously significantly different between the two settings files.
Could this be some sort of a race condition with the T4's faster processor doing a 'better' job? Oh wait, gra reported the issue occurs on the T3 and T4.

[gra]

all my testing has been on the T3 running beta firmware
my first post on this i did check the other T3 and T4 that run official release firmware and they presented the same issue
and i am not testing this issue in chaseplay. recordings have finished.

[prl]

There seem to be two apparently similar problems with distinct causes. Neither appears to be related to my recent changes to start/end marks.

When the "ask user" action is set for movie stop, and "delete and return to movie list" option is selected, the recording files are deleted, then playback is stopped. The latter writes the cuts file for the resume mark for the now deleted recording.

If a recording is deleted while it is still being recorded, it's done in the right order, recording stopped, then files deleted.

However, stopping the recording is done by setting the recording end time to the current time and kicking off the recording queue evaluation, which then stops the recording, which has now "completed".

However, the recording queue evaluation is done through a zero-length timer, which doesn't fire until the current processing, including file deletion, has completed and control returns to the application's main dispatch loop.

So when the recording is stopped, it will write its cuts file for its start/end marks.

[Grumpy_Geoff]

...
When the "ask user" action is set for movie stop, and "delete and return to movie list" option is selected, the recording files are deleted, then playback is stopped. The latter writes the cuts file for the resume mark for the now deleted recording.
...

In my case on the T4, I don't think the cuts file is written as there isn't one left in movies and the one moved to trash is untouched.
However, what you state is occuring on my T2 as an updated cuts file is left in movies.
Perhaps sometimes the move occurs faster on a T4 and when the code then gets around to updating the cuts file it is no longer present in movies and so the code aborts the update?

[prl]

Yes, there could be race conditions in either scenario; I haven't looked closely enough at how the deletes are none in either.