Hello guest, if you like this forum, why don't you register? https://fanrestore.com/member.php?action=register (December 14, 2021) x


Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
[Help] Blu-ray PiP (Picture-in-Picture) ripping/archival
#1
this is an idea ive had for a good while, but haven't really gotten that far: Blu-rau PiP (Picture-in-Picture) ripping/archival.

PiP is a kind of bonus feature where a secondary video stream is presented simultaniously alongside the main feature presentation. it allows interviews/commentary, BTS footage, etc. to be shown at relevant parts of a film, and imo its pretty neat.

[Image: 371cgD1.png]

while the vast majoirty of Blu-ray extras are just in the form of a video file, which is pretty easy to rip (and therefore archive outside of the Blu-ray format). however, PiP tracks are not. PiP video is a seperate video track which is composited onto the main video stream at playback.

it is possible to rip the PiP video and audio themselves; while MakeMKV seems to ignore the video, MKVToolnix will see and mux it just fine from a decrypted backup. the video seems to all be 720x480 and audio is 2.0 E-AC-3 or DTS-Express. the streams themselves offer little issue.

however, its not quite that simple. for starters, i have not encountered any player that will playback some kind of PiP image outside of Blu-ray player software (which only do it when playing back the Blu-ray itself). it doesnt seem too hard to overlay the video/audio in post, but there is some missing information unfortunately.

the PiP video/audio arent a constant. the video turns on and off, and the audio fades in and out (shifting the volume of the main audio alongside it). the video and audio come in and out at different points. the PiP video doesn't have a constant position, it can be shown in different corners. and finally, ive seen some titles show additional text onscreen.

and so, i'd like to look into the archival of these titles, so they can be as true to the disc as possible, while not being bound to the Blu-ray format. which basically means burning everything into a single video file. imo there are genuine reasons to do this. personally, i like to include extras on my media server and these are extras which i have and enjoy, but cant have on my media server, because they are more than just a video stream. but also just general archival stuff as a video file is so much more versatile than a Blu-ray backup.

ideally, it may be possible to generate a file from the PiP data on the Blu-ray itself; it could theoretically be done automatically for an arbitrary number of titles with no intermediate and custom quality settings. that being said, haven't made much progress in that direction. diving into the files of decrypted backups, ive found nothing. using BDedit, ive managed to extract some "PiP metadata" supposedly, but of the ones ive tried, some look to be tiny (<100 bytes) so not sure wut kind of data is here or how useful it may be, not to mention its in a binary format i have not been able to decypher.

alternate routes:

playback capture. ive managed to capture The Matrix's PiP presentation, its a bit shoddy if we're going for perfection but not bad in terms of viewing quality. capture of course requires full length playback and large intermediate files to try and maintain quality. could potentially get better if i can figure out how to capture a 24Hz image at 24fps rather than the 60fps capture i have. however if that doesnt shake out theres always:

manual reconstruction. capture can be used to simply obtain reference to be used to manually reconstruct the presentation in an editor. main downside is it takes a lot of time and may not be perfect. could be augmented with some automation like perhaps analysing the video/audio for black frames/silence to determine rough timing.

regardless, i.. dont really know how to proceed with this idea, research has dug up absolutely nothing helpful beyond some top level technical details, but maybe im not looking in the right places, and i know just enough about the tech stuff to know roughly how it works, but not enough to actually reverse engineer anything useful. any ideas/input/help would be appreciated Big Grin
Reply
Thanks given by: HippieDalek
#2
Could you use VLC to easily record playback? I've never messed with any of the record/capture features but I know with the right version of java you can play a blu-ray with menus and bonus features.
Reply
Thanks given by:
#3
(2024-01-30, 07:01 PM)stwd4nder2 Wrote: Could you use VLC to easily record playback? I've never messed with any of the record/capture features but I know with the right version of java you can play a blu-ray with menus and bonus features.

i haven't been able to get VLC to properly display PiP features, but menus work just fine so im not entirely sure if its a fixable issue (again, very little info/discussion out there that i can find regarding Blu-ray PiP). that is an interesting idea tho if it can be gotten working

the capture that i have, i did by capturing a PowerDVD playback via a HDMI capture card (a cheapo one i got to test it out).
Reply
Thanks given by:
#4
I remember it being pretty picky about the java version. I'm using server-jre-8u201-linux-x64 and that seems to handle everything I've thrown at it (though I don't think I have any PiP discs to test)
Reply
Thanks given by:
#5
(2024-01-30, 08:14 PM)stwd4nder2 Wrote: I remember it being pretty picky about the java version. I'm using server-jre-8u201-linux-x64 and that seems to handle everything I've thrown at it (though I don't think I have any PiP discs to test)

yeah, no dice. VLC will display onscreen text/icons so something is happening, but no PiP video/audio. when i have a little more time at some point i may play around a bit more with java and also perhaps linux (im currently on windows) to see if that does anything.
Reply
Thanks given by:
#6
What's some good examples of discs that have it? I'll run to the library later and see if I can pick one up and try testing it out.
Reply
Thanks given by: bobbster574
#7
(2024-01-30, 09:48 PM)stwd4nder2 Wrote: What's some good examples of discs that have it? I'll run to the library later and see if I can pick one up and try testing it out.

a few discs i know have PiP include:

The Matrix (as "In-Movie Experience")
The Mummy (as "U Control")
The Mummy Returns (as "U Control")
The Mummy: Tomb of the Dragon Emperor (as "U Control")
Shaun of the Dead (as "U Control")
Hot Fuzz (as "U Control")
The World's End (as "U Control")
How to Train your Dragon (as "Animators Corner")

"U Control" is basically Universal's name for a subset of bonus features that could play alongside the main feature (like as well as PiP it included trivia and stuff) im not sure when they stopped doing it but i imagine there are quite a few titles with it. the cases don't mention it explicitly so your milage may vary.
Reply
Thanks given by:
#8
I tried with The Mummy as I do have that one, and the terrible packaging hasn't destroyed the disc (yet).

Anyways it doesn't seem to work. Just like you said, the icon will show up on screen but nothing will actually play. The VLC logs seem to indicate that the feature isn't supported. I guess you could try submitting a feature request but considering I found posts going back to 2009 complaining about this I wouldn't get your hopes up.
Reply
Thanks given by: bobbster574
#9
(2024-01-30, 11:17 PM)stwd4nder2 Wrote: I tried with The Mummy as I do have that one, and the terrible packaging hasn't destroyed the disc (yet).

Anyways it doesn't seem to work. Just like you said, the icon will show up on screen but nothing will actually play. The VLC logs seem to indicate that the feature isn't supported. I guess you could try submitting a feature request but considering I found posts going back to 2009 complaining about this I wouldn't get your hopes up.

ok, thanks for trying!

PiP is such a niche part of Blu-ray playback, which i imagine is such a niche use of VLC to begin with, that yeah i imagine its not something that id be able to get fixed, so looks like VLC is a bust.
im probably going to look into seeing if i can get a 24Hz capture working when i have some time, i think thats the only solid lead i have on this idea for now.
Reply
Thanks given by: stwd4nder2
#10
I did this recently for Underworld: Rise of the Lycans and several years ago Romeo + Juliet.

Download BDInfo: https://www.videohelp.com/software/BDInfo

Either browse to the BD folder's location or paste it at the top and click 'rescan'.
Find the appropriate length playlist for the full movie. If there is more than one, the lowest number is usually right.

Open tsMuxeR: https://www.videohelp.com/software/tsMuxeR and drag/drop or click add and navigate to the playlist folder and select the one you found in BDInfo.

Uncheck all tracks except the PiP ones. The video will probably be the second track and standard definition. The audio track for the PiP, usually is English in low bitrate. I've seen AC3 stereo and DTS Express (which you may want to re-encode for compatibility later on).

You can now extract them separately, remux (like I do) or rebuild them as a Blu-ray all to themselves. I've occasionally had to adjust the aspect ratio.

I don't know if this will help with the discs you're working with though.
Reply
Thanks given by: HippieDalek


Forum Jump:


Users browsing this thread: 2 Guest(s)