AutoOverlay (PKA AutoAlign) discussion

[random.next]

Good news!
New build: https://github.com/introspected/AutoOver...es/tag/0.2
It includes new color matching that can be used as standalone filter (see ''ColorAdjust" in description) and performance increasing. It is also good as border control, sample -> reference -> adjusted -> BD overlaid:
 

[deleted user]

Awesome. May I ask how the colormatching works?

[random.next]

Histogram matching with some kind of dither to make histogram of result image very close to reference.
Another point is that sample image is not the target image. Sample and reference usually cropped base and overlay clips - its intersection area to make image objects max similar pixel to pixel.

[random.next]

0.2.1: https://github.com/introspected/AutoOver.../tag/0.2.1
ColorAdjust supports HDR now. So it is possible to use color matching for HDR->SDR conversion.
Sample:
Unremastered BD -> Remastered FullHD BD -> UHD BD adjusted to FullHD BD and resized to 1080p -> FullHD + UHD -> UHD BD adjusted to unremastered BD

[spoRv]

Great!

[Stamper]

Awesome random! It means you can associate both the 1080p remaster and the 4K (as they have different framings in many shots) to obtain a more opened up version?

[random.next]

In the case of T2, yes, after 57K frames. 

Script:

Code:

DGSourceIM("M:\MEDIA\T2\Terminator.2.Judgment.Day.1991.EXTENDED.REMASTERED.1080p.BluRay.AVC.DTS-HD.MA.5.1-FGT\TC.dgi")
Crop(0,140,0,-140)
Trim(796,0)
FHD=last

LWLibavVideoSource("E:\T2_UHD.mkv", format="YUV420P16", stacked=true).ConvertFromStacked(bits=16)
Trim(805,0)
Crop(0,280,0,-280)
z_ConvertFormat(pixel_type="YUV420P10",colorspace_op="2020ncl:st2084:2020:l=>709:709:709:l", dither_type="none")
UHD=last

Adjusted=UHD.Crop(0,800,0,0).ColorAdjust(UHD.Crop(0,800,0,-52), FHD.Crop(0,426,0,0), dither=0.5).Spline64Resize(1920,400)

Adjusted.ConvertToYV24().AddBorders(0,427,0,0).Crop(0,0,0,-1).ConvertToYV12().Overlay(FHD, mask=FHD.OverlayMask(bottom=80, noise=true))

FHD.AddBorders(0, 12, 0, 14).Trim(0,56890) + Trim(56891,0)

[interaser]

Deleted

[althor1138]

I just tried this plugin out yesterday and wanted to drop in here to say that it works way better than I thought it would! Thanks for making this!

Is there a way to apply the color/luma matching before the clips are aligned? Would that help with alignment at all? Just wondering.

EDIT: Nevermind. I did some reading and it seems color adjust can be used as a standalone. Awesome.

[random.next]

I just tried this plugin out yesterday and wanted to drop in here to say that it works way better than I thought it would! Thanks for making this!

Is there a way to apply the color/luma matching before the clips are aligned? Would that help with alignment at all? Just wondering.

EDIT: Nevermind. I did some reading and it seems color adjust can be used as a standalone. Awesome.

Yep, you are right. If sources have different color it is better to try adjust them before auto-align. The easiest way is to use stand-alone ColorAdjust filter (if you need just luma channel then ConvertToY8 it first). The problem is that at this moment we can't use sample and reference images from intersection area as OverlayRender does so color matching wouldn't be perfect. Probably, the solution is to use two-step auto-align process.