AV1 (AOMedia Video 1) [main thread]

[spoRv]

AOMedia AV1

I'll gather some interesting info found around the web about AOMedia Video 1 a.k.a. AV1 here, in no particular order; feel free to add more!

---

FILM GRAIN SYNTHESIS

This is very interesting for fan preservation purposes; tested personally, it works quite well - it's like to overlay a grain plate, but with grain synthesis it should not be encoded, hence you can expect similar quality for grainy sources but obtained at lower bitrates.

source: https://chowdera.com/2021/05/20210515173437952m.html

---

---

A post on reddit about grain synthesis:
https://www.reddit.com/r/AV1/comments/n4si96/

---

I strongly encourage you to take a look at the following paper - at least at the comparison images; you can see how similar the synthesized grain pattern is to the original grain!

Film Grain Synthesis for AV1 Video Codec:
https://norkin.org/pdf/DCC_2018_AV1_film_grain.pdf

---

DEMO

MPEG-DASH Adaptive Streaming with AV1 by Mozilla and Bitmovin:
https://demo.bitmovin.com/public/firefox/av1/

Well, "Tears of steel" (2.40:1) at 1080@3mbps looks very good to me - it is 4mbps for a full frame 1080p video, hence 16mbps for 2160p; so a whole UHD movie could be fit on a BD-25 with enough space for lossless audio track(s)!

---

AV1, VP9, HEVC and AVC codec comparison:
http://video.1ko.ch/codec-comparison/

---

ARTICLES

Best Video Codec: An Evaluation of AV1, AVC, HEVC and VP9:
https://bitmovin.com/av1-multi-codec-dash-dataset/
and related paper
Multi-Codec DASH Dataset:
https://arxiv.org/pdf/1803.06874.pdf
AV1 bitrate gain on HEVC at UHD resolution is up to almost 44%

---

Navigating a Multi-Codec World:
https://www.streamingmedia.com/Articles/...45580.aspx

---

DVB Selects AV1 With AVS3 And VVC As Candidate Codecs For Standardization:
https://www.thebroadcastbridge.com/conte...ardization

---

Bitmovin’s AV1 Encoding Gift Guide:
https://bitmovin.com/av1-encoding-gift-guide/

---

Update: 2021-12-27:

Aurora1 AV1 Encoder - comparison with AVC:
https://www.visionular.com/en/products/a...v1-encoder
AVC@4mbps Vs Aurora1@1mbps

---

AV1 vs HEVC: Perceptual Evaluation of Video Encoders:
https://mile-high.video/files/mhv2018/pd...3_Wang.pdf
AV1 average bitrate saving of 30% compared to HEVC

---

A Method of Codec Comparison and Selection for Good Quality Video Transmission Over Limited-Bandwidth Networks:
https://www.ncbi.nlm.nih.gov/pmc/article...-04589.pdf
AV1 average bitrate saving of 37% compared to HEVC

---

Update: 2022-01-04:

Testing EVC, VVC, and LCEVC: How Do the Latest MPEG Codecs Stack Up?
https://www.streamingmedia.com/Articles/...eID=150729

So when VVC and AV1 are not tuned for VMAF, the former is merely few percent points better than the latter - and still VVC does not use grain synthesis and is royalty burden.

---

Update: 2022-01-05:

Intel To Ring In 2022 With New, Faster AV1 Encoder Release
https://www.phoronix.com/scan.php?page=a...-088&num=1

---

[spoRv]

I must admit that I always liked the idea of free open formats, and AV1 was the only one that I took in consideration for my projects - avoiding Daala, VP8/9 etc. mostly because of the small base of potential users.

And put AV1 apart, too, because it was slooow to encode, difficult to decode, quality was not that great in comparison to h265 at same bitrate, and still small potential user base.

But lately I started to think back to it, made my homeworks, and found some interesting facts:

• encoding now is faster than h265, with better quality at same bitrate
  
• at same quality, AV1 file is at least 10/20% smaller than h265
  
• it could be easily decoded via software by average computers
  
• it could be hardware encoded/decoded by some GPU of last generation
  
• it could be hardware decoded by few cheap TV BOX/media players
  
• Netflix switched to AV1 recently
  

I've made few tests lately, and found that an UHD scope source could be encoded at around 60mbps preserving the grain perfectly!

Now, I'm curious if someone here is an AV1 expert, to help to write "perfect settings" for it, as documentation is scarce and there is no official physical media AFAIK that use it and that could be used as example.

---

EDIT

Made several encoding using only svt-av1 (Netflix and Intel contributed to its development); to have a common ground between encoding, I set the bitrate to a fair 50mbps - the source is from a 77mbps AVC high@5.1 version of the DCP trailer that may be up to 250mbps. Bitrate chosen because it's the minimum found on UltraHD Blu-ray releases, even if it could be lowered to 35mbps to get the same quality.

At first, based on my previous experience with AVC/HEVC, I've chosen an average speed of 4 (from 1 the slower to 8 the fastest) and dual pass; it took about 147m to encode (so 63x real time); result is very close to the source:

https://screenshotcomparison.com/comparison/19862

Then I've discovered that speed 8 strangely has more quality than speed 4 (graph source):

so the second encode was made at speed 8, always 2 pass; this time encoding time was only 47m (20x real time) and quality the same; so, no reason to use slower speed (but according to the graph, speed 7 should retain a bit more quality with a small speed time tradeoff; must try it in the future).

Then, searching for the best settings, I've found a post on reddit about grain synthesis: let give it a try, then!

Again same encoding settings of the last one, plus grain 15; more or less the same encoding time, but with a nice grain that covers those ugly encoding artifacts found on the source (that is, actually, a mere AVC encoding of the original that is, again, an encoded version); so, at the end, a third generation version that looks like better than the second one IMHO!

Still... let's try the same, but this time only one pass; encoding time reduced to only 27m (11.5x real time) using one thread and 16m38s (7x real time) using 16 threads! Quite a long encoding time, but still "only" 14 hours to encode a 2 hours long movie, instead of five using speed4 2pass, and also better I must admit! And differences between 1pass and 2pass were negligible, and only possible to be seen when zoomed in at 800%, so I dare everyone in the world to see the difference while playing!

https://screenshotcomparison.com/comparison/19863

As you can see, fine details are retained almost always perfectly to pixel level, while at first sight you can see the sky to "blend" better in the AV1 version; this is because the grain synthesis process first "scrub" the source from grain, then adds it back when decoding - the synthesis of the grain is actually encoded, but in a reduced bitrate.

At the end, it's like to have a grain plate added, but with reduced bitrate; sure, both methods are not perfect, but they serve their purpose: give an "organic" look to the image - and grain synthesis on AV1 works pretty well.

Not that anybody (but me) have a reason to produce a bitrate constrained encoding, but if one wants to put an AV1 UHD version on BD, this will surely look great at UHD-BD "low" bitrates (45/50mbps), hence perfect to fit onto a BD-50; but I strongly suspect that, with careful settings, it would be possible to put it onto a BD-25 too, up to normal feature lenghts (90/100m) of a scope film (2.35:1), retaining most of the quality of the source.

---

EDIT 2

I just calculated at what bitrates (avg and max) should a 100m movie be encoded, at the net of a well robust lossless audio track of 4600mbps, and the average was 27200kbps and max 42100kbps; then encoded the same trailer using these two settings, but 12 threads instead 16. PC was stuck as well, still the encoding time lowered to just a bit more than 14m - that's 6x real time, not that bad!

And guess what? The details are almost the same, as well as (synthesized) grain; you must zoom like 10/20x to spot tiniest differences at pixel level! I'm shocked!

https://screenshotcomparison.com/comparison/19877

Take this test with a grain of salt; but if the promise is kept, it will be possible to publish projects onto a BD-25 disc (without a Blu-ray compliance, of course) - or for a 32GB memory - with a transparent video result, along with a lossless audio track - or various lossy ones... if you said that 5 years ago, I laughed at you, but now...

---

I converted a DCP 4K trailer to AV1, using svt-av1 speed 4 dual pass... well, it took 2h27m for a 2m21s trailer - 60x!!!

Sure quality is astounding, but I can't think to let the PC convert a movie for 5 days!
Must test faster speed settings.

[deleted user]

Very interesting. 5 days wouldn't bother me at all as encoding time goes.

Did you look into the successors of h265 as well? h266 and I think even h267 might have been on the horizon?

[spoRv]

I'm doing more interesting tests - stay tunes, I'll publish results very soon.

AV1: it has improved a lot in the last few years; bitrate/quality ratio going from worst than HEVC, to be equal, to be 10% better and now is 30% (depending on encoder used, settings, speed etc.) and up to 40% using proprietary encoders.

Now, VVC (AKA h.266) is 40% better than HEVC, so for now better than AV1 using free encoders; yet, it is patent encumbered and personally, if there is a free open alternative, I'd take it...

In the past several codecs were free and open, with quality near to the mainstream codecs - like Theora, Daala, Dirac etc.
Main problems were their quality (not on par with mainstream ones like AVC or HEVC) and/or very limited use... what's the point to convert something in, let's say Theora, if you can watch it only on a computer, and its quality/bitrate is lower than AVC?

Now, we have a free open video codec that will be mainstream since next year (where reports tell it will be used in 22% of production, more than HEVC for the first time), encoding speed is, if not fast, at least bearable (an order or two of magnitude faster than first attempts), could be hardware decoder by 100 bucks devices... why should it NOT be used?

[spoRv]

Second post updated with encoding comparisons and notes.

[spoRv]

Update: I noticed that, when the encoder is changed, threads change as well - last encoding used only one thread; I repeated the encoding but using 16 threads at this time... total time 16m38s, or 7x real time... GREAT! - first post edited accordingly

[spoRv]

Another update: what if an AV1 encoded video must be put onto a BD-25?

Second post edited, read more there!

[deleted user]

Can you try some very grainy source? Those tended to be hardest on h265. I dont mean mild grain, but really hardcore grain all over the place.

[spoRv]

Can you try some very grainy source? Those tended to be hardest on h265. I dont mean mild grain, but really hardcore grain all over the place.

Sure! Drop me a one minute clip and I'll encode it!

[dwalkerdon]

has anyone seen how lower bitrate AV1 files look on CRT TV's?