FFmpeg: The Incredible Technology Behind Video on the Internet | Lex Fridman Podcast #496

Been using VLC for so long I can't even remember how long. I remember the early early days trying to play stuff with windows media player/center, having to download virus ridden codec packs, and then a magical orange safety cone came along.

i have spend considerable time learning, and using FFmpeg, and I am always fascinated to find it behind, basically every major multimedia tool. Like oh my god.

Fabrice Bellard next! he created FFmpeg and QEMU

jb was my GSoC co-mentor, I contributed to VLMC and later to vlc-android. Last time I met him in fosdem. Good to see him!

Incredible guests. True builders of the digital world. I know they might not get so many views but interviews like this are important! Thank you Lex.

I worked at a video steaming company from Austria whose engineers also contributed to these codecs. These engineers are insanely smart and are the reason we have nice things these days.

These guys are great. I'll never get why programming "experts" can't understand that expertly hand-coded asm will always win (or tie) when it comes to performance. It just stands to reason. High-level languages are designed to save development time - they are not designed to "beat" machine code. Phrases like "xxx compiler produces code that meets or beats assembly language" need to say "beats assembly language produced by people who are not experts or don't have enough time to fully optimize it." To be fair, that is 99.9% of us - and that's cool. I'm not going back to .asm, but I'm glad that people like this are out there doing real-man programming where it is still needed.

I only recently found out what ffmpeg does and my goodness, without that open-source project, absolutely nothing would work.
Curl next please 😁

📖 The Importance of Excellent Code Quality (0:00 - 7:16)
├─ 2:00 The Power of FFmpeg and VLC Technology
└─ 4:09 The Power of Open Source Infrastructure
📖 The Iconic VLC Logo and Its Significance (7:16 - 14:05)
└─ 10:14 The Inner Workings of Video Processing Technology
📖 Video Compression Techniques for Human Perception (14:05 - 19:58)
└─ 16:20 Video Compression Techniques and Mathematical Tricks
📖 Understanding Video Container Formats and Codecs (19:58 - 25:36)
└─ 22:45 Designing Resilient Video Players
📖 Video Compression Techniques and Redundancy (25:36 - 31:27)
└─ 28:37 The Inner Workings of Video Compression Technologies
📖 FFmpeg as a Multimedia Processing Toolbox (31:27 - 37:09)
├─ 33:56 FFmpeg's Democratization of Complex Video Technology
└─ 35:32 The Impact of FFmpeg on Global Communication
📖 The Power of Open Source Software Development (37:09 - 43:32)
├─ 39:07 Open Source License Challenges in FFmpeg
└─ 40:58 Open Source Licensing Explained
📖 Licensing Differences Between GPL and LGPL (43:32 - 48:49)
└─ 45:59 Open Source Licensing and Contribution Requirements
📖 Importance of Community Agreements in Open Source (48:49 - 54:28)
└─ 51:29 Maintaining High-Quality Open Source

the focus on code quality is so awesome to see

This is the best advert ever for ffmpeg. So many devs will now take a look at the code.

Hmm, hard choice between Rogan talking to flying pyramid people, or Fridman talking to the guys who made the most important piece of open source software ever

That mfer that's been roasting everybody on Twitter is rocking the dora haircut 😭
It makes it even better

love these geek out history shows

If Silicon Valley had Jean-Baptiste Kempf’s ethics, the world would be a better place. We need fewer Zuckerbergs and more Kemps

YES absolutely love episodes like this, more of this please, less vapid celebrities

FFmpeg is the epitome of brutally honest hardcore software engineering. More of this please! Lots of us are sick and tired of the constant LLM grifting.

Linux and FFmpeg run this world. Hope you get to get Linus Torvalds on board for an interview soon!

"If we have to compromise our software, we will shut it down. That is clear." Made me proud hearing someone say that. Not a lot of people left with ethics that strong.

Thank you for listening ❤ Check out our sponsors: lexfridman.com/sponsors/ep496-sa
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
0:00 - Episode highlight
2:17 - Introduction
5:35 - Weirdest things VLC opens
9:59 - How video playback works
19:20 - Video codecs and containers
30:07 - FFmpeg explained
51:07 - Linus Torvalds
55:46 - Turning down millions to keep VLC ad-free
1:10:04 - FFmpeg & Google drama
1:29:18 - FFmpeg developers
1:35:55 - VLC and FFmpeg
1:40:29 - History of FFmpeg
1:43:46 - Reverse engineering codecs
1:57:01 - FFmpeg testing
2:01:08 - Assembly code (handwritten)
2:25:26 - Rust programming language
2:34:42 - FFmpeg and Libav fork
2:43:04 - Open source burnout
2:50:51 - x264 and internet video
3:04:07 - Video compression basics
3:11:04 - CIA and fake VLC
3:21:39 - Ultra low latency streaming
3:39:07 - AV2 codec and video patents
3:48:59 - VLC backdoors
3:59:14 - Video archiving
4:05:51 - Future of FFmpeg and VLC

Transcript:
lexfridman.com/ffmpeg-transcript

CONTACT LEX:
Feedback - give feedback to Lex: lexfridman.com/survey
AMA - submit questions, videos or call-in: lexfridman.com/ama
Hiring - join our team: lexfridm