China copies American AI breakthroughs but can't make them 10x better

Having said that, again, at least so far, up until like this week, you just say that like whatever the American big labs do, like China figures out a way to do it, in open source form at a point.

14:57 / 15:44

Having said that, again, at least so far, up until like this week, you just say that like whatever the American big labs do, like China figures out a way to do it, in open source form at a point. But they haven't been able to figure out a way to do it 10x better because what they're doing is letting American labs invest and then just distilling the models to some degree. So I think it's more that there is this there is this distillation and so you And and there's infrastructure optimization and a bunch of stuff Yeah. There's some for for sure distillation, so there's this thing distillation where you basically train the next model on the answers of of the previous model, and and and I think for sure China is is doing some of that, and there there's a there's a lens on that that says of course that's unfair because you're basically piggybacking on top of work other people have done. You know, look, you know, having said that, you know, it's a little bit like, well, okay, there's a fair amount of distillation happening in The US also. Yeah. Right? Because distillation, all you need is just be able to ask another AI questions and train on the answers. And then of course, the AI's themselves are distillations of other content.

About this clip

Marc Andreessen explains how China has been able to replicate American AI lab innovations through model distillation and infrastructure optimization, but hasn't been able to create dramatically superior versions. He notes that distillation - training models on answers from previous models - is happening in the US as well, making the competitive dynamics more complex than they appear.

Why this clip

Provides insider perspective on the US-China AI race and reveals the technical methods behind competitive dynamics that most people don't understand.

14:57 - 15:4448smarket insight

Share

LinkedInX

More from this guest

Marc Andreessen

6 appearances · 7 clips

What they said next

If you compare productivity growth across eras: 1880-1930 was three times as fast, 1930-1970 was twice as fast, and since 1970 it's been one x. We had 3x, then 2x, then 1x. This is very not good.

3:04 - 38s · Practical Framework

More from this episode

Similar clips from other shows

From the blog

Want clips like this for your podcast?

We find your top 5-8 clips, write the hooks, and deliver ready-to-post content. First 2 episodes are free.

Get 2 Episodes Clipped Free