Searching...
12 results for “public data”
Company10 mentions across episodes
Public
...data they've been collecting as a matter of business for the last decade, or that could be data that they've sourced from a data annotator or another data provider. And some folks we work with have all three. They're going to use open data, they're g
34:23 / 35:36
from transcript34:23 – 35:36
...Yeah. Data. But for public code, I think those are the most common. Yeah. I think some interesting things about those that I just personally find surprising,
22:30 / 23:36
from transcript22:30 – 23:36
...all the data. No. The the first step is like, okay. What are the cool data sources, and datasets people have put together for language model for training? Or when it comes to, like, our post training pipeline, we one of, the steps is, you wanna do so
6:41 / 7:59
from transcript6:41 – 7:59
...all the data. No. The the first step is like, okay. What are the cool data sources, and datasets people have put together for language model for training? Or when it comes to, like, our post training pipeline, we one of, the steps is, you wanna do so
7:21 / 8:39
from transcript7:21 – 8:39
...dataset that was actually good to train these models on. It's, of course, so much smaller than final web. It's only 30,000,000,000 tokens, but that's the scale that Microsoft datasets was.
8:55 / 10:03
from transcript8:55 – 10:03
...the replication cost is going to be far, far higher, and same goes for the code. We should also say that this is probably one of the more open models out of the Frontier models. Yeah. So, like, in this full spectrum, we're probably the fullest open s
17:11 / 18:16
from transcript17:11 – 18:16
...Because the dataset that they trained on was not public, so people were not really sure if these models are really good or maybe there's just some data contamination. So it was really hard to check if you just have the weights of the models. And, at
6:40 / 7:49
from transcript6:40 – 7:49
...data than public data. I mean, you all work for Bloomberg, so I'm I you're probably intimately familiar with this. But if you think about the different AI labs that exist, they actually now do kind of have different data related modes like XAI.
25:30 / 26:40
from transcript25:30 – 26:40
And there's a lot of types of models, so we're gonna break down what each of them are. There's a lot of technical specifics on training and go from high level to specific and kinda go through each of them. There's so many places we can go here, but m
14:59 / 16:01
from transcript14:59 – 16:01
...that are in the public domain. They are most private companies have to disclose their data to regulators any place you look. Typically, a number of other companies have looked there before and haven't yet found anything. But this data is even when it
3:42 / 4:55
from transcript3:42 – 4:55
...public after a period of time. And there's an enormous amount of data in maps of various kinds. One of my favorite datasets that we use around the world, a set of, of maps from Zambia from, almost a 100 years ago. The originals are hand painted on li
4:35 / 5:40
from transcript4:35 – 5:40
Have a podcast?
Run your podcast through Clypt
Get ranked clips, hooks, and ready-to-post copy from your own episodes. Free to try.