@2twitme
Pinned post
Also excited to announce that all @SparkAISummit attendees will get a free ebook copy of the new version of Learning Spark, updated for #ApacheSpark 3.0 and authored by @2twitme, Brooke Wenig, @tathadas and @dennylee.View quoted post on X
MLflow Ambassador @shrinathsuresh covers D for Dataset Tracking in this MLflow A-Z clip.
Log training and evaluation datasets, version them, and associate those versions with your experiments. Skipping that is a huge mistake for GenAI, because the models are probabilistic.
🎥 youtube.com/watch?v=BoTbLW…View quoted post on X
www.linkedin.com Judgment is the Jev Model's Job. Policy Is Yours "Whenever you can't find the policy in the code, it's in a prompt." It usually starts small. About a decade ago, Databricks got an acquisition offer at roughly six times its valuation at the time. CEO Ali Ghodsi tells the story of the conversation with Ben Horowitz that made him turn it down:
Ben: "You just don't get this good of a market opportunity with this good of an entrepreneur. That's the rarest of rare things."
"We see great entrepreneurs, but their market opportunity is limited, and then we see companies that have a great market opportunity, but the entrepreneur is not big enough to fulfill that... But this was a case where we had both."
Ali: "The acquisition offer was on the table... I had made the mistake of telling my co-founders, and they were like, 'Take your hands off the keyboard. Nobody work anymore. We're done here. Let's count my money.'"
"And I was like, 'Maybe they're right. Maybe we should just sell.' And I remember having that conversation with Ben."
"He said, 'If you sell for this number, it's really great for me. I'll pay the investors back many times over... But if you're like me, you're gonna look back the rest of your life thinking, I missed that one shot. I should have taken it all the way. And now I'll never know how far I could have taken it. So do you wanna live with that, or do you wanna just have the money?'"
"And I was like, 'Okay, thanks.' Hung up the phone. 'We're never doing this. This is not happening.'"
@alighodsi @bhorowitz
Read the latest Profiles of the Future by @bhorowitz and @mikemcg0 on Databricks & the Future of the Firm: a16z.news/p/databricks-a…View quoted post on X
