Building Your Own LLM

The Brave Technologist

Dec 6 2023 • 30 mins

Greg Diamos, Co-Founder of Lamini, shares how their discovery of the Scaling Laws Recipe led to rapid evolution of language learning models, and inspired Lamini’s product offering. He also discusses his message for policy makers, including what we should be worried about, and what pitfalls we should work to avoid.

Key Takeaways:

  • Why you should build your own LLM

  • How language learning models have impacted ChatGPT

  • Why this is the best time for software engineers to enter the space

Guest Bio:

Greg Diamos is a Co-Founder of Lamini, the enterprise LLM platform for building and owning LLMs. He is also a Co-Founder of MLPerf™, the industry standard benchmark for deep learning performance. Greg was a founding engineer at Baidu’s Silicon Valley AI Lab (SVAIL), where he co-invented the first deep learning speech and language model (which was deployed in production to billions of users). At Baidu, he discovered Scaling Laws, motivating LLMs. His team members from SVAIL built the most useful LLMs today, including OpenAI’s ChatGPT, Llama 2 at Meta, Claude 2 at Anthropic, PALM at Google, and NVIDIA’s Megatron. Before Baidu, Greg was a CUDA Architect at NVIDIA. Greg holds a PhD from Georgia Tech focusing on high performance computing.

----------------------------------------------------------------------------------------

About this Show:

The Brave Technologist is here to shed light on the opportunities and challenges of emerging tech. To make it digestible, less scary, and more approachable for all!

Join us as we embark on a mission to demystify artificial intelligence, challenge the status quo, and empower everyday people to embrace the digital revolution. Whether you're a tech enthusiast, a curious mind, or an industry professional, this podcast invites you to join the conversation and explore the future of AI together.

The Brave Technologist Podcast is hosted by Luke Mulks, VP Business Operations at Brave Software—makers of the privacy-respecting Brave browser and Search engine, and now powering AI everywhere with the Brave Search API.

Music by: Ari Dvorin

Produced by: Sam Laliberte