The Cloudcast

Massive Studios

The Cloudcast (@cloudcastpod) is the industry's #1 Cloud Computing podcast, and the place where Cloud meets AI.  Co-hosts Aaron Delp (@aarondelp) & Brian Gracely (@bgracely) speak with technology and business leaders that are shaping the future of business. Topics will include Cloud Computing | AI | AGI | ChatGPT | Open Source | AWS | Azure | GCP | Platform Engineering | DevOps | Big Data | ML | Security | Kubernetes | AppDev | SaaS | PaaS .

read less
TechnologyTechnology

Episodes

Modernizing Video Production with AI
3d ago
Modernizing Video Production with AI
Tim Huckaby (@TimHuckaby, CTO at Lucihub) talks about building modern AI applications to generate business video, the human vs AI interactions, and the importance of domain expertise. SHOW: 893SHOW TRANSCRIPT: The Cloudcast #893 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SHOW NOTES:Lucihub (homepage)Lucihub - AI powered video creation platform (YouTube)Topic 1 - Welcome to the show. Tell us about your background…Topic 2 - Having seen a lot of technology evolution, how do you think about today’s possibilities with AI? Topic 3 - Let’s talk about Lucihub. They deliver video production using AI. Help us understand how their approach is different? (very curious about the interaction of AI and humans in the design of the platform)Topic 4 - What are the expectations of creators to interact with the AI parts of the system vs. the expectations to interact with humans? Topic 5 - How are you seeing companies compare the experience of using Lucihub vs. experience they had previously with non-AI agencies? Topic 6 - Your other passion is fly fishing. Do you find any symmetries between the nurture of fly fishing and your work with technology, or is it the contrast that you need to find a balance in your life? FEEDBACK?Email: show at the cloudcast dot netBluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Auth in the Age of AI Agents
01-01-2025
Auth in the Age of AI Agents
Jake Moshenko (@jacobmoshenko, CEO of @AuthZed) talks about the challenges of securing AI interactions, as well as authentication best-practices for AI Agents and RAG patterns.  SHOW: 885SHOW TRANSCRIPT: The Cloudcast #885 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SHOW NOTES:Authzed (homepage)SpiceDB - Authorization that scales (GitHub)Google’s Zanzibar (research paper)Annotating Zanzibar (by AuthZed)Authzed CEO discusses Auth for AI RAG and Agents (TheCUBE)Topic 1 - Welcome to the show. Tell us about your background and why you decided to start AuthZed.Topic 2 - AuthZed is based on technology from Google called Zanzibar. There’s an in-depth research paper, but give us some background on the types of problems it solves and why it was so appealing to you. Topic 3 - Authorization is used for every application, but let’s talk about it in the context of AI or AI Agents. This is still a fairly new concept, but what authorization-related challenges do you expect GenAI or AI agents to create for developers and operators?Topic 4 - Is this space moving so fast that people already realize they’ll likely need something more modern, like Authzed, or are there mistakes they are making today that are going to cause serious red flags soon? Topic 5 - What is the typical path for companies or teams to adopt Authzed, and is it something that can start small and grow (or merge with other groups), or does it have to be centralized like at Google? Topic 6 - What are some of the more important areas that people building and growing AI systems that need authorization should be keeping an eye on? FEEDBACK?Email: show at the cloudcast dot netBluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
2024 Year End Mailbag
18-12-2024
2024 Year End Mailbag
It’s that time of the year… Aaron and Brian answer emails and questions for the second half of the year.SHOW: 882SHOW TRANSCRIPT: The Cloudcast #882 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS"SHOW NOTES:Question 1 - There was a lot of talk about Broadcom’s changes to VMware at the beginning of the year, but not as much since then. What’s going on in the world of virtualization?Question 2 - Both of you have talked about working remotely for quite a while. What’s your take on RTO mandates? Any suggestions for remote workers? Question 3 - Have either of you found any valuable uses of AI in your day-to-day job? Question 4 - Now that the US elections are over, how do you expect the US Gov’t to be involved with the tech industry (anti-trust, CHIPS ACT, AI regulation, etc..)Question 5 - AI models and GPUs  seem to get all the attention in the news. Are there other areas of AI that you think are really important but aren’t getting much attention right now?Question 6 - Are cloud skills still considered valuable? Do certifications matter anymore? Question 7 - What’s going on in the open source communities like the CNCF? Question 8 - What surprised you the most this year?FEEDBACK?Email: show at the cloudcast dot netBluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Reacting to the AWS re:Invent Keynote
11-12-2024
Reacting to the AWS re:Invent Keynote
The 2024 AWS re:Invent happened, with a new CEO, and an appearance by a previous CEO. What were the big announcements, trends and stories coming out of the keynote?SHOW: 880SHOW TRANSCRIPT: The Cloudcast #880 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS" SHOW SPONSOR:While data may be shaping our world, Data Citizens Dialogues is shaping the conversationFollow Data Citizens Dialogues on Apple, Spotify, YouTube, or wherever you get your podcastsSHOW NOTES:AWS re:Invent 2024 - CEO Keynote with Matt GarmanTop Announcements of 2024 AWS re:InventWhat hath AWS wrought? (Forrest Brazzeal newsletter)Prince guitar solo during George Harrison tributeOverall Takeaways:The new CEOThe overall themesAndy Jassy’s appearanceBrian’s Top 5 Takeaways:The focus is now all ARM and GPUs/AI Accelerators (goodbye Intel)AWS is getting back to basics on Cloud - a focus on primitivesAWS is trying to get ahead of startup and enterprise usage of GenAI with a focus on Inferencing costs (trying to make it a game of compute costs vs. model capabilities)What are the 1000 GenAI apps that Amazon has built? (Rufus, Robot package loading? NFL Blitz predictor?Brandon’s Top 5 Takeaways:Amazon is the “Everything Store,” AWS is the “Every Service Store”Garmon is the legacy AWS CEO, Jassy is the AWS AI CEOAWS wants everyone to build a chatbot and/or call center app using AWS Bedrock The NOVA foundation models are the AWS answer to OpenAI and Anthroptic. AWS is attempting to build both the models and the AI Chips to run them. Tenuous partnerships with Nvidia and Anthropic. Neither was on stage. AWS will never stop telling us about “Working Backwards”AWS marketing still wants talk about the how rather than the benefit. A long lecture on Nitro and Amazon Aurora DSQL with a lot of discussion about synchronizing clocks.FEEDBACK?Email: show at the cloudcast dot netBluesky: @cloudcastpod.bsky.socialTwitter/X: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Reviewing "AI Eats the World"
08-12-2024
Reviewing "AI Eats the World"
How are the largest VCs viewing the early stages of the AI Era, from the perspective of investment, technology moats, economics, early adoption and future use-cases.  SHOW: 879SHOW TRANSCRIPT: The Cloudcast #879 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS"SHOW NOTES:AI Eats the World (Presentation - Benedict Evans)IS SILICON VALLEY STILL THE CENTER OF TECH INNOVATION?Companies are investing tons of moneyBreakthrough results haven’t emerged yet (business models, profits)It’s not clear that there is a technology moat; but maybe a capital moatModel training costs are expected to rise 5x to 10x - worse economics??Lots of VC investment and vendor 2nd-order investmentsLLM costs are creating marginal cost of software (been since the mainframe)Model quality vs. price is improving, but price of the services (e.g. ChatGPT-Pro) is increasing - how much extra value is being delivered?How will open source impact AI? “If anything in life is certain, semiconductors are cyclical, commodity tech goes to marginal cost, and every new tech produces a bubble.”Today’s GenAI question - is it accurate and useful? How can we tell, and how can it improve (or does it need to)?Start with a simple concept - AI gives us unlimited interns - how can you extrapolate that? How would this have been extrapolated for the original internet (create content, translate language, write code, etc.)Use cases are still not easy to see beyond Chatbots (and variants), Coding AssistantsConsulting revenue from GenAI is bigger than technology - and still most/many projects still in trials. Technology can take a long time to adopt - Cloud still only has 30% of workloads (15yrs old)66% of CEO’s don’t expect their first GenAI app in production until sometime in 2025, 50% at least 2H of 2025.[Shadow AI] SaaS AI will accelerate adoption, if it follows Cloud pattern - external forces are more motivated to attack business “change” than internal teams[Build vs. Ecosystem] Do the LLM vendors become the application vendors? Where does the LLM start and stop (infra, platform, API, apps, etc.)[Learning from the customers] Do the LLM vendors use their knowledge advantage to build the apps? GenAI Apps Categories - Make something better, Replace something, Just do the thing“AI is just whatever is wrong/broken now” - How well does AI understand “broken”Will people be the biggest problem in AI progress? [Decoupling] Looks at global markets for Internet today - ecommerce/retail, food delivery, advertising, media, autonomous driving, [Elevator Example] Automation gets rid of peopleNo real conclusionFEEDBACK?Email: show at the cloudcast dot netTwitter/X: @cloudcastpodBlueSky: @cloudcastpod.bsky.socialInstagram: @cloudcastpodTikTok: @cloudcastpod
The Pros and Cons of Living in Silicon Valley during the AI Boom
01-12-2024
The Pros and Cons of Living in Silicon Valley during the AI Boom
As the AI era emerges, the debate about the best place to live to take advantage of it for your career has started up again. Is Silicon Valley still the best place to live when a new trend starts?SHOW: 877SHOW TRANSCRIPT: The Cloudcast #877 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS"SHOW SPONSOR:Love the insights from this episode? Make sure you never miss a beat with Chatpods! Whether you're commuting, working out, or just on the go, Chatpods lets you capture and summarize key takeaways effortlessly.Save time, stay organized, and keep your thoughts at your fingertips.Download Chatpods directly from App Store or Google Play and use it to listen to this podcast today!SHOW NOTES:The case against living in the Bay area (Forrest Brazeal) Cost of living calculatorBest quality of life cities (US) Best quality of life cities (Europe)Best quality of life cities (Asia)Top 15 Wealth Creating Stocks of last 10 years (Vanguard)IS SILICON VALLEY STILL THE CENTER OF TECH INNOVATION?Amazon, Microsoft, Space X , BYD, TSMC, are not in Silicon ValleyTHE PROS AND CONS OF LIVING IN SILICON VALLEY DURING A BOOM?Density of ideasDensity of people that obsess over technologyWork from Office vs. Work from AnywhereLocation of customers - and physical vs. digitalAbility to make money vs. life changing moneyNon-work considerations (family, non-work activities, etc.)FEEDBACK?Email: show at the cloudcast dot netTwitter/X: @cloudcastpodBlueSky: @cloudcastpod.bsky.socialInstagram: @cloudcastpodTikTok: @cloudcastpod
Using GenAI for DevSecOps
27-11-2024
Using GenAI for DevSecOps
Andrew Manoske (@a2d2, VP Products @Kindo)  talks about the intersection of GenAI and DevSecOps, the WhiteRabbitNeo model, and learning adversary behavior.SHOW: 876SHOW TRANSCRIPT: The Cloudcast #876 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS"SHOW SPONSOR:While data may be shaping our world, Data Citizens Dialogues is shaping the conversationFollow Data Citizens Dialogues on Apple, Spotify, YouTube, or wherever you get your podcastsSHOW NOTES:Kindo (homepage)WhiteRabbitNeo (open source project)Open Source GenAI models advances support for CyberSecurity and DecSecOps teamsTopic 1 - Welcome to the show. Tell us about your background and your current areas of focus.Topic 2 - You come from a security background. Every conversation we have with security teams is “attackers have more tools, more money and more time”. Is security an almost unwinnable game without a new way of thinking about the equation?Topic 3 - It seems like AI has the potential to give Security teams (or anyone in IT) more of a chance, if used properly. How are you thinking about giving teams the right security AI powers?Topic 4 - Let’s talk about WhiteRabbitNeo. “WhiteRabbitNeo is uncensored and trained to act like a modern adversary.” What does this mean in practical terms? Topic 5 - Where is the potential for the right set of AI models + Agents to make a significant impact towards better on-going security? Topic 6 - There will be lots of things aimed at being AI for Security. How would you tell someone how to sort through what is useful vs. AI-washed or not likely to be useful?FEEDBACK?Email: show at the cloudcast dot netTwitter/X: @cloudcastpodBlueSky: @cloudcastpod.bsky.socialInstagram: @cloudcastpodTikTok: @cloudcastpod
Searching for the Netflix of the AI Era
24-11-2024
Searching for the Netflix of the AI Era
In the Cloud Era, Netflix was held up as the lighthouse for what was possible with cloud. So who is the Netflix of the AI era, and are we learning enough about AI yet?SHOW: 875SHOW TRANSCRIPT: The Cloudcast #875 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK: http://bit.ly/cloudcast-cnotwCHECK OUT OUR NEW PODCAST: "CLOUDCAST BASICS"SHOW SPONSOR:Love the insights from this episode? Make sure you never miss a beat with Chatpods! Whether you're commuting, working out, or just on the go, Chatpods lets you capture and summarize key takeaways effortlessly.Save time, stay organized, and keep your thoughts at your fingertips.Download Chatpods directly from App Store or Google Play and use it to listen to this podcast today!SHOW NOTES:New research shows widespread adoption of GenAINetflixOSS (homepage)WHAT DID NETFLIX DO FOR THE CLOUD ERA?Provided a face for a new style of doing workProvided validation that a new model could workEncouraged people to explore older, “bad practices”Began to define metrics of what the new world could look likeWHY DO WE NEED A NETFLIX OF THE AI ERA?Because AI can apparently do everything, but what are some specific things?What are the new ways of thinking about old problems?Has it been proven to improve teams, or mostly individuals? Do we need a Couch to 5k set of use-cases? Starting use-casesOr is AI going to be a big-bang approach?FEEDBACK?Email: show at the cloudcast dot netTwitter/X: @cloudcastpodBlueSky: @cloudcastpod.bsky.socialInstagram: @cloudcastpodTikTok: @cloudcastpod
Building AI Models for IT Operations
20-11-2024
Building AI Models for IT Operations
Sunil Mallya (@sunilmallya, Co-Founder & CTO @_FlipAI) talks about building AI models to help IT Operations teams simplify troubleshooting, incident response and pattern detection.  SHOW: 874 SHOW TRANSCRIPT: The Cloudcast #874 TranscriptSHOW VIDEO: https://youtube.com/@TheCloudcastNET CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: "CLOUDCAST BASICS"SHOW NOTES:Flip AI (homepage)Enterprise AI Agents: Bringing LLMs to Enterprise DataTopic 1 - Welcome to the show. Topic 2 - Let’s begin by talking about your broader view of where IT Operations is today for large companies. What are their biggest challenges, and where are their opportunities for big improvements? Topic 3 - One of the biggest challenges for IT Operations is so many systems, so many tools, so many data sources and the difficulty of coordinating (troubleshooting, incident response, pattern detection, etc.) across them. Is there a modern approach that’s emerging about how to make this better? Topic 4 - Where does the potential of AI models come into play here? It is more focused on being able to ask the system for diagnosis, or can it start getting closer to taking independent actions? Topic 5 - How do you train an AI model with so many different pieces of customer data? Topic 6 - Let’s talk about AI Agents and what they can begin to accomplish within an Enterprise.FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod