Kubernetes Bytes

Ryan Wallner & Bhavin Shah

Kubernetes Bytes is a podcast bringing you the latest from the world of cloud native data management. Hosts Ryan Wallner and Bhavin Shah come to you from Boston, Massachusetts with experienced backgrounds in cloud-native tech. They'll be sharing their thoughts on recent cloud native news and talking to industry experts about their experiences and challenges managing the wealth of data in today's cloud-native ecosystem. read less
TechnologyTechnology

Episodes

Generative AI on Kubernetes
Mar 12 2024
Generative AI on Kubernetes
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Janakiram MSV - an advisor, analyst and architect to talk about how users can run Generative AI models on Kubernetes. The discussion revolves around Jani's home lab and his experimentation with different LLM models and how to get them running on NVIDIA GPUs. Jani has spent the past year becoming a subject matter expert in GenAI, and this discussion highlights all the different challenges he faced and what lessons he learnt from them.   Check out our website at https://kubernetesbytes.com/  Episode Sponsor: Elotl  https://elotl.co/lunahttps://www.elotl.co/luna-free-trial  Timestamps: 02:02 Cloud Native News 15:31 Interview with Jani 01:11:00 Key takeaways  Cloud Native News: https://www.techerati.com/press-release/octopus-deploy-acquires-codefresh-to-boost-kubernetes-and-cloud-native-delivery/https://www.civo.com/blog/kubefirst-joins-civo  https://cast.ai/kubernetes-cost-benchmark https://www.techradar.com/pro/vmware-customers-are-jumping-ship-as-broadcom-sales-continue-heres-where-theyre-moving-to https://cloudonair.withgoogle.com/events/techbyte-making-ai-ml-scalable-cost-effective-gkehttps://dok.community/dok-events/dok-day-kubecon-paris/ https://training.linuxfoundation.org/certification/certified-argo-project-associate-capa   Show Links: https://www.youtube.com/janakirammsv https://www.linkedin.com/in/janakiramm/- NVIDIA Container Toolkit - https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/index.htmlNVIDIA Device Plugin - https://github.com/NVIDIA/k8s-device-pluginNVIDIA Feature Discovery - https://github.com/NVIDIA/gpu-feature-discoveryHugging Face Text Gen Inference - https://huggingface.co/docs/text-generation-inference/indexHugging Face Text Embeddings Inference - https://huggingface.co/docs/text-embeddings-inference/indexChromaDB - https://www.trychroma.com/
Kubernetes at the Edge
Oct 13 2023
Kubernetes at the Edge
In this Episode of the Kubernetes Bytes podcast, Bhavin and Ryan discuss Edge Computing and how Kubernetes and other platforms and distributions can help build better solutions for the edge.   Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytesCheck out the KubernetesBytes website: https://www.kubernetesbytes.com/Ads:Ready to shop better hydration, use "kubernetesbytes" to save 20% off anything you order.Try Nom Nom today, go to https://trynom.com/kubernetesbytes and get 50% off your first order plus free shipping.Timestamps:00:00 Introduction 05:30 Cloud Native News 15:50 Kubernetes at the Edge   Cloud Native News: https://www.cncf.io/announcements/2023/10/11/cloud-native-computing-foundation-announces-cilium-graduation/https://www.pulumi.com/blog/series-c/https://www.calcalistech.com/ctechnews/article/ryrfsmtlahttps://cloudnativenow.com/features/loft-labs-bolsters-virtual-kubernetes-cluster-management-at-scale/  Show Notes:  https://www.cncf.io/blog/2022/08/18/kubernetes-on-the-edge-getting-started-with-kubeedge-and-kubernetes-for-edge-computing/https://youtu.be/rj4FFf1gZ0g?si=j74AHT_09l5wwIMihttps://thenewstack.io/a-new-kubernetes-edge-architecture/https://www.packtpub.com/product/edge-computing-systems-with-kubernetes/9781800568594https://www.redhat.com/en/topics/linux/ARM-vs-x86https://www.xenonstack.com/blog/edge-data-managementhttps://www.cncf.io/blog/2022/08/18/kubernetes-on-the-edge-getting-started-with-kubeedge-and-kubernetes-for-edge-computing/https://docs.k3s.io/architecturehttps://microk8s.io/docs/getting-startedhttps://kubeedge.io/docs/category/architecture
How Chick-fil-A adopts GitOps and K3s at the Edge
Sep 26 2023
How Chick-fil-A adopts GitOps and K3s at the Edge
In this episode of Kubernetes Bytes, Bhavin Shah and Ryan Wallner interview Brian Chambers, Chief Architect at Chick-fil-A. Brian walks through some of the design decisions, challenges and architecture of how Chick-fil-A uses Kubernetes at the edge in their restaurants.Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytesReady to shop better hydration, use "kubernetesbytes" to save 20% off anything you order.Try Nom Nom today, go to https://trynom.com/kubernetesbytes and get 50% off your first order plus free shipping.Interested in attending Boston DevOps Days?https://bit.ly/dodb2023 (Main Website, Program, Registration, etc.)https://www.linkedin.com/company/devopsdaysbos/(Real-time updates)Timestamps01:05 Introduction06:22 Cloud Native News19:13 Interview with Madhuri01:13:20 TakeawaysCloud Native News:K8s 1.28 https://kubernetes.io/blog/2023/08/15/kubernetes-v1-28-release/SC assignment stable- https://kubernetes.io/blog/2023/08/15/kubernetes-v1-28-release/#automatic-retroactive-assignment-of-a-default-storageclass-graduates-to-stableNon graceful shutdown stable - https://kubernetes.io/blog/2023/08/15/kubernetes-v1-28-release/#generally-available-recovery-from-non-graceful-node-shutdownCeph RBD and FS in tree deprecatedControl plan and node supported version go from n-2 to n-3Redhat Openstack services on OpenShift - https://www.redhat.com/en/blog/red-hat-openstack-services-openshift-next-generation-red-hat-openstack-platformAlcion 21 Million funding round: https://techcrunch.com/2023/09/19/alcion-which-provides-backup-and-security-services-to-enterprises-raises-21m/Veeam was major funder: https://www.techtarget.com/searchdatabackup/news/366552363/Veeam-leads-funding-round-for-SaaS-backup-provider-AlcionKubescape 3.0 - https://kubescape.io/blog/2023/09/19/introducing-kubescape-3/GPU sharing on Amazon EKS with NVIDIA time-slicing and accelerated EC2 instances or MIG based sharinghttps://aws.amazon.com/blogs/containers/gpu-sharing-on-amazon-eks-with-nvidia-time-slicing-and-accelerated-ec2-instanceshttps://aws.amazon.com/blogs/containers/maximizing-gpu-utilization-with-nvidias-multi-instance-gpu-mig-on-amazon-eks-running-more-pods-per-gpu-for-enhanced-performance/Akuity launches Kargo - New Open Source project to automate declarative promotion of changes across multiple app environments - https://www.businesswire.com/news/home/20230918552920/en/Akuity-Launches-Kargo---a-New-Open-Source-Project-to-Automate-the-Declarative-Promotion-of-Changes-Across-Multiple-Application-EnvironmentsOpenTofu - Linux Foundations alternative to Terraform - loads of community supporthttps://www.linuxfoundation.org/press/announcing-opentofu?hss_channel=lcp-208777CFP already open for Paris!!!! https://events.linuxfoundation.org/kubecon-cloudnativecon-europe/program/cfp/
Nodeless Kubernetes - Optimizing costs with just in time compute
Sep 14 2023
Nodeless Kubernetes - Optimizing costs with just in time compute
In this episode of Kubernetes Bytes, Ryan and Bhavin sit down with Madhuri Yechuri and talk about all things Nodeless Kubernetes and how users can leverage the concept of Just in Time compute provisioning to prevent wasted spend on their cloud bills. Madhuri talks about LUNA and NOVA - a couple of Elotl products that help users run a nodeless Kubernetes multicluster platform for their containerized applications. Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytes Ready to shop better hydration, use code "kubernetesbytes" at this special link https://zen.ai/apaSnaIFOuee5jScqZ28a03tKKvQiqkyz8mtm9wipoE to save 20% off anything you order.Interested in attending Boston DevOps Days?https://bit.ly/dodb2023 (Main Website, Program, Registration, etc.)https://www.linkedin.com/company/devopsdaysbos/(Real-time updates)Timestamps00:30 Introduction 05:18 Cloud Native News 12:48 Interview with Madhuri56:20 Takeaways  Cloud Native News: https://tech.eu/2023/09/04/rig-dev-first-open-source-baas-platform-on-kubernetes https://d2iq.com/blog/dkp-2-6-features-new-ai-navigator https://securityboulevard.com/2023/09/pluto-finds-deprecated-kubernetes-api-versions-3-questions-from-users/ https://www.businesswire.com/news/home/20230906419666/en/RapidFort-Launches-Runtime-Protection-to-Automatically-Monitor-and-Secure-Kubernetes-Workloads  https://www.businesswire.com/news/home/20230906393254/en/InfluxData-Announces-InfluxDB-Clustered-to-Deliver-Time-Series-Analytics-for-On-Premises-and-Private-Cloud-Deployments  https://blocksandfiles.com/2023/09/04/storage-news-ticker-4-sep-2023/  https://blocksandfiles.com/2023/09/07/storage-ticker-7-september-2023/    Show links: https://www.elotl.co/ https://www.elotl.co/multi-cluster-podcast https://docs.kubefirst.io/aws/faq https://kubefirst.io/slack
Solving Multicloud with Seamless Connectivity and AI - with Rob Croteau
Sep 1 2023
Solving Multicloud with Seamless Connectivity and AI - with Rob Croteau
In this episode of KubernetesBytes, Bhavin and Ryan interview Rob Croteau of Avesha. Avesha is behind the open source project KubeSlice which aims to enable admins to seamlessly connect multiple Kubernetes clusters no matter where they are located with a few command or clicks. Learn about the challenges teams face today with networking and how Kubeslice and avesha are trying to make connectivity for clusters simple. Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytes   Try Nom Nom today, go to https://trynom.com/kubernetesbytes and get 50% off your first order plus free shipping.Ready to shop better hydration, use code "kubernetesbytes" at this special link https://zen.ai/apaSnaIFOuee5jScqZ28a03tKKvQiqkyz8mtm9wipoE to save 20% off anything you order.Time Stamps News 00:05:36 Interview 00:14:05Takeaways 00:53:50  Show Links - https://kubeslice.io/ - https://avesha.io/ - https://github.com/kubeslice  Show Notes: - https://cloud.google.com/blog/products/ai-machine-learning/duet-ai-in-google-cloud-preview - https://cloud.google.com/blog/products/containers-kubernetes/whats-new-with-gke-at-google-cloud-next - Kubecost Cloud now GA - install agent using Helm chart https://siliconangle.com/2023/08/21/kubecost-debuts-kubecost-cloud-help-enterprises-rein-kubernetes-spending/ - KEDA graduates - https://www.prnewswire.com/news-releases/cloud-native-computing-foundation-announces-graduation-of-kubernetes-autoscaler-keda-301907019.html  - Netapp files in google https://www.techtarget.com/searchstorage/news/366550341/NetApp-cloud-storage-evolving-for-stateful-K8s-AI  - GKE Enterprise https://techcrunch.com/2023/08/29/google-introduces-gke-enterprise-to-help-companies-manage-complex-kubernetes-environments/  - API GW article https://thenewstack.io/the-api-gateway-and-the-future-of-cloud-native-applications/  - Ngrok static domains https://ngrok.com/blog-post/free-static-domains-ngrok-users
Kubernetes Observability 101
Aug 17 2023
Kubernetes Observability 101
In this episode of Kubernetes Bytes, Ryan and Bhavin go back to school after the summer break and talk about What is Kubernetes Observability? They talk about how Observability is different from Monitoring, what are the three pillars of Observability and the CNCF projects viewers can check out to get started with Kubernetes Observability!   Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytes Ready to shop better hydration, use my special link https://zen.ai/apaSnaIFOuee5jScqZ28a03tKKvQiqkyz8mtm9wipoE to save 20% off anything you order.Chapters:00:30 Introduction06:25 Cloud Native News17:57 What is Kubernetes ObservabilityCloud Native News:https://kubernetes.io/blog/2023/08/15/kubernetes-v1-28-release/ - Planterneteshttps://techcrunch.com/2023/08/09/sweet-security-raises-12m-seed-round-for-its-cloud-security-suite/https://www.dynatrace.com/news/press-release/dynatrace-to-acquire-rookout/https://www.businesswire.com/news/home/20230725088248/en/https://www.forbes.com/sites/janakirammsv/2023/07/31/kubeflow-joins-cncf-to-accelerate-the-adoption-of-mlops/?sh=6495358e6e75https://finance.yahoo.com/news/edb-announces-three-ways-run-130000473.htmlhttps://www.prnewswire.com/news-releases/portworx-by-pure-storage-recognized-as-a-leader-in-kubernetes-storage-by-gigaom-for-fourth-consecutive-year-301889796.htmlhttps://blocksandfiles.com/2023/08/15/nutanix-puts-chatgpt-in-a-box/https://venturebeat.com/ai/middleware-raises-6-5m-to-simplify-cloud-monitoring-with-ai/https://thenewstack.io/aqua-security-uncovers-major-kubernetes-attacks/   Show Links: https://signoz.io/blog/kubernetes-observabilityhttps://landscape.cncf.io/card-mode?category=monitoring&grouping=categoryhttps://www.linuxfoundation.org/webinars/kubernetes-observability-with-opentelemetry-and-beyond
Generative AI: The New Frontier in Kubernetes Problem-Solving
Jul 19 2023
Generative AI: The New Frontier in Kubernetes Problem-Solving
In this episode of Kubernetes Bytes, Ryan and Bhavin talk to Kyle Forster CEO at RunWhen - a platform for troubleshooting Kubernetes with Generative AI assistance. The discussion starts by talking about LLMs and GPTs, and why everyone is building a ChatBot powered by AI. They then talk about how Generative AI can act as a co-pilot for SREs working with Kubernetes, and help them troubleshoot things faster.  Watch this episode to learn more about how AI can help you become the 10x engineer / SRE instead of replacing you at your company.   Join the Kubernetes Bytes slack using: https://bit.ly/k8sbytes Ready to shop better hydration, use my special link https://zen.ai/apaSnaIFOuee5jScqZ28a03tKKvQiqkyz8mtm9wipoE to save 20% off anything you order.00:30 Introduction04:44 Cloud Native News18:10 Interview with Kyle58:43 TakeawaysCloud Native News:  https://www.crunchydata.com/blog/announcing-crunchy-postgres-for-kubernetes-5-4https://www.itpro.com/cloud/cloud-security/kubernetes-on-aws-targeted-by-hackers-abusing-legitimate-pentesting-toolshttps://www.scmagazine.com/news/cloud-security/scarleteel-targets-aws-fargate-launches-ddos-as-a-service-campaignshttps://www.techtarget.com/searchitoperations/feature/Practice-troubleshooting-Kubernetes-clusters-using-log-datahttps://www.hashicorp.com/state-of-the-cloudhttps://techcrunch.com/2023/07/12/istio-graduates/https://www.infoq.com/news/2023/07/instacart-flink-kubernetes/https://thenewstack.io/how-to-secure-kubernetes-with-kubelinter/Show Links: RunWhen - https://www.runwhen.com/RunWhen Local - https://docs.runwhen.com/public/runwhen-local/getting-started-with-runwhen-localKyle's LinkedIn - https://www.linkedin.com/in/kyforster/Ugly Command Party - https://www.linkedin.com/feed/update/urn:li:activity:7087375534606712833/
From Manual to Automatic: Revolutionizing Cloud Native Stack Deployment with Argonaut
Jul 6 2023
From Manual to Automatic: Revolutionizing Cloud Native Stack Deployment with Argonaut
In this episode Bhavin and Ryan interview Surya Oruganti, Founder of Argonaut. This episode covers the complexities and challenges production Kubernetes environments encounter, how teams are often wrangling with infrastructure and pipelines rather than enabling teams to focus on developing value. Surya helps explain why these problems led him to create the Argonaut project and platform to get teams off and running with full cloud native stacks with all the bells and whistles like GitOps ready to go.   00:30 Intro07:22 News00:17:18 Interview with Surya01:02:04 Takeaways K8s Bytes Slack ! - https://kubernetesbytes.slack.com/  Try Nom Nom today, go to https://trynom.com/kubernetesbytes and get 50% off your first order plus free shipping.News https://blog.aquasec.com/2023-nautilus-cybersecurity-report-insights-revealed https://siliconangle.com/2023/06/29/causal-ai-company-causely-raises-8-6m-automate-operations/https://www.youtube.com/@PlatformEngineering/playlists?view=50&sort=dd&shelf_id=1https://twitter.com/i/spaces/1vOxwMygjoMGB?s=20  https://www-portainer-io.cdn.ampproject.org/c/s/www.portainer.io/blog/announcing-k2d.io?hs_amp=truehttps://tanzu.vmware.com/content/blog/vmware-tanzu-mission-control-self-managed-announcement https://www.opensourceforu.com/2023/07/netapp-launches-spot-ocean-cd-revolutionising-kubernetes-delivery/   Surya and Argonaut Links https://www.argonaut.dev/ https://www.linkedin.com/in/suryaoruganti/ https://twitter.com/suryaoruganti https://www.linkedin.com/company/argonautdev/https://twitter.com/argonaut_dev