Guests are Maciej Rozacki, Product Manager on GKE for AI Training, and Wojciech Tyczyński, Software Engineer on the GKE team at Google. We explore what it means for GKE to support 65k nodes, and the open source contributions that made this possible

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

 

News of the week

The Kubernetes Podcast is on Bluesky

OpenTelemetry expanding into CI/CD observability

Gitpod is moving away from Kubernetes

OpenCost is a CNCF Incubated project

Links from the interview

Guests:

• Maciek

• Wojciech

Kubernetes OSS Scalability thresholds

PGS on the Kubernetes Podcast

Batch Working Group

Serving Working Group episode on the podcast

Dynamic Resource Allocation

Kueue

Multitenancy and Fairness at Scale with Kueue

SIG Scalability

Links from the post-interview chat

Consistent Reads from Cache

Kubernetes Scalability: A Multi-Dimensional Analysis

 

Yuan is a principal software engineer at Red Hat, working on OpenShift AI. Previously, he has led AI infrastructure and platform teams at various companies. He holds leadership positions in open source projects, including Argo, Kubeflow, and Kubernetes WG Serving. Yuan authored three technical books and is a regular conference speaker, technical advisor, and leader at various organizations.

Eduardo is an environmental engineer derailed into a software engineer. Eduardo has been working on making containerized environments the de facto solution for High Performance Computing(HPC) for over 8 years now. Began as a core contributor to the niche Singularity Containers, today known as Apptainer under the Linux foundation. In 2019 Eduardo moved up the ladder to work on making Kubernetes better for performance oriented applications. Nowadays Eduardo works at NVIDIA on the Core Cloud Native team working on enabling specialized accelerators into Kubernetes workloads.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

News of the week

Docker official terraform provider

Tetrate and Bloomberg Envoy AI Gateway 

KubeCon+CloudNativeCon North America 2024 laptop drive

Remaining KCDs for 2024

Links from the interview

Yuan Tang

Eduardo ArangoWG Serving

Kserve

Kserve Serving models with OCI images

LLM Gateway

Dynamic Resources Allocation

 

This episode is special. We collaborated with the folks behind the Cloud Security Podcast from Google, Anton Chuvakin(LinkedIn)and Tim Peacock, to bring you a joint episode. We had the pleasure to jointly interview Michelle Chubirka, a Cloud Security Developer Advocate. We talked about VM and Container security, debunked some myths about isolation, attack surfaces, immutability of containers, and more.

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

News of the week

• Nvidia NIM on GKE

• Kubernetes Steering Committee Election Results for 2024

• The schedule for KubeCon and CloudNativeCon India

• Diagrid Catalyst Beta

• Dapr on the Kubernetes Podcast with Salaboy

Links from the interview

• Cloud Security Podcast

• Anton Chuvakin

• Tim Peacock

• Michelle Chubirka

• Dora report

• Container Security: It’s All About the Supply Chain - Michele Chubirka

• Software composition analysis (SCA)

• DevSecOps Decisioning Principles

• Kubernetes CIS Benchmark

• Cloud-Native Consumption Principles

• State of WebAssembly outside the Browser - Abdel Sghiouar

• Why Perfect Compliance Is the Enemy of Good Kubernetes Security - Michele Chubirka - KubeCon NA 2024

Links from the post-interview chat

• Cloud Code

• Skaffold

• Introduction to Distributed ML Workloads with Ray on Kubernetes - Mofi Rahman & Abdel Sghiouar - KubeCon NA 2024

Marvin Beckers is a Team Lead at Kubermatic and a contributor and maintainer of the CNCF Sandbox Project, KCP. KCP is an open source horizontally scalable control plane for Kubernetes-like APIs.

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

News of the week

• [Docker Blog] Announcing Upgraded Docker Plans: Simpler, More Value, Better Development and Productivity 

• [LinuxFoundation Blog] Linux Foundation Announces Intent to Form Developer Relations Foundation

• [Computer Weekly Article] NetApp Insight 2024 - Live show report: day zero

Links from the interview

• KCP

• Kubernetes Resource Model (KRM)

• Crossplane

Links from the post-interview chat

• Cloud Native Maturity Model

 

Guests are Avin Regmi and David Xia from Spotify. We spoke to Avin and David about their work building Spotify’s Machine Learning Platform, Hendrix. They also specifically talk about how they use Ray to enable inference and batch workloads. Ray was featured on episode 235 of our show, so make sure you check out that episode too.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

News of the week

IBM acquired Kubecost

KubeCon Japan in 2025

Call for Proposals for KubeCon EU 2025 is now open

Artifact Hub is a CNCF incubating project

OpenMetrics is dead, long live OpenMetrics

Kubecolor 0.4.0

Links from the interview

Avin Regmi

David Xia

Hendrix ML Platform

Ray on Kubernetes

KubeRay

Workbench instances

Backstage

PyTorch

Ray Summit 2024

Kueue

Solomon Hykes is the co-founder of Dagger. He is probably best known as the creator of Docker. The tool that changed how developers package, run and distribute software in the last 11 years. His impact on our industry is undeniable. Today, we discuss his new venture, Dagger. Dagger is a new approach to how we do CI/CD.

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

News of the week

• Kubeadm v1beta4

• 1.32 Release Cycle Info

• Updates to the Certified Kubernetes Administrator Exam

• 2024 Generative AI Survey

• Microsoft Azure Advanced Container Networking enhancements

 

Links from the interview

• Solomon Hykes on LinkedIn

• Dagger

• OpenStack

• Act (GitHub Actions Locally)

• Buildkit

• Cue

• GraphQL

• Dagger Discord

• Caching - Dagger Documentation

• Bazel

• Terraform

• Pulumi

• Kubectl

• gRPC

• GraphQL

• Google Cloud’s Package Index

• The Daggerverse

• Cloud Foundry

• PostHog

• RedHat Development Model

Links from the post-interview chat

• Scaffold

• Solomon Hykes - Docker, Dagger, and the Future of DevOps

• Directed Acyclic Graphs

• Solomon Hykes on wikipedia

• Stack Overflow

 

In this episode, guest host and AI correspondent Mofi Rahman interviews Richard Liaw and Kai-Hsun Chen from Anyscale about Ray and KubeRay. Ray is an open-source unified compute framework that makes it easy to scale AI and Python workloads, while KubeRay integrates Ray’s capabilities into Kubernetes clusters.

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

 

News of the week

• CNCF Blog - LitmusChaos audit complete!

• Kubernetes Podcast from Google episode 234 - LitmusChaos, with Karthik Satchitanand

• Google Cloud Blog - Run your AI inference applications on Cloud Run with NVIDIA GPUs

• Diginomica article - KubeCon China - at 33-and-a-third, Linux is a long player. So, why does Linus Torvalds hate AI?

• CNCF-Hosted Co-Located Event Schedule for KubeCon NA 2024 

• Google Kubernetes Engine Release Notes - August 20, 2024 (1.31 available in Rapid Channel)

• Kubernetes Podcast from Google - Kubernetes v1.31: "Elli", with Angelos Kolaitis

• Red Hat Press Release - Red Hat OpenStack Services on OpenShift is Now Generally Available

• Red Hat Enables OpenStack to Run Natively on OpenShift Platform

• Broadcom Revamps Tanzu to Simplify Cloud-Native App Development and Deployment

• Tanzu Platform 10 Offers Cloud Foundry Users Deep Visibility and Productivity Enhancements

• VMware Explore Conference Website

• CNCF Blog - Announcing 500 Kubestronauts

• CNCF - Kubestronaut FAQ

• Dapr Day 2024 Virtual Event Website

Links from the interview

• Kai-Hsun Chen on LinkedIn

• Richard Liaw on LinkedIn

• Ray from the RISE Lab at UC Berkeley

• Ray: A Distributed System for AI by Robert Nishihara and Philipp Moritz - Jan 9, 2018

• KubeRay Docs

• KubeRay on GitHub

• PyTorch

• Apache Airflow

• Apache Spark

• Kubeflow

• Apache Submarine (retired)

• Jupyter Notebooks

• VS Code

• Examples of schedulers for Batch/AI workloads in Kubernetes

  • Kueue

  • Volcano

  • Apache Yunikorn

• Examples of observability tools for Batch/AI workloads in Kubernetes

  • Prometheus

  • Grafana

  • Fluentbit

• Examples of loadbalancers

  • Nginx

  • Istio

• Ray Data: Scalable Datasets for ML

• Dask Python - Parallel Python

• Ray Serve: Scalable and Programmable Serving

• HPA - Horizontal Pod Autoscaling in Kubernetes

• Karpenter - “Just-in-time nodes for any Kubernetes cluster”

• Lazy Computation Graphs with the Ray DAG API

• Types of hardware accelerators

  • Google Cloud Tensor Processing Units (TPUs)

  • AMD Instinct

  • AMD Radeon

  • AWS Trainium

  • AWS Inferentia

• Pandas

• Numpy

• KubeCon EU 2024 - Accelerators(FPGA/GPU) Chaining to Efficiently Handle Large AI/ML Workloads in K8s - Sampath Priyankara, Nippon Telegraph and Telephone Corporation & Masataka Sonoda, Fujitsu Limited

• NVidia Megatron

Links from the post-interview chat

• DRA - Dynamic Resource Allocation in Kubernetes

• Different ways of Running RayJob on Kubernetes

• Ray framework diagram in the docs

 

In this episode, we spoke to Karthik Satchitanand. Karthik is a principal software engineer at Harness and co-founder and maintainer of LitmusChaos, a CNCF incubated project. We talked about Chaos engineering , the Litmus project and more.

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

 

News of the week

• Kubernetes 1.31 release blog

• Kubernetes 1.31 release episode of the Kubernetes Podcast from Google

• KubeCon NA 2024 Schedule

• Score accepted as a CNCF Sandbox Project

 

Links from the interview

• LitmusChaos

• principlesofchaos.org

• Okteto

• LitmusChaosCon

• community.cncf.io

 

Links from the post-interview chat

• Chaos Monkey

• Chapter 5 of “Chaos Engineering” by Casey Rosenthal, Nora Jones, published by O’Reilly, covers DiRT

• LitmusChaos ChaosHub

• Klustered on YouTube

• Rawkode Academy

 

Guest is Angelos Kolaitis, Angelos is a senior Software Engineer at Canonical working on Kubernetes. He has multiple contributions to open source projects, a highlight of which is his involvement in the Kubernetes Release Team since Kubernetes v1.26.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

 

News of the week

• Gemma2 2b

• AWS deprecates services

• Refreshing the KCD program: a new chapter in community building

Links from the interview

• Angelos Kolaitis

• kubernetes 1.31 release blog

• Kat Cosgrove k8s 1.30 release lead

• Kubernetes 1.31 Removals and Major Changes

• KEP-3063 Dynamic Resource Allocation

Links from the post-interview chat

• Completing the largest migration in Kubernetes history

Ohad Maislish is the CEO and co-founder of env0 and part of the founding team for the OpenTofu project. Before env0, Ohad was the CEO and founder of Arno Software, a cloud infrastructure services company, and Capester, a startup that empowered citizens in smart cities worldwide. Over the course of this career, Ohad has also served in different technical and management roles at Ravello Systems, eToro, and VMware. He was also the youngest developer at Microsoft Israel at the age of 17, after starting his bachelor's degree at the age of 14.

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

News of the week

The Kubernetes Removals and Major Changes blog for v1.31

Google Cloud Announced GKE Extended support

Bob Killen has joined as a Senior Technical Program Manager

Microsoft announced general availability of Microsoft Azure Container Storage

CNCF Glossary Turkish edition

Links from the interview

Ohad Maislish

• LinkedIn

• Twitter/X

IaC Podcast

OpenTofu

OpenTofu Day

OpenTofu Manifesto

OpenTofu announcement

OpenTofu state encryption

OpenTofu 1.8 early evaluation of variables

ValKey

AWS Support for ValKey

KubeCon EU Co-lo: Atlantis and OpenTofu: The Future of Open-Source IaC

Links from the post-interview chat

Abdel chatting on the IaC Podcast at kubeCon Paris 24

OpenTofu State and Plan Encryption

IaC Podcast

 

Mauricio Salatino is a software engineer at Diagrid working on the Dapr project but also serves as a chair for the newly formed App Development Working Group under the TAG App Delivery for the CNCF. He also serves as a member of the steering committee for Knative and the Keptn project.  Mauricio authored a book about Platform Engineering on Kubernetes for Manning and co-authored some books on Jboss. He used to work for Red Hat and VMware. 

 

Do you have something cool to share? Some questions? Let us know:

- web: kubernetespodcast.com

- mail: [email protected]

- twitter: @kubernetespod

 

News of the week

• ArgoCD announced that ArgoRollouts now supports version 1.0 of the Kubernetes Gateway API

• Gateway API Supported providers

• Google has released Gemma 2

Links from the interview

• Dapr (Distributed Application Runtime)

• JBoss

• Overview of JNDI (Java Naming and Directory Interface)

• Secrets Management Overview on Dapr

• Knative

• Java Spring Boot

• App Development Working Group (Cloud Native Computing Foundation)

• Spring AI

• Langchain

• Dapr and service meshes

• Istio

• Vcluster

• Testcontainers