Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024.

Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code “KUBERNETESBYTES” to get a 10% discount on your registration fees!

Nethopper

• Learn more about KAOPS:  @nethopper.io 
• For a supported-demo:  [email protected]
• Try the free version of KAOPS now!   https://mynethopper.com/auth

News

• https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/
• https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415
• https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/
• https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true
• https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/
• https://www.observeinc.com/blog/stepping-on-the-gas/
• https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/
• https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/
• https://www.suse.com/c/meet-rancher-prime-3-0/
• https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/
• https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s 
• https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/ 
• https://github.com/Azure/kaito 
• https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/
• https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/ 
• https://docs.solo.io/gloo-network/latest/about/overview/ 
• https://github.com/kosmos-io/kosmos 
• https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/ 
• https://newrelic.com/press-release/20240319 
• https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/ 

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Charlie Egan, Sr. Developer Advocate at Styra about all things Open Policy Agent or OPA. This episode is meant to be a 101 level episode, where we will learn what OPA is and how it can help improve the security posture for your applications running on Kubernetes. The discussion dives into some of the use cases for OPA and how it helps with Kubernetes admission control,  auditing, etc.   

Check out our website at https://kubernetesbytes.com/  

Episode Sponsor: Elotl  

Links:  

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial 

Timestamps: 

• 07:46 Interview with Charlie 
• 01:02:00 Key takeaways  

Show Links:  

• OPA Ecosystem https://www.openpolicyagent.org/ecosystem/
• OPA Envoy Integration https://github.com/open-policy-agent/opa-envoy-plugin
• Charlie's site: https://charlieegan3.com
• OPA Docs: https://www.openpolicyagent.org/docs/latest/
• OPA Playground: https://play.openpolicyagent.org
• OPA Slack: https://communityinviter.com/apps/openpolicyagent/signup

Join hosts Ryan Wallner and Bhavin Shah of Kubernetes Bytes as they explore the complexities of Internal Developer Platforms (IDPs) with Chris Munford, CEO, and Dan Donahue, Solution Architect of Nethopper. In this episode, the team discusses the challenges of constructing IDPs, achieving the optimal balance of flexibility and prescriptive golden paths. The episode dives into the unique operations perspective required for effective implementation. Gain valuable insights and practical advice from industry leaders on navigating the evolving landscape of IDPs. Don't miss this insightful conversation on unlocking the full potential of IDPs for your organization.

Timestamps

• 00:06:24 - Discussion with Chris and Dan
• 00:51:44 - Takeaways

Episode Links

• What Happened to Platform Engineering? (ebook/pdf)
• LinkedIn Audio Recording  "What Happened to Platform Engineering"
• Website resources on platform engineering/IDP
• LinkedIn Newsletter about KAOPS/Platform Engineering/IDP

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Janakiram MSV - an advisor, analyst and architect to talk about how users can run Generative AI models on Kubernetes. The discussion revolves around Jani's home lab and his experimentation with different LLM models and how to get them running on NVIDIA GPUs. Jani has spent the past year becoming a subject matter expert in GenAI, and this discussion highlights all the different challenges he faced and what lessons he learnt from them.   

Check out our website at https://kubernetesbytes.com/  

Episode Sponsor: Elotl  

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial  

Timestamps: 

• 02:02 Cloud Native News 
• 15:31 Interview with Jani 
• 01:11:00 Key takeaways  

Cloud Native News: 

• https://www.techerati.com/press-release/octopus-deploy-acquires-codefresh-to-boost-kubernetes-and-cloud-native-delivery/
• https://www.civo.com/blog/kubefirst-joins-civo  
• https://cast.ai/kubernetes-cost-benchmark 
• https://www.techradar.com/pro/vmware-customers-are-jumping-ship-as-broadcom-sales-continue-heres-where-theyre-moving-to 
• https://cloudonair.withgoogle.com/events/techbyte-making-ai-ml-scalable-cost-effective-gke
• https://dok.community/dok-events/dok-day-kubecon-paris/ 
• https://training.linuxfoundation.org/certification/certified-argo-project-associate-capa   

Show Links: 

• https://www.youtube.com/janakirammsv 
• https://www.linkedin.com/in/janakiramm/
• - NVIDIA Container Toolkit - https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/index.html
• NVIDIA Device Plugin - https://github.com/NVIDIA/k8s-device-plugin
• NVIDIA Feature Discovery - https://github.com/NVIDIA/gpu-feature-discovery
• Hugging Face Text Gen Inference - https://huggingface.co/docs/text-generation-inference/index
• Hugging Face Text Embeddings Inference - https://huggingface.co/docs/text-embeddings-inference/index
• ChromaDB - https://www.trychroma.com/

In this episode of Kubernetes Bytes. Hosts Bhavin and Ryan dive into what makes up a Internal Development Platform (IDP). Bhavin and Ryan help to define what an IDP is, how it relates to the overarching topic of platform engineering as well as the pros and cons of implementing an IDP.

• 00:03:01 - News
• 00:12:11 - Discussion Topic on IDPs

Discount for KCD New York! https://community.cncf.io/events/details/cncf-kcd-new-york-presents-kcd-new-york-2024/

Please make sure to use the voucher code “KUBERNETESBYTES” to get a 10% discount

News:

• https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/
• https://github.com/Ume0344/mongokube
• https://www.businesswire.com/news/home/20240207876324/en/ZEDEDA-Secures-72M-in-Growth-Capital-to-Meet-the-Skyrocketing-Demand-for-Edge-AI-and-Computing
• https://fintech.global/2024/02/15/ktrust-secures-5-3m-in-seed-funding-to-revolutionise-kubernetes-security
• https://thenewstack.io/kubernetes-predictions-were-wrong/
• https://cloudnativenow.com/features/crossplane-maintainers-add-python-support-to-control-plane/
• https://blog.crossplane.io/crossplane-v1-15/

Links:

• Mercado Libre IDP Talk: https://youtu.be/y-X1ZcPxRnI?si=q9UoglFrZycIcZ_l

IDP Companies and Projects

• Cortex
• OpsLevel
• Port
• Argonaut
• Upbound
• Nethopper
• Mia Platform
• Amazee
• Configure8
• Otomi-Core
• BackStage Roadie
• Qovery
• Plural
• Kubermatic
• Clutch
• Lagoon
• Garden.io
• Portainer

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Jason Dobies - Director of Edge Engineering at SUSE to talk about all things K3s. They discuss why Kubernetes is best suited for Edge deployments, and why K3s was built and how it helps users architect their edge solutions. The discussion goes into topics like Security, Storage, High Availability at the Edge. 

Check out our website at https://kubernetesbytes.com/  

Episode Sponsor: Elotl  

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial 

 Timestamps: 

• 01:20 Cloud Native News 
• 06:01 Interview with Jason 
• 50:42 Key takeaways  

Cloud Native News:

• https://vmblog.com/archive/2024/01/29/dynatrace-to-acquire-runecast-to-enhance-cloud-native-security-and-compliance.aspx - 
• https://chronosphere.io/news/chronosphere-acquires-calyptia/  

Show links: 

• https://k3s.io/ 
• https://www.linkedin.com/in/jdob/

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Lukas Gentele, Co-founder and CEO of Loft Labs to talk about the vCluster project. They discuss how vCluster helps organizations run multi-tenant Kubernetes clusters, where each tenant gets access to a CNCF-conformant Kubernetes cluster, while still being able to deploy everything they need to build and run their applications on Kubernetes. The discussion goes into topics like how Security, Storage, CICD and GitOps work for virtual clusters running on the host clusters.    

Check out our website at https://kubernetesbytes.com/   

Episode Sponsor: Elotl

• https://elotl.co/luna
• https://www.elotl.co/luna-free-trial  

Timestamps: 

• 00:59 Cloud Native News
• 06:51 Interview with Lukas
• 55:09 Key takeaways 

Cloud Native News: 

• https://www.redhat.com/en/blog/krknchaos-joining-cncf-sandbox
• https://cloudnativenow.com/features/red-hat-makes-idp-based-on-backstage-generally-available/
• https://trilio.io/resources/trilio-announces-backup-and-recovery-for-red-hat-openshift-on-ibm-power-systems/
• https://snyk.io/news/snyk-acquires-runtime-data-pioneer-helios/   

Show links: 

• https://loft.sh/blog/how-codefresh-uses-vcluster-to-provide-hosted-argo-cd/
• https://www.coreweave.com/blog/coreweave-and-loft-labs-leverage-vcluster-in-kubernetes-at-scale
• https://www.linkedin.com/in/gentele/
• https://www.vcluster.com/
• https://loft.sh/
• https://slack.loft.sh/

In the first episode of Season 4 for the Kubernetes Bytes podcast, Bhavin sits down with Ahmed Bebars, Staff Software Engineer at NYTimes to talk about how the times uses Kubernetes and Platform Engineering to accelerate their developer productivity and improve developer experience. They talk about what the technology stack at NYTimes looks like, how the platform team has built a resilient platform on Amazon EKS and share some best practices for anyone starting their journey with Platform Engineering.

Check out our website at https://kubernetesbytes.com/

Timestamps:

• 01:20 Cloud Native News
• 09:55 Interview with Ahmed
• 50:04 Key takeaways

Cloud Native News:

• https://www.aquasec.com/news/60m-additional-funding/
• https://devclass.com/2023/12/12/docker-buys-atomicjar-to-integrate-container-based-test-automation/
• https://www.businessinsider.com/armory-acquired-startup-harness-7-million-2023-12
• https://techcrunch.com/2023/12/19/scaleops-looks-to-cut-cloud-bills-by-automating-kubernetes-configurations
• https://wraltechwire.com/2023/12/21/ciscos-latest-cloud-play-exec-explains-the-deal-for-tech-startup-isovalent/
• https://www.kubernetes.dev/resources/release/

Show links:

• https://open.nytimes.com/
• https://tickets.kcdnewyork.com/
• https://github.com/abebars
• https://www.linkedin.com/in/ahmedbebars/
• https://github.com/nytimes

Learn along side Bhavin and Ryan as they dig into some of basics of Artificial Intelligence, Machine Learning and Deep Learning. They explore what terms mean, what the basic differences are and take an introductory look at how companies approaches to building and using models for various use cases.

News

• https://aws.amazon.com/blogs/aws/amazon-eks-pod-identity-simplifies-iam-permissions-for-applications-on-amazon-eks-clusters/
• https://aws.amazon.com/blogs/aws/use-aws-fault-injection-service-to-demonstrate-multi-region-and-multi-az-application-resilience/

Show Links

• Vector DB Talk DoK https://www.youtube.com/watch?v=uxoqMgFKAlM
• https://www.kubeflow.org/docs/components/pipelines/v1/introduction/
• https://weaviate.io/blog/what-is-a-vector-database
• https://huggingface.co/
• https://docs.ray.io/en/latest/ray-overview/getting-started.html
• https://kueue.sigs.k8s.io/docs/overview/
• https://www.datastax.com/guides/what-is-a-vector-index
• https://www.datastax.com/guides/what-is-vector-search
• https://medium.com/building-the-open-data-stack/whats-a-vector-database-c3e8b6bb0436
• https://www.pinecone.io/blog/aws-reference-architecture/

In this episode, Ryan and Bhavin talk about Kubecon + Cloud Native Con North America 2023 in Chicago, and discuss all the vendor announcements from the past couple of weeks. Kubecon North America was in Chicago and had more than 13500 attendees and shows a continuous increase in adoption of Kubernetes as the platform to run containers, virtual machines, AI workloads, etc.  

Check out the KubernetesBytes website: https://www.kubernetesbytes.com/

Ads:

• Ready to shop better hydration, use "kubernetesbytes" to save 20% off anything you order.
• Try Nom Nom today, go to https://trynom.com/kubernetesbytes and get 50% off your first order plus free shipping.

Find all the links to the things we discussed during the episode here:  https://docs.google.com/document/d/169mrZGi7oYptuT1nXrmuy-uwIlrAYZ8jJR3p5vRZ5Vo/edit?usp=sharing

In this episode of KubernetesBytes, Bhavin and Ryan interview Viktor Farcic, a Developer Advocate from Upbound, the company behind Crossplane. Crossplane extends Kubernetes into becoming a universal control plane for more than what runs in Kubernetes, however, you get to manage everything in a Kubernetes-native way. Hear what Viktor has to say about Crossplane and what hes been up to.  

• 01:35 Introduction 
• 08:29 Cloud Native News 
• 16:15 Crossplane with Viktor

 Cloud Native News 

• https://www.chainguard.dev/unchained/series-b-funding  
• https://www.honeycomb.io/blog/introducing-honeycomb-for-kubernetes?hss_channel=lcp-12957659 
• https://techcrunch.com/2023/10/18/microsoft-launches-radius-an-open-source-application-platform-for-the-cloud/ 
• https://docs.radapp.io/ 
• https://thehackernews.com/2023/10/urgent-new-security-flaws-discovered-in.html 
• https://www.techtarget.com/searchdatabackup/news/366557752/CloudCasa-now-offers-self-hosted-Kubernetes-backup-service 
• https://finance.yahoo.com/news/kubecost-launches-cloud-cost-optimization-080000850.html   

Links 

• https://youtube.com/@UCfz8x0lVzJpb_dgWm9kPVrw
• https://docs.crossplane.io/ 
• https://www.crossplane.io/community