Bret and Nirmal Mehta are joined by Ken Collins to dig into using AI for more than coding, and if we can build an AI assistant that knows us.
They touch on a lot of tools and platforms. "We're bit all over the place on this one, from talking about AI features in our favorite note taking apps like Notion, to my journey of making an open AI assistant with all of my Q&A from my courses, thousands of questions and answers, to coding agents and more."

Ken is a local friend in Virginia Beach and was on the show last year talking about AWS Lambda, and we've both been trying to find value in all of these AI tools for our day to day work.

Be sure to check out the live recording of the complete show from October 24, 2024 on YouTube (Stream 279).

★Topics★
The Lifestyle Copilot Blog Post
Serverless AI Inference with Gemma 2 Blog Post

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Ken Collins - Guest
• Nirmal Mehta - Host

• (00:00) - Intro
• (01:26) - AI in Recruitment at Torc
• (03:25) - AI for Day to Day Workflows
• (04:44) - Notion AI and RAG
• (07:20) - Creating Your Own AI Search Solution
• (13:59) - Choosing the Right LLM for the Job
• (20:55) - Personal AI and Long Context Windows
• (25:10) - Future of Personal Fine-Tuned Models
• (25:52) - AI Assistants in Meetings
• (27:34) - Temperature and AI Hallucinations
• (32:07) - Agents and Tool Integration
• (39:31) - Apple Intelligence and Personal AI
• (44:56) - AI Apps on Mobile
• (50:00) - LoRA

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret explores the spectrum of user interfaces and tools available for managing Kubernetes clusters as of Autumn 2024.
This solo episode touches on both paid and open-source options, looking at their features, benefits, and drawbacks. Key tools covered include Lens, Aptakube, K8Studio, Visual Studio Code's Kubernetes extension, K9S, Portainer, and Meshery.

Bret also discusses specialized tools like Headlamp and the Argo CD dashboard, and their specific use cases and advantages.

★Topics★

• Lens
• Aptakube
• K8Studio
• K9s
• Kubernetes Dashboard
• Portainer
• Meshery
• Headlamp

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host

• (00:00) - Intro
• (01:43) - Paid UI Offerings
• (02:22) - Lens
• (03:42) - Aptakube and K8Studio
• (04:30) - Free and Open Apps
• (05:42) - K9s
• (06:45) - SaaS Offerings
• (07:32) - Web Dashboards
• (08:08) - Portainer
• (09:08) - Meshery
• (11:14) - Headlamp
• (13:28) - Argo CD's Web Dashboard

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret and Nirmal are joined by Chris Kühl and Jose Blanquicet, the maintainers of Inspektor Gadget, the new eBPF-focused multitool, to see what it's all about.
Inspektor Gadget, aims to solve some serious problems with managing Linux kernel-level tools via Kubernetes. Each security, troubleshooting, or observability utility is packaged in an OCI image and deployed to Kubernetes (and now Linux directly) via the Inspektor Gadget CLI and framework.

Be sure to check out the live recording of the complete show from September 12, 2024 on YouTube (Stream 277).

★Topics★
Inspektor Gadget website
Inspektor Gadget Docs
GitHub Repository

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Nirmal Mehta - Host
• Chris Kühl - Guest
• Jose Blanquicet - Guest

• (00:00) - Intro
• (01:33) - Why Inspektor Gadget?
• (05:49) - Who is Inspektor Gadget For?
• (21:07) - Windows Nodes Support
• (22:15) - Stress Testing and OOM
• (26:50) - Ensuring Safe Use of eBPF Tools
• (32:42) - Future Roadmap and Platform Support
• (36:17) - Getting Started with Inspektor Gadget

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret and Nirmal are joined by Maria Vechtomova, a MLOps Tech Lead and co-founder of Marvelous MLOps, to discuss the obvious and not-so obvious differences between a MLOps Engineer and traditional DevOps jobs.
Maria is here to discuss how DevOps engineers can adopt and operate machine learning workloads, also known as MLOps. With her expertise, we'll explore the challenges and best practices for implementing ML in a DevOps environment, including some hot takes on using Kubernetes.

Be sure to check out the live recording of the complete show from June 20, 2024 on YouTube (Stream 271).

★Topics★
Marvelous MLOps on LinkedIn
Marvelous MLOps Substack
Marvelous MLOps YouTube Channel

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Maria Vechtomova - Guest
• Nirmal Mehta - Host

• (00:00) - Intro
• (02:04) - Maria's Content
• (03:22) - Tools and Technologies in MLOps
• (09:21) - DevOps vs MLOps: Key Differences
• (19:22) - Transitioning from DevOps to MLOps
• (22:52) - Model Accuracy vs Computational Efficiency
• (24:46) - MLOps with Sensitive Data
• (29:10) - MLOps Roadmap and Getting Started
• (32:36) - Tools and Platforms for MLOps
• (37:14) - Adapting MLOps Practices to Future Trends
• (44:08) - Is Golang an Option for CI/CD Automation?

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret and Nirmal were joined by Emile Vauge, CTO of Traefik Labs to talk all about Traefik 3.0.
We talk about what's new in Traefik 3, 2.x to 3.0 migrations, Kubernetes Gateway API, WebAssembly (Cloud Native Wasm), HTTP3, Tailscale, OpenTelemetry, and much more!

Be sure to check out the live recording of the complete show from June 6, 2024 on YouTube (Stream 269). Includes demos.

★Topics★
Traefik Website
Traefik Labs Community Forum
Traefik's YouTube Channel
Gateway API helper CLI
ingress2gateway migration tool

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Nirmal Mehta - Host
• Emile Vauge - Guest

• (00:00) - Intro
• (02:20) - Origins of Traefik
• (05:01) - The Road to 3.0
• (06:20) - Balancing Stability and Innovation
• (08:25) - Migration to Traefik 3.0
• (14:58) - WebAssembly and Plugins in Traefik
• (21:43) - Gateway API and gRPC Support
• (30:32) - Gateway API Components and Configuration
• (33:35) - Tools for Gateway API Management
• (40:08) - OpenTelemetry Integration
• (47:21) - Future Plans and Community Contributions

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret is joined by DockerSlim (now mintoolkit) founder Kyle Quest, to show off how to slim down your existing images with various options.
The slimming down includes distroless images like Chainguard Images and Nix. We also look at using the new "mint debug" feature to exec into existing images and containers on Kubernetes, Docker, Podman, and containerd. Kyle joined us for a two-hour livestream to discuss mint’s evolution.

Be sure to check out the live recording of the complete show from May 30, 2024 on YouTube (Stream 268). Includes demos.

★Topics★
Mint repository in GitHub

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Kyle Quest (aka Q) - Guest

• (00:00) - Intro
• (02:26) - The Evolution of Docker Slim
• (04:43) - Docker Slim's First Feature
• (10:04) - Forcing Change is Not Always Possible
• (13:29) - Docker Slim Name Change to Mintoolkit
• (15:13) - Dive vs Mint
• (18:45) - Mint and the Problem with Container Debugging
• (28:25) - AI-Assisted Debugging
• (34:46) - Hands-On Debugging Examples
• (41:27) - Debugging a Podman Image
• (49:00) - Kubernetes Debugging Example
• (59:00) - What is KoolKits?
• (01:05:48) - Future Plans for Mintoolkit
• (01:06:44) - cdebug: Dedicated Debugging Tool for Containers

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret is joined by Shahar Azulay, Groundcover CEO and Co-Founder, to discuss their new approach to fully observe K8s and its workloads with a "hybrid observability architecture."
Groundcover is a new, cloud-native, eBPF-based platform that designed a new model for how observability solutions are architected and priced. It is a product that can drastically reduce your monitoring, logging, and tracing costs and complexity, it stores all its data in your clusters and only needs one agent per host for full observability and APM.

We dig into the deployment, architecture, and how it all works under the hood.

Be sure to check out the live recording of the complete show from June 27, 2024 on YouTube (Stream 272). Includes demos.

★Topics★
Groundcover Discord Channel
Groundcover Repository in GitHub
Groundcover YouTube Channel
Join the Groundcover Slack

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Shahar Azulay - Guest

• (00:00) - Intro
• (03:16) - Shahar's Background and GroundCover's Origin
• (06:34) - Where Did the Hybrid Idea Come From?
• (12:11) - GroundCover's Deployment Model
• (18:21) - Monitoring More than Kubernetes
• (20:32) - eBPF from the Ground Up
• (23:58) - How Does Groundcover read eBPF Logs?
• (32:06) - GroundCover's Stack and Compatibility
• (36:18) - The Importance of PromQL
• (37:41) - Groundcover Also OnPrem and Managed
• (49:35) - Getting Started with Groundcover
• (52:15) - Groundcover Caretta
• (54:55) - What's Next for Groundcover?

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret and Nirmal are joined by Continue.dev co-founder, Nate Sesti, to walk through an open source replacement for GitHub Copilot.
Continue lets you use a set of open source and closed source LLMs in JetBrains and VSCode IDEs for adding AI to your coding workflow without leaving the editor.

You've probably heard about GitHub Copilot and other AI code assistants. The Continue team has created a completely open source solution as an alternative, or maybe a superset of these existing tools, because along with it being open source, it's also very configurable and allows you to choose multiple models to help you with code completion and chatbots in VSCode, JetBrains, and more are coming soon.

So this show builds on our recent Ollama show. Continue uses Ollama in the background to run a local LLM for you, if that's what you want to Continue to do for you, rather than internet LLM models.

Be sure to check out the live recording of the complete show from May 16, 2024 on YouTube (Ep. 266). Includes demos.

★Topics★
Continue.dev Website

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Nirmal Mehta - Host
• Nate Sesti - Guest

• (00:00) - Introduction
• (01:52) - Meet Nate Sesti, CTO of Continue
• (02:40) - Birth and Evolution of Continue
• (03:56) - Continue's Features and Benefits
• (22:24) - Running Multiple Models in Parallel
• (26:38) - Best Hardware for Continue
• (32:45) - Other Advantages of Continue
• (36:08) - Getting Started with Continue

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret and Nirmal are joined by Michael Fischer of AWS to discuss why we should use Graviton, their arm64 compute with AWS-designed CPUs.
Graviton is AWS' term for their custom ARM-based EC2 instances. We now have all major clouds offering an ARM-based option for their server instances, but AWS was first, way back in 2018. Fast forward 6 years and AWS is releasing their 4th generation Graviton instances, and they deliver all the CPU, networking, memory and storage performance that you'd expect from their x86 instances and beyond.

I'm a big fan of ARM-based servers and the price points that AWS gives us. They have been my default EC2 instance type for years now, and I recommend it for all projects I'm working on with companies.

We get into the history of Graviton, how easy it is to build and deploy containers and Kubernetes clusters that have Graviton and even two different platform types in the same cluster. We also cover how to build multi-platform images using Docker BuildKit.

Be sure to check out the live recording of the complete show from May 9, 2024 on YouTube (Ep. 265). Includes demos.

★Topics★
Graviton + GitLab + EKS
Porting Advisor for Graviton
Graviton Getting Started

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Nirmal Mehta - Host
• Michael Fischer - Guest

• (00:00) - Intro
• (06:19) - AWS and ARM64: Evolution to Graviton 4
• (07:55) - AWS EC2 Nitro: Why and How?
• (11:53) - Nitro and Graviton's Evolution
• (18:35) - What Can't Run on Graviton?
• (23:15) - Moving Your Workloads to Graviton
• (27:19) - K8s Tooling and Multi-Platform Images
• (37:07) - Tips for Getting Started with Graviton

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret and Nirmal are joined by friend of the show, Matt Williams, to learn how to run your own local ChatGPT clone and GitHub Copilot clone with Ollama and Docker's "GenAI Stack," to build apps on top of open source LLMs.

We've designed this conversation for tech people like myself, who are no strangers to using LLMs in web products like chat GPT, but are curious about running open source generative AI models locally and how they might set up their Docker environment to develop things on top of these open source LLMs.

Matt Williams is walking us through all the parts of this solution, and with detailed explanations, shows us how Ollama can make it easier on Mac, Windows, and Linux to set up LLM stacks.

Be sure to check out the video version of this episode for any demos.

This episode is from our YouTube Live show on April 18, 2024 (Stream 262).

★Topics★

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• Matt Williams - Host
• Nirmal Mehta - Host

• (00:00) - Intro
• (01:32) - Understanding LLMs and Ollama
• (03:16) - Ollama's Elevator Pitch
• (08:40) - Installing and Extending Ollama
• (17:17) - HuggingFace and Other Libraries
• (19:24) - Which Model Should You Use?
• (26:28) - Ollama and Its Applications
• (28:57) - Retrieval Augmented Generation (RAG)
• (36:44) - Deploying Models and API Endpoints
• (40:38) - DockerCon Keynote and LLM Demo
• (47:44) - Getting Started with Ollama

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

Bret is joined by Jasper Paul and Vinoth Kanagaraj, observability experts and Site24x7 Product Managers, to discuss achieving end-to-end visibility for applications on Kubernetes infrastructure. We answer questions on all things monitoring, OpenTelemetry, and KPIs for DevOps and SREs.

We talk about the industry's evolution from monitoring to full observability platforms, as well as adjacent topics for helping you with your own Kubernetes and application monitoring, including going through some of the most useful metrics in Kubernetes and AI's role in metric analysis and alerting humans.

Be sure to check out the live recording of the complete show from April 25, 2024 on YouTube (Ep. 263). Includes demos.

★Topics★
Site24x7 Full stack observability
Site24x7 Kubernetes monitoring
Voting App

Creators & Guests

• Cristi Cotovan - Editor
• Beth Fisher - Producer
• Bret Fisher - Host
• J.P. Jasper - Guest

• (00:00) - Intro
• (02:01) - Observability vs Monitoring
• (08:32) - The New App Health Layer
• (14:39) - Attributes Collected
• (17:47) - Unified Observability
• (19:00) - AI-Powered Insights: The Role of AIOps
• (21:51) - OpenTelemetry and Multi-Cluster Monitoring
• (25:45) - Windows Support
• (26:06) - Correlating Requests Between Microservices
• (28:14) - Synthetic vs Real-Time Monitoring
• (30:25) - Dashboards, Tracing and Metrics
• (37:17) - Getting Started

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com