AI in Kubernetes: How to Get Started?

CNCF [Cloud Native Computing Foundation] November 7, 2024
Video Thumbnail
CNCF [Cloud Native Computing Foundation] Logo

CNCF [Cloud Native Computing Foundation]

@cncf

About

To provide educational and informative content on cloud native computing, which uses an open source software stack to deploy applications as microservices, packaging each part into its own container, and dynamically orchestrating those containers to optimize resource utilization. Educational content on CNCF projects, like Kubernetes and Prometheus, will also be provided.

Video Description

In this session, you will learn how Kubernetes, designed years before AI became the mainstream force that is today, brings a host of key features that make it a stable platform to support the ML model development lifecycle. From data ingestion to serving, K8s offers autoscaling, GPU device management, idempotent operations, Pod templating, and more; supporting the iterative and distributed nature of AI-powered app development. Using the Flyte open source orchestrator, you'll see how all these features can be leveraged today from an ML pipeline developed in Python.

You May Also Like