Featured Ebook The CFO’s Guide to AWS Commitments - Download Now

  • Home
  • nCast
  • Episode 8: Operating ML and GenAI at scale: the latest on Kubernetes, Karpenter and Bedrock

Episode 8: Operating ML and GenAI at scale: the latest on Kubernetes, Karpenter and Bedrock

Operating ML and GenAI at scale

In this episode of nCast, we’re joined by AWS Partner Solutions Architects Andrew Park and Mike McDonald to discuss the complexities and cost of running today’s ML and GenAI workloads on the cloud.

From anecdotes of the bad old days before container orchestration to the present challenge of simplifying infrastructure operation – our panelists share the best strategies to free Data Scientists and Engineers to focus on building and innovating.

Don’t miss the entertaining discussion about the merits, pitfalls, and potential of various cost-optimizing tools and approaches, plus:

  • The lowdown on AWS Bedrock and where it fits into the current stack of the latest AWS ML and AI offerings — how it works, use cases, the access it grants to new generative AI models
  •  How Karpenter can make your life easy and save you SO much money
  • And hot takes on the controversial question: is ECS dead?

Sound Bites : Tip of the week

Video

Publish Date

Meet our hosts
Operating ML and GenAI at scale

James Wilson

nOps

Operating ML and GenAI at scale

Andrew Park

AWS

Operating ML and GenAI at scale

Mike McDonald

AWS

Listen and Subscribe

Related Episodes

Podcast episode 1 image from nOps.
Episode 1: Kubernetes 101: History, Cost Optimization, and the State of K8s Today

Welcome to episode 1 of nCast, where we explore the fascinating world of container orchestration and optimization. In this episode, our hosts Andrew and James will take us on a journey through the history of container orchestration, highlighting various optimization strategies along the way.

Podcast episode 2 image from nOps.
Episode 2: Commitment Issues? Why Engineers Struggle with Reserved Instances & Savings Plans

Welcome to Episode 2 of our podcast series! In this episode, we tackle the complexities of AWS savings tools and explore the reasons behind why engineers struggle with making commitments.

Start now with nOps

Discover how much could you save by connecting your AWS cloud infrastructure with nOps

Join the nCast

Join our podcast as a speaker and share your expertise with our listeners! Contact us now to be featured on our next episode.