Loading…
CNCF-hosted Co-located Events Europe 2025 taking place on 1 April. This event is happening in person at Excel London in London, England.

The Sched app allows you to build your schedule, but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2025, and have an All-Access pass in order to participate in the sessions.

To view the full event schedule for a specific CNCF-hosted Co-located event, you can use the right-hand navigation bar to sort and filter.

The schedule is subject to change.
← Back to schedule
Platform Engineering and DevEx for Your On-Prem LLM - Hannah Foxwell, Kortensia
Tuesday April 1, 2025 15:20 - 15:45 BST
Level 1 | Hall Entrance N10 | Room H
Your CEO wants AI and they want it now. They want it now BUT you can’t just hand over all your confidential data to a Cloud or SaaS provider. Your CISO is losing sleep.

What options do you have to keep your CEO, your developers and security happy?

We’ll tell the story of how we set up an internal development platform (IDP) AROUND a self-hosted LLM on Kubernetes. From the outset our goal was to use Platform Engineering practices, so our engineers could benefit from "paved paths" for:

- Knowledge integrations (commonly known as RAG)
- API integrations, so you can connect your LLM to business applications
- Quality assurance tooling such as the LLM-as-a-judge pattern

This will be a live demo of how to stand up an entire IDP for GenAI apps that you can replicate yourself using open source tools. During the demo we’ll share the lessons learned along the way and how we ended up with the solution we use in production today.

Happy CEO? Yes. Happy CISO? Yes. Happy Developers? Hell Yes!
Speakers
avatar for Hannah Foxwell

Hannah Foxwell

Independent Consultant, Kortensia
With over a decade of experience in technology transformation Hannah has always advocated for the human impact of change. Hannah now works as an independent adviser and consultant at the intersection of Platform Engineering, Security and AI. As founder of AI for the rest of us... Read More →
Tuesday April 1, 2025 15:20 - 15:45 BST
Level 1 | Hall Entrance N10 | Room H
  Platform Engineering Day, Designing paved paths

Attendees (5)


Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link