CNCF-hosted Co-located Events Europe 2025

LLMs moving beyond data centers to edge devices. While this migration promises reduced latency and enhanced privacy, challenges come: maintaining accuracy within limited resources, and cross-device deployment problems.

The integration of KubeEdge and WasmEdge addresses the challenge. WasmeEdge is a lightweight, portable runtime (less than 50MB) without external dependencies. The KubeEdge Sedna orchestrates the edge-cloud collaboration. It monitors inference accuracy and automatically routes requests to cloud-based models when edge processing doesn't meet accuracy thresholds.

This session will demo that small LLMs provide quick, local inference at the edge. When higher accuracy is needed, Sedna seamlessly transitions to larger models in the cloud. The inference workload is built in Rust and compiled to Wasm, enabling deployment across edge and cloud without any changes.

The solution has been implemented in production across multiple industries like aerospace and bank branches.