Loading…
Thursday August 13, 2026 13:50 - 14:15 KST
This talk shares lessons from rebuilding a production LLMOps feedback system after its original pipeline architecture became too difficult to extend and operate in practice. The system was initially designed as a modular, cloud-native pipeline that handled community exercise data end to end—from collection and analysis to feedback generation and publishing. As new capabilities were added, coordinating cross-step dependencies, managing state, and evolving the workflow without breaking existing logic became a growing challenge.
To address this, we restructured the system around MCP tools. Each core function—data ingestion, exercise analysis, recommendation generation, and feedback delivery—was refactored into an independently callable tool that agents can dynamically orchestrate. We will discuss how we handled multi-step coordination without losing state, partial failures and retries across tool boundaries, observability in agent-driven execution, and secure tool interaction in a production environment. Rather than presenting an idealized architecture, this session focuses on what changed in practice: what worked, what didn’t, and what we would do differently.
Speakers
avatar for Ian Choi

Ian Choi

Containers Specialist, AWS
Ian Choi is a Containers GTM Specialist at AWS focused on AWS container platforms and Kubernetes. He built LLMOps-based systems for real-world use cases during his Ph.D. and is interested in how AI-native and agentic approaches can reshape them into more flexible architectures. His... Read More →
avatar for Taeyoung Kim

Taeyoung Kim

CEO, AIFactory
Taeyoung Kim is CEO of AIFactory. He works on production AI systems, LLMOps, agent orchestration, and MCP-based tool architectures. His focus is on building reliable, observable, and maintainable LLM applications that can evolve from experimental workflows into real-world service... Read More →
Thursday August 13, 2026 13:50 - 14:15 KST
Orchid 1

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Share Modal

Share this link via

Or copy link