Jerome Chua

AI Orchestration

AI Orchestration…

Current Leading Frameworks

Semantic Kernel

Semantic Kernel is a model-agnostic SDK to build, orchestrate & deploy AI agents and multi-agent systems

# Single Agent

LangChain

most basic code example for Single Agent

LlamaIndex

most basic code example for Single Agent

Underlying Concepts from Key Papers

Tool Calling

Read more: Evaluation Driven Development


Evals

  • LLM-as-a-Judge
  • Code-based
  • Human Label

What to look at

  • Trajectory
  • Convergence Score

Tools

Arize AI (Phoenix UI)

Running Experiments