Skip to content

feat(lk): --caller-model picks the model that plays the simulated caller - #1119

Open
u9g wants to merge 1 commit into
mainfrom
jasonlernerman/sim-caller-model
Open

u9g wants to merge 1 commit into
mainfrom
jasonlernerman/sim-caller-model

Conversation

@u9g

@u9g u9g commented Nov 11, 2026

Copy link
Copy Markdown
Contributor

lk agent simulate --caller-model usim-v1 runs every job with LiveKit's caller model, fine-tuned on real calls (usim), instead of the default caller. The flag applies to text and audio.

  • It sets SimulationRun.Create.Request.caller_model (agent_simulation: choose the simulated caller's model per run (default or usim v1) protocol#1968). The default value is default; anything other than default or usim-v1 is rejected before the run is created.
  • usim-v1 is English only: agent-service (livekit/agents-private#873) has the default caller play any scenario in another language.
  • Bumps livekit/protocol to the commit with caller_model. Merge after #1968, with the bump moved to its release.

Testing

  • go build ./..., go vet ./cmd/lk and go test ./cmd/lk all pass.
  • New TestCallerModelsCoverTheProtocol fails if the protocol gains a caller model without a --caller-model name.
  • Not run against a server: the agent-service side (simulate: strip ANSI escapes from the agent log file #873) isn't deployed yet, and a server without it ignores the field and uses the default caller.

`lk agent simulate --caller-model usim-v1` runs every job with LiveKit's
caller model fine-tuned on real calls (usim) instead of the default caller.
It sets SimulationRun.Create.Request.caller_model (livekit/protocol#1968) and
applies to text and audio. usim-v1 is English only: agent-service has the
default caller play scenarios in other languages.

Bumps livekit/protocol to the commit with caller_model.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@u9g

u9g commented Nov 11, 2026

Copy link
Copy Markdown
Contributor Author

lk agent simulate --help shows the new --caller-model flag (default or usim-v1), and an unknown value is rejected before any run is created.

caller-model.mp4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant