add console, simulate, and agent dev commands + vendor webrtc & portaudio (#810) (#809)

* add vendored WebRTC APM and PortAudio native sources

* add console, simulate, and agent dev commands (#810)

* add console, simulate, agent dev commands with TUI and protobuf IPC

* improve agent detection error messages and consistency

- Add friendly error when no agent project is detected (start/dev/console)
- Print detected language and directory to stderr for start/dev/console
- Deduplicate console detection logic to use shared detectProject()
- Add nil guard in BytesToSamples for empty data

* improve error messages, entrypoint detection, and IPC safety

- Detect project root from entrypoint directory when --entrypoint is set
- Better entrypoint-not-found error showing checked paths
- Print detected language and directory to stderr for start/dev/console
- Render CLI errors in red at the call site
- Add maxMessageSize check to IPC WriteProto

* add console build docs and PortAudio submodule check

* add blank line after user/agent messages in console TUI

* remove duplicate -lc++ linker flags, cgo handles C++ linking automatically

* fix console TUI rendering, add startup spinner and handoff support

* remove local replace directives, use published server-sdk-go

Switch to the server-sdk-go branch that exports CreateSourceTarball,
MultipartUpload, and AgentSimulationClient. Fix spinnerFrames reference
across build tags.

* update server-sdk-go to include complete AgentSimulationClient

* update server-sdk-go to merged main with SimulationAdmin grant

* Fix agent watcher exitCh race on restart

* Remove default num-simulations, let server decide

* Show 'Generating scenarios' without count when num-simulations not specified

* Improve agent simulate TUI setup and log display

* Read NumSimulations from server response

* Use larger circle icon (⏺) in TUI

* Integrate save scenario overlay, show labels in job list, fix selected row highlight

* Softer yellow, use ⏺ for pending icons

* Pad selected row to max label width for consistent highlight

* Remove q to quit, only ctrl+c exits

* CI mode, TUI improvements, log filtering, and entrypoint fix

CLI architecture:
- Non-interactive CI mode auto-detected (no TTY or CI env var)
- Shared lifecycle functions in simulate.go (no bubbletea dependency)
- simulate_ci.go: sequential runner with ::group:: output for GHA

TUI improvements:
- Detail view: unified scrollable content (instructions, transcript, logs)
- Log filtering by room name prefix (latest retry only)
- Compact chat transcript rendering
- Removed filter tabs, simplified matrix rain
- Mouse capture removed (text selection works)
- Summary unavailable message, summarizing spinner

Agent subprocess:
- Debug logging enabled, room-indexed log storage
- Per-room log filtering by prefix with latest-room tracking

Bug fix:
- Send CodeEntrypoint in ConfirmSourceUpload so the generator
  analyzes the correct file instead of the entire workspace

* Use positional arg for entrypoint instead of --entrypoint flag

* Address PR review: remove redundant flags, fix console text mode

- Remove --url, --api-key, --api-secret flags from agent run commands
  (already available as global flags)
- Fix console text mode: suppress UserInputTranscribed events in text
  mode to prevent duplicate/out-of-order user messages
- Clear partial transcript when switching to text mode mid-call

* Put start/dev/console/simulate behind console build tag, revert CI changes

- All agent subprocess commands (start, dev, console, simulate) require
  -tags console to build. Without the tag, they don't appear in lk agent.
- Revert .github/workflows/release.yaml and banner to main
- Remove .goreleaser.yaml (not on main)
- Move noAgentError to agent.go (non-tagged)
- Add init() registration for simulate command

* Add CI job for no-console, no-CGO build verification

* Remove build-binaries.yaml workflow

* Remove Homebrew formula

* Restore .goreleaser.yml

* Rename .goreleaser.yml to .goreleaser.yaml

* Remove console build section from README

* Add CI job for no-console, no-CGO build verification

* Read Go version from go.mod instead of hardcoding in CI

* Remove windows_arm from build matrix (no CGO, redundant with no-console job)

* Fix staticcheck: tag agent_reload, move console-only vars to agent_run

* Fix Windows build: extract platform-specific process management

* Clean up unused RoomLogCount and stale entrypoint error message

* Pin GitHub Actions to SHA references in build.yaml

Author: theomonnom

.gitattributes

@@ -1,3 +1,11 @@
 pkg/provider/resources/*.h264 filter=lfs diff=lfs merge=lfs -text
 pkg/provider/resources/*.ivf filter=lfs diff=lfs merge=lfs -text
 pkg/provider/resources/*.ogg filter=lfs diff=lfs merge=lfs -text
+
+# Vendored C/C++ source (WebRTC APM, PortAudio, abseil, pffft, rnnoise)
+pkg/apm/webrtc/**/*.cc linguist-vendored
+pkg/apm/webrtc/**/*.c linguist-vendored
+pkg/apm/webrtc/**/*.h linguist-vendored
+pkg/apm/webrtc/**/*.m linguist-vendored
+pkg/apm/webrtc/**/*.inc linguist-vendored
+pkg/portaudio/pa_src/** linguist-vendored

.github/banner_dark.png

@@ -20,31 +20,163 @@ on:
   pull_request:
     branches: [ main ]
 
+permissions:
+  contents: read
+
 jobs:
-  build:
+  build-no-console:
+    name: Build (no console, no CGO)
     runs-on: ubuntu-latest
     steps:
       - uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6
-      - uses: actions/cache@668228422ae6a00e4ad889ee87cd7109ec5666a7 # v5
-        with:
-          path: |
-            ~/go/pkg/mod
-            ~/go/bin
-            ~/.cache
-          key: livekit-cli
 
       - name: Set up Go
         uses: actions/setup-go@4a3601121dd01d1626a1e23e37211e3254c1c06c # v6
         with:
-          go-version: "1.25"
+          go-version-file: go.mod
+
+      - name: Build without console tag
+        env:
+          CGO_ENABLED: "0"
+        run: go build -o bin/lk ./cmd/lk
+
+      - name: Verify binary
+        run: bin/lk --help > /dev/null
+
+  lint-and-test:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6
+        with:
+          submodules: true
 
-      - name: Download Go modules
-        run: go mod download
+      - name: Set up Go
+        uses: actions/setup-go@4a3601121dd01d1626a1e23e37211e3254c1c06c # v6
+        with:
+          go-version-file: go.mod
 
-      - name: Lint
-        uses: golangci/golangci-lint-action@1e7e51e771db61008b38414a730f564565cf7c20 # v9
+      - name: Static Check
+        uses: dominikh/staticcheck-action@288b4e28bae83c59f35f73651aeb5cab746a06fc # v1.4.0
         with:
-          version: v2.11.4
+          version: "latest"
+          install-go: false
 
-      - name: Run Go tests
+      - name: Test
         run: go test -v ./...
+
+  build:
+    strategy:
+      fail-fast: false
+      matrix:
+        include:
+          - os: macos-latest
+            suffix: darwin_arm64
+          - os: ubuntu-latest
+            suffix: linux_amd64
+            zig_target: x86_64-linux-gnu.2.28
+            alsa_arch: amd64
+            alsa_triple: x86_64-linux-gnu
+          - os: ubuntu-latest
+            suffix: linux_arm64
+            zig_target: aarch64-linux-gnu.2.28
+            alsa_arch: arm64
+            alsa_triple: aarch64-linux-gnu
+            goarch: arm64
+          - os: ubuntu-latest
+            suffix: linux_arm
+            zig_target: arm-linux-gnueabihf.2.28
+            alsa_arch: armhf
+            alsa_triple: arm-linux-gnueabihf
+            goarch: arm
+            goarm: "7"
+          - os: ubuntu-latest
+            suffix: windows_amd64
+            zig_target: x86_64-windows-gnu
+            goos: windows
+            goarch: amd64
+          - os: ubuntu-latest
+            suffix: windows_arm64
+            zig_target: aarch64-windows-gnu
+            goos: windows
+            goarch: arm64
+    runs-on: ${{ matrix.os }}
+    steps:
+      - uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6
+        with:
+          submodules: true
+
+      - name: Set up Go
+        uses: actions/setup-go@4a3601121dd01d1626a1e23e37211e3254c1c06c # v6
+        with:
+          go-version-file: go.mod
+
+      - name: Install Zig
+        if: matrix.zig_target
+        uses: mlugg/setup-zig@d1434d08867e3ee9daa34448df10607b98908d29 # v2
+        with:
+          version: 0.14.1
+
+      - name: Install ALSA headers
+        if: matrix.alsa_arch
+        run: |
+          sudo dpkg --add-architecture ${{ matrix.alsa_arch }}
+          if [ "${{ matrix.alsa_arch }}" != "amd64" ]; then
+            CODENAME=$(lsb_release -cs)
+            # Restrict existing sources to amd64 to avoid 404s for foreign arch
+            for f in /etc/apt/sources.list.d/*.sources; do
+              grep -q '^Architectures:' "$f" || sudo sed -i '/^Types:/a Architectures: amd64 i386' "$f"
+            done
+            # Add ports.ubuntu.com for the foreign architecture
+            printf 'Types: deb\nURIs: http://ports.ubuntu.com/ubuntu-ports\nSuites: %s %s-updates\nComponents: main universe\nArchitectures: %s\nSigned-By: /usr/share/keyrings/ubuntu-archive-keyring.gpg\n' \
+              "$CODENAME" "$CODENAME" "${{ matrix.alsa_arch }}" | sudo tee /etc/apt/sources.list.d/ports.sources
+          fi
+          sudo apt-get update
+          sudo apt-get install -y libasound2-dev:${{ matrix.alsa_arch }}
+
+      - name: Generate Windows import libraries
+        if: matrix.goos == 'windows' && matrix.zig_target
+        run: |
+          ZIG_LIB=$(zig env | jq -r '.lib_dir')
+          echo "ZIG_LIB=${ZIG_LIB}" >> "$GITHUB_ENV"
+          LIB_DIR="${ZIG_LIB}/libc/mingw/lib-common"
+          # Zig bundles MinGW .def files but lld needs .a import libraries.
+          # Go's compiled objects embed COFF /DEFAULTLIB directives (e.g. dbghelp,
+          # bcrypt) that lld resolves directly, bypassing Zig's lazy .def→.a
+          # generation. Pre-generate all import libraries so lld can find them.
+          MACHINE=${{ matrix.goarch == 'amd64' && 'i386:x86-64' || 'arm64' }}
+          for def in "${LIB_DIR}"/*.def; do
+            lib=$(basename "$def" .def)
+            [ -f "${LIB_DIR}/lib${lib}.a" ] && continue
+            zig dlltool -d "$def" -l "${LIB_DIR}/lib${lib}.a" -m "$MACHINE" 2>/dev/null || true
+          done
+
+      - name: Build
+        env:
+          CGO_ENABLED: ${{ (matrix.goos && !matrix.zig_target) && '0' || '1' }}
+          CC: ${{ matrix.zig_target && format('zig cc -target {0}', matrix.zig_target) || '' }}
+          CXX: ${{ matrix.zig_target && format('zig c++ -target {0}', matrix.zig_target) || '' }}
+          # Zig uses its own sysroot; point it at the system ALSA headers and libraries
+          CGO_CFLAGS: ${{ matrix.alsa_triple && format('-isystem /usr/include -isystem /usr/include/{0}', matrix.alsa_triple) || '' }}
+          CGO_LDFLAGS: ${{ matrix.alsa_triple && format('-L/usr/lib/{0}', matrix.alsa_triple) || '' }}
+          # -fms-extensions: enable __try/__except (SEH) used by WebRTC
+          # -DNTDDI_VERSION: target Windows 10 base to skip WinRT includes absent from MinGW
+          CGO_CXXFLAGS: ${{ matrix.goos == 'windows' && '-fms-extensions -DNTDDI_VERSION=0x0A000000' || '' }}
+          GOOS: ${{ matrix.goos || '' }}
+          GOARCH: ${{ matrix.goarch || '' }}
+          GOARM: ${{ matrix.goarm || '' }}
+        shell: bash
+        run: |
+          EXT=""; if [ "${GOOS:-}" = "windows" ]; then EXT=".exe"; fi
+          TAGS=""
+          if [ "$CGO_ENABLED" = "1" ]; then TAGS="-tags console"; fi
+          # Force external linking for Windows so Go uses zig cc (CC) as the linker,
+          # and add Zig's MinGW lib path so lld can find the generated import libraries.
+          EXTLD=""
+          if [ "${GOOS:-}" = "windows" ] && [ "$CGO_ENABLED" = "1" ]; then
+            EXTLD="-linkmode=external -extldflags '-L${ZIG_LIB}/libc/mingw/lib-common'"
+          fi
+          go build $TAGS -ldflags "-w -s $EXTLD" -o "bin/lk${EXT}" ./cmd/lk
+
+      - name: Verify binary
+        if: "!matrix.goos && !matrix.goarch"
+        run: bin/lk --help > /dev/null

.github/workflows/build.yaml

@@ -81,7 +81,7 @@ jobs:
       - name: Set up Go
         uses: actions/setup-go@4a3601121dd01d1626a1e23e37211e3254c1c06c # v6
         with:
-          go-version: "1.25"
+          go-version-file: go.mod
 
       - name: Run GoReleaser
         uses: goreleaser/goreleaser-action@ec59f474b9834571250b370d4735c50f8e2d1e29 # v7

.github/workflows/release.yaml

@@ -24,7 +24,7 @@ jobs:
       - name: Set up Go
         uses: actions/setup-go@4a3601121dd01d1626a1e23e37211e3254c1c06c # v6
         with:
-          go-version: "1.25"
+          go-version-file: go.mod
           cache: true
 
       - name: Download Go modules

.github/workflows/test.yaml

@@ -21,3 +21,4 @@ dist/
 .task/
 
 .DS_Store
+lk

.gitignore

@@ -0,0 +1,3 @@
+[submodule "pkg/portaudio/pa_src"]
+	path = pkg/portaudio/pa_src
+	url = https://github.com/PortAudio/portaudio.git

.gitmodules

@@ -16,6 +16,9 @@ cli: check_lfs
 	GOOS=windows GOARCH=amd64 go build -ldflags "-w -s" -o bin/lk.exe ./cmd/lk
 
 
+console:
+	CGO_ENABLED=1 go build -tags console -ldflags "-w -s" -o bin/lk ./cmd/lk
+
 install: cli
 ifeq ($(DETECTED_OS),Windows)
 	cp bin/lk.exe $(GOBIN)/lk.exe

Makefile

@@ -54,6 +54,7 @@ git clone https://github.com/livekit/livekit-cli && cd livekit-cli
 make install
 ```
 
+
 # Usage
 
 See `lk --help` for a complete list of subcommands. The `--help` flag can also be used on any subcommand for more information.

README.md

@@ -379,6 +379,13 @@ var (
 	}
 )
 
+func noAgentError() error {
+	return fmt.Errorf("no agent project detected in the current directory\n\n" +
+		"Make sure you are running this command from an agent project directory\n" +
+		"containing one of: pyproject.toml, requirements.txt, uv.lock, package.json, or lock files.\n\n" +
+		"To get started, see: https://docs.livekit.io/agents/quickstart")
+}
+
 func createAgentClient(ctx context.Context, cmd *cli.Command) (context.Context, error) {
 	return createAgentClientWithOpts(ctx, cmd)
 }
@@ -605,7 +612,7 @@ func createAgent(ctx context.Context, cmd *cli.Command) error {
 
 	projectType, err := agentfs.DetectProjectType(os.DirFS(workingDir))
 	if err != nil {
-		return fmt.Errorf("unable to determine agent language: %w, please navigate to a directory containing an agent written in a supported language", err)
+		return noAgentError()
 	}
 	fmt.Printf("Detected agent language [%s]\n", util.Accented(string(projectType)))
 
@@ -773,7 +780,7 @@ func deployAgent(ctx context.Context, cmd *cli.Command) error {
 
 	projectType, err := agentfs.DetectProjectType(os.DirFS(workingDir))
 	if err != nil {
-		return fmt.Errorf("unable to determine agent language: %w, please make sure you are inside a directory containing an agent written in a supported language", err)
+		return noAgentError()
 	}
 	fmt.Printf("Detected agent language [%s]\n", util.Accented(string(projectType)))
 
@@ -1611,7 +1618,7 @@ func generateAgentDockerfile(ctx context.Context, cmd *cli.Command) error {
 
 	projectType, err := agentfs.DetectProjectType(os.DirFS(workingDir))
 	if err != nil {
-		return fmt.Errorf("unable to determine agent language: %w, please make sure you are inside a directory containing an agent written in a supported language", err)
+		return noAgentError()
 	}
 	fmt.Printf("Detected agent language [%s]\n", util.Accented(string(projectType)))