> Canonical URL: https://codingcat.dev/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-2-phonetics

# Lesson 2: Phonetic Code Identifier Pre-Processing for Technical Narration | Flagship 4: Local GPU Audio & Diffusion Pipelines with Chatterbox, faster-whisper & ComfyUI | CodingCat.dev Course

[🧶 Flagship 4: Local GPU Audio & Diffusion Pipelines with Chatterbox, faster-whisper & ComfyUI](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui)Section 1.2 · Lesson 2 of 5[![](/logos/tags/video-symbol-light.svg)![](/logos/tags/video-symbol-dark.svg)Video](/topic/video)[← Prev Lesson](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-1-chatterbox)[Next Lesson →](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-3-faster-whisper)

# Lesson 2: Phonetic Code Identifier Pre-Processing for Technical Narration

![Lesson 2: Phonetic Code Identifier Pre-Processing for Technical Narration Architecture Diagram](https://cdn.sanity.io/images/hfh83o0w/production/7a43567757f12f6fbe23f101ee5f4398ec9f640e-1376x768.png?w=1376&q=82&fit=max&auto=format)

## 1. The 15-Second Hook

Welcome to Lesson 2 of Flagship 4: Local GPU Audio & Diffusion Pipelines with Chatterbox, faster-whisper & ComfyUI on CodingCat.dev. Today we break down Phonetic Code Identifier Pre-Processing for Technical Narration and see how it powers our deterministic 3D AJ and code-rendered video pipeline.

## 2. Architecture Mental Model (Visual Diagram)

Look at the architecture diagram: on the left, vibe-prompted animations suffer from timer drift and unreviewed layout bugs. On the right, Phonetics and Code TTS enforce a deterministic frame contract.

## 3. Show Me the Code (tools/video-studio/align-audio-visemes.py)

Copied! 🐾📄 tools/video-studio/align-audio-visemes.pypython

```
from faster_whisper import WhisperModel

model = WhisperModel("large-v3", device="cuda", compute_type="float16")
segments, _ = model.transcribe("lesson-voiceover.wav", word_timestamps=True)
viseme_events = [
    {"word": w.word.strip(), "start": round(w.start, 3), "end": round(w.end, 3)}
    for seg in segments for w in (seg.words or [])
]
```

In tools/video-studio/align-audio-visemes.py, we wire up the production implementation so both our browser runtime and headless renderer stay 100 percent synchronized.

## 4. Production Trade-Off Matrix

DimensionDeterministic 2026 PatternLegacy Anti-PatternWhy It Matters in ProductionDeterminismPure function of time t via window.seek(t)Non-deterministic timers & Math.random()Any frame renders identically on demand.Visual PolishContact-sheet critique loop + W3C tokensFirst unreviewed render ships as finalEliminates overlapping text and dead beats.3D & Mascot RigUnified 57-path 2D SVG + Three.js 3D GLB AJStatic flat raster imagesInteractive orbital 3D + 120 BPM lip-sync.Production Cost$0 open-source local RTX 5090 pipeline$1,200+ agency fee or per-minute SaaS cliffScales across 95+ lessons with zero marginal cost.

When we compare this deterministic 2026 pattern against legacy workflows in our trade-off matrix, we get exact frame reproducibility, automated critique gates, and zero licensing cost.

## 5. Verdict & AJ Pro-Tip

> AJ Pro-Tip: Always verify frame 300 twice during your contact-sheet critique pass to confirm your Phonetics setup has zero non-deterministic state leaks.

Adopt Phonetics inside your studio folder today so every future launch film and 3D mascot animation builds on a reusable harness. Hit Subscribe and let's continue!

✏️ Visual Architecture Diagram

## how this course connects together.

Follow AJ from first principles to production-ready architecture.

Let’s build it!✏️ Visual Diagram: Flagship 4: Local GPU Audio & Diffusion Pipeline…✓ Good PatternVISUAL DIAGRAM[Diagram Walkthrough]Step-by-step diagram breakdown for Flagship 4: Local GPU Audio & Diffusion Pipelines with Chatterbox, faster-whisper & ComfyUI: Lesson 2: Phonetic Code Identifier Pre-Processing for Technical Narration: start with Core Architecture & Deterministic Implementation, implement Flagship 4: Local GPU Audio & Diffusion Pipelines with Chatterbox, faster-whisper & ComfyUI, and ship to production.AAA Contrast Verified

## related deep dives.

[View All→](/blog)[![Remotion Skills: Teaching AI Agents to Build Videos the Right Way](https://cdn.sanity.io/images/hfh83o0w/production/0980e327798a7bfa3580457d05953c763b3ce650-1376x768.png?w=1376&q=82&fit=max&auto=format)](/course/remotion-skills-ai-agents)November 4, 2026[![](/logos/tags/react-symbol-light.svg)![](/logos/tags/react-symbol-dark.svg)React](/topic/react)[![](/logos/tags/remotion-symbol-light.svg)![](/logos/tags/remotion-symbol-dark.svg)Remotion](/topic/remotion)

### [Remotion Skills: Teaching AI Agents to Build Videos the Right Way](/course/remotion-skills-ai-agents)

Install and customize remotion-dev/skills so Claude Code, Cursor, and Google Antigravity write deterministic, well-paced React video compositions on the first try.

[![Alex Patterson](https://cdn.sanity.io/media-libraries/mlttp0BZbCpV/images/a606dfaa381aab08ddbe16a33fe1d3e1fb37c927-400x400.jpg?w=96&h=96&q=82&fit=max&auto=format)Alex Patterson](/author/alex-patterson)[![Alex Patterson next to a dark-mode architecture diagram of 3D AJ and the 14 open-source video repositories](https://cdn.sanity.io/images/hfh83o0w/production/1a6c5bade322565ed55c3d0999dfe3c0332055c4-1376x768.png?w=1376&q=82&fit=max&auto=format)](/post/14-open-source-repos-code-driven-video-how-we-built-3d-aj)November 4, 2026[![](/logos/tags/ai-symbol-light.svg)![](/logos/tags/ai-symbol-dark.svg)AI & Agents](/topic/ai)[![](/logos/tags/video-symbol-light.svg)![](/logos/tags/video-symbol-dark.svg)Video](/topic/video)

### [The 14 Open-Source Repos Powering Code-Driven Video in 2026: How We Built 3D AJ the Cat](/post/14-open-source-repos-code-driven-video-how-we-built-3d-aj)

Why viral 'one-prompt' AI videos are actually 9,500-character production harnesses backed by deterministic frame functions, closed-form springs, and contact-sheet critique loops. Here is the full architectural breakdown of all 14 open-source repos and how we used them to build our interactive 3D AJ the Cat mascot and Course Factory.

[![Alex Patterson](https://cdn.sanity.io/media-libraries/mlttp0BZbCpV/images/a606dfaa381aab08ddbe16a33fe1d3e1fb37c927-400x400.jpg?w=96&h=96&q=82&fit=max&auto=format)Alex Patterson](/author/alex-patterson)[Course Outline](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui)

## Flagship 4: Local GPU Audio & Diffusion Pipelines with Chatterbox, faster-whisper & ComfyUI

2/51

### Core Architecture & Deterministic Implementation

- [1.1Lesson 1: Zero-Shot Local Voice Cloning & Emotion Control with Chatterbox](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-1-chatterbox)
- [1.2Lesson 2: Phonetic Code Identifier Pre-Processing for Technical Narration▶](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-2-phonetics)
- [1.3Lesson 3: Sub-20ms Word Timestamp Extraction with faster-whisper on CUDA](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-3-faster-whisper)
- [1.4Lesson 4: Driving 2D & 3D AJ Lip-Sync Visemes from Word & Beat Envelopes](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-4-aj-visemes)
- [1.5Lesson 5: ComfyUI API Graphs for Character Turnarounds & Generate-Then-Trace](/course/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui/lesson/local-gpu-audio-diffusion-chatterbox-faster-whisper-comfyui-lesson-5-comfyui-api)

@CodingCatDev on YouTube62.5K / 100K

Subscribe for new course lessons and architecture deep dives every week.

[Subscribe for New Lessons →](https://www.youtube.com/@codingcatdev?sub_confirmation=1)