LearnAI
Module 14 · Voice and Multimodal Applications (Pro) · Lesson 1/5
← Back to catalog
Task

Speech to Text (STT)

How to embed speech recognition? Return JSON {"steps": [list of 2+ steps], "why": "short"}.

Unlock access to submit solutions for instant AI review.Start for free
Voice input in the product
💡 A bit of theory

Speech to text (STT, speech-to-text) turns audio into text, which is further processed by the model. How to embed: select a mode - streaming (transcription as speech occurs, for live dialogue) or batch (uploaded a file - received text, for recordings); take into account accuracy factors - noise, accent, terms, language (often the language must be specified explicitly); handle recognition errors (STT makes mistakes, especially on names and numbers - let the user check and correct); pass the text on to LLM for meaning. STT is the input, not the end: the raw transcript almost always needs to be cleaned up or made sense of. Rule: STT gives the text, but not the understanding - the model follows the meaning, and monitor the quality by noise, language and error checking.

How it's graded · passing score 70

  • 1Valid JSON without text around it30%
  • 2There is an array steps and why35%
  • 32+ steps: stream/batch mode, accuracy factors, error handling, pass to LLM35%
Your promptClaude ⌄