Project Description

Case Studies / AI & ML

AI & ML

Robust Automatic Speech Recognition System for German Language Transcription

A prestigious law firm specializing in legal services in the German legal landscape.

Book a strategy call
Robust Automatic Speech Recognition System for German Language Transcription
3.2%word error rate (WER)
PracticeAI & ML

The Client

Client Overview

A prestigious law firm specializing in legal services in the German legal landscape. The client encountered challenges in transcription and documentation during legal proceedings. Clarity in legal discussions and accurate transcription was crucial. The objective was to implement German ASR to optimize audio quality, ensuring precise and efficient handling of legal documents and proceedings.

01

Challenges

The client needed full control over the ASR setup due to privacy and confidentiality concerns. This requirement ruled out the use of out-of-the-box APIs from AWS, GCP, and Azure services.

02

Approach

Technical implementation
  • Kaldi- an open-source Automatic Speech Recognition (ASR) toolkit is used, that contains various recipes for training customized acoustic models.
  • The Automatic Speech Recognition script is built using the Librispeech recipe from Kaldi, an acoustic model, and a language model.
  • Labeled Audio Data (recordings and spoken words) and Pronunciation Lexicon (words and corresponding sequences of phonemes) are collected from Tuda de and mozilla commonvoice datasets of German language audio files.
  • The acoustic model based on TDNN (Time Delay Neural Network) is trained using Labeled Audio Data on an NVIDIA A10 GPU.
  • The audio data is preprocessed to remove noise, enhance quality, and normalize volume.
  • MFCC (Mel-frequency Cepstral Coefficients), CMVN (Cepstral mean and variance normalization), and i-vectors audio features are extracted.
  • The language model refines word sequence predictions, while the decoding graph inspects potential word sequences, generating accurate transcription, evaluated against Word Error Rate (WER).
Download LabeledTraining Data Data Preparationand LexiconCreation Extract MFCC, CMVNand i-vectorFeatures Acoustic ModelTraining Evaluate the ModelUsing WER Need MoreData? Fine TuningRequired? Fine Tune ModelParameters Add More Data andRe-train the Model Publish the Model NOYES YESNO Training flowRetraining loop
Figure 1 — Model training on an NVIDIA A10 GPU.
Download LabeledTraining Data Data Preparationand LexiconCreation Extract MFCC, CMVNand i-vectorFeatures Acoustic ModelTraining Evaluate the ModelUsing WER Need MoreData? Fine TuningRequired? Fine Tune ModelParameters Add More Data andRe-train the Model Publish the Model NOYES YESNO Training flowRetraining loop ×
END-TO-END ASR Audio InputFrom User Data Preparation Extract MFCC, CMVN,I-vector Features Decoding RetrieveTranscriptionfrom Lattice Display Output
Figure 2 — End-to-end ASR script running on a Linux EC2 instance.
END-TO-END ASR Audio InputFrom User Data Preparation Extract MFCC, CMVN,I-vector Features Decoding RetrieveTranscriptionfrom Lattice Display Output ×

03

Impact

3.2%

Achieved a Word Error Rate of an impressive 3.2%, signifying high accuracy of transcription.

5.2%

Maintained a low WER of 5.2% for audios with background noises and disturbances.

70%

70% reduction in cost for manual transcription tasks, while significantly improving manpower morale.

100%

Maintained 100% compliance with the client's stringent data protection and privacy regulations.

  • Achieved high precision in the legal context by training the model on legal terminology and jargon.
  • Ensured consistent transcription quality over varying accents, pitch, or speaking styles.

Want results like these from your own data?

Talk to a specialist

See how you could get similar results

Rudder Analytics builds data and AI systems that ship — and stay tied to accuracy, cost, and customer experience.