Metrics

Only objective evaluation will be performed. Three complementary metrics will be used:

  • Privacy:
    • equal error rate (EER) for automatic speaker verification (ASV)
  • Utility:
    • word error rate (WER) for automatic speech recognition (ASR)
    • unweighted average recall (UAR) for speech emotion recognition (SER)