Metrics

While the metrics for VoicePrivacy 2022 remain similar to those used for the inaugural 2020 challenge edition, updated software packages will be provided and we will be defining a small number of different evaluation conditions. These stimpulate minimum targets for anonymisation performance expressed in terms of the equal error rate (EER) for a provided automatic speaker verification system. For each evaluation condition, submissions will then be ranked in terms of the lowest resulting word error rate (WER) for a provided automatic speech recognition system. As for VoicePrivacy 2020, the challenge is hence to meet or exceed the specified EER while minimising the WER.