Odyssey Challenge - MSP-Podcast

Submission Instructions

Before submission, please read and follow the instructions carefully.
Only registered team submissions will be accepts. To register please visit this website.
For information about baselines visit this link.
Each registered email is permitted a maximum of three submissions per task. For the first submission, participants may choose any preferred team name. However, it is important to use the same team name for subsequent submissions, as any different name will result in rejection.

Task 1: Categorical

  • The categorical letters must be {A, C, D, F, H, N, S, U}, Any other letter will not be accepted
  • A=Anger, C= Contempt, D= Disgust, F= Fear, H= Happiness, N= Neutral, S= Sadness, U= Surprise
  • Metric: Macro-F1 score
  • Example submission file:
  • FileName, EmoClass
    MSP-PODCAST_test3_0001.wav, S
    MSP-PODCAST_test3_0002.wav, D
    MSP-PODCAST_test3_0003.wav, A
    MSP-PODCAST_test3_0004.wav, U
    ...
  • Sample file

Task 2: Attributes

  • The values are from 1 to 7:
    • Arousal (1 calm, 7 active)
    • Valence (1 negative, 7 positive)
    • Dominance (1 weak, 7 strong)
  • Values outside this range will create an error
  • Metric: average of Concordance Correlation Coefficient (CCC)
  • Example submission file:
  • FileName, EmoAct, EmoVal, EmoDom
    MSP-PODCAST_test3_0001.wav, 5.962445394, 1.645595285, 3.277091995
    MSP-PODCAST_test3_0002.wav, 5.925202743, 3.510046627, 4.902689017
    MSP-PODCAST_test3_0003.wav, 5.133939009, 2.012986747, 5.79230556
    MSP-PODCAST_test3_0004.wav, 2.727285967, 4.033873751, 1.566529833
    ...
  • Sample file
Emotion Recognition Challenge

Emotion Recognition Challenge

Congratulations to all teams in the Odyssey Emotional Recognition Challenge! We're thrilled to announce that the submission portal is now closed. Thank you for your valuable contributions, and best of luck as we move to the next phase of evaluation.
Team NameF1 MacroF1 MicroAccuracySubmissionCompetitionDate
Sheffield-MINI0.35690.37320.37323Odyssey2024-03-01 18:57:32
TalTech0.35430.37030.37032Odyssey2024-03-01 11:01:33
TalTech0.35410.36860.36863Odyssey2024-03-02 03:03:08
TalTech0.34950.36340.36341Odyssey2024-03-01 08:10:25
UPC-BSC0.34410.35620.35622Odyssey2024-02-28 18:22:59
Sheffield-MINI0.34290.35320.35322Odyssey2024-02-28 16:29:56
THAU0.34260.35280.35283Odyssey2024-03-02 05:16:58
IRIT/MFU0.33670.35150.35153Odyssey2024-03-02 08:27:20
CONILIUM0.3350.34730.34733Odyssey2024-03-01 13:09:53
VK Lab0.3340.35020.35023Odyssey2024-03-01 05:58:39
IRIT/MFU0.33350.35110.35111Odyssey2024-02-22 17:42:41
UPC-BSC0.33330.35490.35493Odyssey2024-02-29 20:21:43
L'antenne du Ventoux0.33180.34730.34731Odyssey2024-02-11 16:36:14
thuhcsi0.33030.34090.34093Odyssey2024-02-29 10:57:10
Sheffield-MINI0.32760.33530.33531Odyssey2024-02-26 08:29:56
SUST-AI4AC-TEAM0.32670.3430.3432Odyssey2024-02-26 06:22:39
NU0.32560.34430.34432Odyssey2024-03-01 06:59:58
L'antenne du Ventoux0.32460.34980.34982Odyssey2024-02-27 14:51:15
thuhcsi0.32090.33320.33322Odyssey2024-02-28 11:30:39
SUST-AI4AC-TEAM0.32010.34090.34093Odyssey2024-03-01 01:32:26
CONILIUM0.31960.33750.33752Odyssey2024-03-01 08:35:32
thuhcsi0.31870.33110.33111Odyssey2024-02-28 02:31:51
THAU0.31470.33190.33192Odyssey2024-03-01 17:30:47
BIIC LAB0.31420.32510.32513Odyssey2024-03-01 05:12:59
BIIC LAB0.31140.32720.32722Odyssey2024-03-01 05:02:28
Baseline0.31130.32720.32721Odyssey2024-02-02 14:45:58
Team AGH0.30930.32470.32472Odyssey2024-02-29 11:11:15
UPC-BSC0.30910.320.321Odyssey2024-02-21 05:01:41
Team AGH0.30670.32680.32681Odyssey2024-02-27 12:41:25
NU0.30610.31570.31571Odyssey2024-02-29 00:06:03
VK Lab0.30480.34210.34212Odyssey2024-02-28 16:28:34
AstroSpeech0.29840.31320.31321Odyssey2024-03-01 16:04:29
NU0.29760.33060.33063Odyssey2024-03-02 03:19:07
vivolab0.29420.30760.30763Odyssey2024-03-01 08:01:57
VicomSpeech0.29380.32470.32471Odyssey2024-02-23 07:31:45
Salam0.28680.32720.32722Odyssey2024-03-01 05:50:45
dj-ulm0.28570.29360.29361Odyssey2024-03-01 05:31:09
AIST-BahasaKita0.27680.30810.30811Odyssey2024-02-26 18:50:49
dj-ulm0.27380.28970.28972Odyssey2024-03-01 05:32:32
BIIC LAB0.27360.32380.32381Odyssey2024-02-28 11:44:02
CONILIUM0.2720.31570.31571Odyssey2024-02-29 01:56:36
sensein group0.26850.3110.3113Odyssey2024-03-02 08:26:11
RTES LAB IIT KGP0.26740.29230.29231Odyssey2024-02-22 14:12:24
TJU_SER0.26330.30080.30081Odyssey2024-02-29 06:37:09
RTES LAB IIT KGP0.25690.29230.29232Odyssey2024-03-02 04:51:47
SUST-AI4AC-TEAM0.25510.2970.2971Odyssey2024-02-22 07:10:31
RTES LAB IIT KGP0.24750.28290.28293Odyssey2024-03-02 05:44:30
Salam0.23990.27870.27871Odyssey2024-03-01 04:37:30
vivolab0.23870.25480.25482Odyssey2024-02-14 05:23:03
Team-SIPLAB0.2350.26370.26371Odyssey2024-03-01 08:02:14
Team-SIPLAB0.22510.2450.2452Odyssey2024-03-02 00:58:12
CASIA-MAIS0.20930.25990.25992Odyssey2024-03-02 05:47:45
sensein group0.20330.2850.2851Odyssey2024-03-01 21:52:38
sensein group0.19590.24240.24242Odyssey2024-03-01 21:56:26
CASIA-MAIS0.19290.25860.25861Odyssey2024-03-02 05:10:25
IRIT/MFU0.18180.23730.23732Odyssey2024-03-01 10:42:03
vivolab0.17860.23090.23091Odyssey2024-02-12 06:31:41
simba90.16370.24160.24161Odyssey2024-02-29 22:21:36
CMU0.12420.2190.2191Odyssey2024-02-28 10:54:41
intema.ai0.12280.19730.19731Odyssey2024-02-21 22:37:33
VK Lab0.12160.13170.13171Odyssey2024-02-17 13:00:24
EMO-GSD0.10440.18960.18963Odyssey2024-03-01 06:00:34
EMO-GSD0.1040.18750.18752Odyssey2024-02-29 20:20:21
THAU0.10230.10310.10311Odyssey2024-03-01 16:49:27
EMO-GSD0.09420.1790.1791Odyssey2024-02-29 19:32:30
UVigo_Lab0.07180.10910.10912Odyssey2024-03-01 05:24:04
DA-IICT_Speech_Research_Lab0.06680.13120.13121Odyssey2024-02-23 05:16:15
mosaic0.06360.15810.15811Odyssey2024-03-01 22:53:05
UVigo_Lab0.05980.11290.11291Odyssey2024-02-26 05:42:01
team_namef1_macrof1_microaccuracysubmissionNumcompetitiondate
Team NameValenceArousalDominanceAverageSubmissionCompetitionDate
Baseline0.60690.56670.42440.53271Odyssey2024-02-02 14:46:34
AIST-BahasaKita0.60250.58210.40460.52972Odyssey2024-03-01 01:25:22
intema.ai0.5830.58460.41940.5292Odyssey2024-02-28 14:04:16
AIST-BahasaKita0.58640.5810.41460.52731Odyssey2024-02-29 03:26:10
TJU_SER0.57680.58230.41520.52481Odyssey2024-02-29 06:40:26
NU0.60140.56080.40280.52162Odyssey2024-03-01 23:25:03
NU0.59360.56970.40030.52123Odyssey2024-03-02 04:29:48
TalTech0.63620.54170.36550.51443Odyssey2024-03-02 02:29:35
SMILE0.61970.5540.34360.50581Odyssey2024-03-01 12:11:00
NU0.57430.54370.37340.49721Odyssey2024-02-27 07:40:45
intema.ai0.55810.54510.37370.49233Odyssey2024-02-29 13:57:47
sensein group0.53320.54550.37060.48311Odyssey2024-03-02 09:03:20
TalTech0.55990.51640.34210.47282Odyssey2024-03-01 04:02:18
thuhcsi0.59840.50570.31150.47192Odyssey2024-03-01 00:08:14
mosaic0.59660.50750.30320.46912Odyssey2024-03-01 10:53:00
CASIA-MAIS0.55070.4950.27640.44071Odyssey2024-03-02 04:42:03
mosaic0.55350.48720.27950.44013Odyssey2024-03-01 13:45:46
thuhcsi0.56130.48410.26320.43621Odyssey2024-02-28 00:26:21
CASIA-MAIS0.53090.44450.28210.41922Odyssey2024-03-02 05:11:33
dj-ulm0.4550.49460.29090.41351Odyssey2024-02-23 08:34:28
dj-ulm0.47060.47070.27760.40632Odyssey2024-03-01 05:32:52
dj-ulm0.46830.47050.2770.40533Odyssey2024-03-01 05:33:11
mosaic0.41420.50080.29060.40191Odyssey2024-02-29 14:09:59
AstroSpeech0.33270.43060.22630.32991Odyssey2024-03-01 16:53:50
AstroSpeech0.33270.43060.22630.32992Odyssey2024-03-01 17:03:07
CASIA-MAIS0.27390.47490.09650.28183Odyssey2024-03-02 05:54:30
intema.ai0.16260.45330.22630.28071Odyssey2024-02-21 22:38:23
TalTech-0.0090.51640.05350.1871Odyssey2024-03-01 03:27:27
CMU-0.00670.0250.31580.11131Odyssey2024-02-29 13:05:38
team_nameValenceArousalDominanceAveragesubmissionNumcompetitiondate
Sponsor 1
Sponsor 2
Sponsor 3
Sponsor 4
Sponsor 5