Online Rank
Multilingual Medical Instructional Video Question Answering Challenge

Multilingual Temporal Answer Grounding in Singe Video Track
Rank Date Team ID Organization System Name R@1,IoU=0.3 R@1,IoU=0.5 R@1,IoU=0.7 mIoU(R@1)
1 2024/6/20 Ouc_AI The Open University of China - 0.5088 0.3542 0.2054 0.3637
2 2024/6/20 SETAG Fudan University - 0.4775 0.3209 0.1898 0.3389
3 2024/6/20 BIGG YNU - 0.4099 0.2863 0.1544 0.2977
4 2024/6/20 PIPINSTALL SEU - 0.4055 0.2911 0.1454 0.2898
5 2024/5/10 - - Random Pick Method 0.0571 0.0465 0.0358 0.0397

Multilingual Video Corpus Retrieval Track
Rank Date Team ID Organization System Name R@1 R@10 R@50 MRR Overall
1 2024/6/20 sun CETC - 0.3121 0.4078 0.4966 0.3245 1.5410
2 2024/6/20 GEN - - 0.1311 0.1074 0.0978 0.1142 0.4505
2 2024/5/10 - - Random Pick Method 0.0343 0.0366 0.0523 0.0442 0.1674

Multilingual Temporal Answer Grounding in Video Corpus Track
Rank Date Team ID Organization System Name R@1|mIoU R@10|mIoU R@50|mIoU Average
1 2024/6/20 IIEleven University of Chinese Academy of Sciences - 0.1141 0.2343 0.3098 0.2200
2 2024/5/10 - - Random Pick Method 0.0247 0.0397 0.0509 0.0384
Important Dates
Important Dates and Details of the Multilingual Medical Instructional Video Question Answering Challenge

Signup to receive updates: using this form

The submission deadline is at 11:59 p.m. of the stated deadline date (UTC/GMT+08:00).

Announcement of shared tasks and Registration open for participation March 25, 2024
Release of detailed task guidelines & training data April 15, 2024
Release of test data June 11, 2024
Test submission deadline June 20, 2024
Registration deadline (Same as the Test submission deadline) June 20, 2024
Evaluation results release and call for system reports and conference paper June 30, 2024
Questions?
Some contacts for your quick start with this challenge

Feel free to contact the organizers at libincn@hnu.edu.cn.