Online Rank
Multilingual Medical Instructional Video Question Answering Challenge

M4 Temporal Answer Grounding in Singe Video Track
Rank Date Team ID Organization System Name R@1,IoU=0.3 R@1,IoU=0.5 R@1,IoU=0.7 mIoU(R@1)
1 2025/4/30 Baichuan Sichuan University - 0.5133 0.3612 0.2103 0.3717
2 2024/6/20 Ouc_AI The Open University of China - 0.5088 0.3542 0.2054 0.3637
3 2024/6/20 SETAG Fudan University - 0.4775 0.3209 0.1898 0.3389
4 2025/4/30 SEU Southeast University - 0.4719 0.3314 0.1973 0.3411
5 2024/6/20 BIGG YNU - 0.4099 0.2863 0.1544 0.2977
6 2024/6/20 PIPINSTALL SEU - 0.4055 0.2911 0.1454 0.2898
7 2024/5/10 - - Random Pick Method 0.0571 0.0465 0.0358 0.0397

M4 Video Corpus Retrieval Track
Rank Date Team ID Organization System Name R@1 R@10 R@50 MRR Overall
1 2025/4/30 DIMA University of Pittsburgh - 0.3264 0.4211 0.5177 0.3407 1.6059
2 2025/4/30 NYU New York University - 0.3213 0.4137 0.5104 0.3354 1.5808
3 2024/6/20 sun CETC - 0.3121 0.4078 0.4966 0.3245 1.5410
4 2025/4/30 Wjh YNU - 0.2744 0.3312 0.4117 0.2551 1.2724
5 2024/6/20 GEN - - 0.1311 0.1074 0.0978 0.1142 0.4505
6 2024/5/10 - - Random Pick Method 0.0343 0.0366 0.0523 0.0442 0.1674

M4 Temporal Answer Grounding in Video Corpus Track
Rank Date Team ID Organization System Name R@1|mIoU R@10|mIoU R@50|mIoU Average
1 2025/4/30 MedEcho Wuhan University - 0.1284 0.2417 0.3243 0.2314
2 2025/4/30 NYU New York University - 0.1202 0.2366 0.3133 0.2233
3 2024/6/20 IIEleven University of Chinese Academy of Sciences - 0.1141 0.2343 0.3098 0.2200
4 2024/5/10 - - Random Pick Method 0.0247 0.0397 0.0509 0.0384
Important Dates
Important Dates and Details of the M4 Instructional Video Question Answering Challenge

Signup to receive updates: using this form

The submission deadline is at 11:59 p.m. of the stated deadline date (UTC/GMT+08:00).

Announcement of shared tasks and Registration open for participation Feb. 17, 2025
Release of detailed task guidelines & training data Feb. 28, 2025
Registration deadline March 25, 2025
Release of test data April 11, 2025
Participants results submission deadline; April 20, 2025
Evaluation results release and call for system reports and conference paper April 30, 2025
Questions?
Some contacts for your quick start with this challenge

Feel free to contact the organizers at b.li2@siat.ac.cn.