Zhenwen Liang's Home Page
Description: A Scientific College Entrance Level Multimodal Question Answering Benchmark
ai (9902) artificial intelligence (4046) agi (124) large language model (34) lmm (22) artificial general intelligence (15) vision language model (7) lmm evaluation (3) large multimodal model (3) scemqa (1)
Example problems in SceMQA, which contains four scientific subjects - math , physics , chemistry and biology in two formats - multiple choice and free response
🔥[2024-01-25]: Our website is now available online! 😆
The paper introduces SceMQA, a novel benchmark for scientific multimodal question answering at the college entrance level. It addresses a critical educational phase often overlooked in existing benchmarks, spanning high school to pre-college levels. SceMQA focuses on core science subjects including Mathematics, Physics, Chemistry, and Biology. It features a blend of multiple-choice and free-response formats, ensuring a comprehensive evaluation of AI models’ abilities. Additionally, our benchmark provides sp
Zhenwen Liang's Home Page