Publications
[Multimodal],
[Segmentation],
[Generation]
|
[Multimodal]
MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine
Yunfei Xie,
Ce Zhou,
Lang Gao,
Juncheng Wu,
Xianhang Li,
Hong-Yu Zhou,
Liu Sheng,
Lei Xing,
James Zou,
Cihang Xie,
Yuyin Zhou
ICLR, 2025
paper / website
TL;DR:
To scale up multimodal medical datasets, we developed an automated pipeline to generate multigranular visual and textual annotations for any given medical image. Based on this pipeline, we introduced MedTrinity-25M, a comprehensive, large-scale dataset containing over 25 million images, including detailed ROIs.
|
|
[Segmentation]
From Pixels to Objects: A Hierarchical Approach for Part and Object Segmentation Using Local and Global Aggregation
Yunfei Xie,
Cihang Xie,
Alan Yuille,
Jieru Mei
ECCV, 2024
paper
TL;DR:
We developed a hierarchical superpixel-based model that simultaneously addresses two conflicting needs in segmentation: local detail for parts and global context for objects. By employing local aggregation for superpixels in part segmentation and global aggregation for group tokens in object segmentation, we achieved state-of-the-art performance in part and object segmentation.
|
|
[Multimodal]
A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor?
Yunfei Xie,
Juncheng Wu,
Haoqin Tu,
Siwei Yang,
Bingchen Zhao,
Yongshuo Zong,
Qiao Jin,
Cihang Xie,
Yuyin Zhou
arxiv, 2024
paper /
code /
data
TL;DR:
We benchmarked OpenAI's o1-preview model on a comprehensive medical dataset covering 37 diverse tasks, including understanding, reasoning, multilingual capabilities, and agent interaction. Additionally, we presented preliminary findings that enhance clinical reasoning in o1 and discussed the model’s limitations and future directions for improvement.
|
|
[Generation]
Story-Adapter: A Training-free Iterative Framework For Long Story Visualization
Jiawei Mao*,
Xiaoke Huang*,
Yunfei Xie,
Yuanqi Chang,
Mude Hui,
Bingjie Xu,
Yuyin Zhou
arxiv, 2024
paper /
code
TL;DR:
We proposed a training-free and efficient framework for generating long stories with up to 100 frames. We designed an iterative paradigm that progressively refines the process by integrating text and global constraints, achieving more precise interactions and improved semantic consistency throughout the story.
|
|
[Segmentation]
Few-shot Medical Image Segmentation via Supervoxel Transformer
Yunfei Xie,
Alan Yuille,
Cihang Xie,
Yuyin Zhou,
Jieru Mei
arxiv, 2024
paper
TL;DR:
To address the complexity of 3D medical volume representations, we proposed supervoxels, which are more flexible and semantically meaningful, suitable for 3D organ structures.
|
|
[Segmentation]
Brain Tumor Segmentation Through SuperVoxel Transformer
Yunfei Xie,
Ce Zhou,
Jieru Mei,
Xianhang Li,
Cihang Xie,
Yuyin Zhou
ISBI, 2024
paper
TL;DR:
We developed two CNN-Transformer hybrid models as part of the BraTS-ISBI 2024 challenge to create brain tumor segmentation models with broad applicability.
|
2025: ICLR, CVPR, ICML, TMM
2024: CVPR, ICML, IEEE ISBI
|
This website template was borrowed from Jon Barron .
Last updated on July 29th, 2024.
|
|