Hao Fei - Home
Shengqiong Wu
Hao Fei - Home
Description: Vitron: A Unified Pixel-level Vision LLM
multimodal large language models (2)
Existing vision LLMs might still encounter challenges such as superficial instance-level understanding , lack of unified support for both images and videos , and insufficient coverage across various vision tasks . To fill the gaps, we present Vitron , a universal pixel-level vision LLM, designed for comprehensive understanding (perceiving and reasoning), generating, segmenting (grounding and tracking), editing (inpainting) of both static image and dynamic video content.
Figure 1: Task support and key features of Vitron.
Recent developments of vision large language models (LLMs) have seen remarkable progress, yet still encounter challenges towards multimodal generalists, such as coarse-grained instance-level understanding, lack of unified support for both images and videos, and insufficient coverage across various vision tasks. To fill the gaps, we present Vitron , a universal pixel-level vision LLM designed for comprehensive understanding, generating, segmenting, and editing of both static image and dynamic video content.
Hao Fei - Home
Shengqiong Wu
Hao Fei - Home