GitHub

VAR: a new visual generation method elevates GPT-style models beyond diffusion & Scaling laws observed

🕹️ Try and Play with VAR! We provide a demo website for you to play with VAR models and generate images interactively. Enjoy the fun of visual autoregressive modeling! We provide a demo website for ...
GitHub

Don’t Blind Your VLA: Aligning Visual Representations for OOD Generalization

To address the degradation of visual-language (VL) representations during VLA supervised fine-tuning (SFT), we introduce Visual Representation Alignment. During SFT, we pull a VLA’s visual tokens ...
Microsoft

LLM2CLIP: Powerful Language Model Unlocks Richer Visual Representation

CLIP is one of the most important multimodal foundational models today. What powers CLIP’s capabilities? The rich supervision signals provided by natural language, the carrier of human knowledge, ...
Microsoft

LLM2CLIP: Powerful Language Model Unlocks Richer Visual Representation - Microsoft Research

CLIP is one of the most important multimodal foundational models today, aligning visual and textual signals into a shared feature space using a simple contrastive learning loss on large-scale ...
IEEE

Reconstructing Visual Stimulus Representation From EEG Signals Based on Deep Visual Representation Model

Abstract: Reconstructing visual stimulus representation is a significant task in neural decoding. Until now, most studies have considered functional magnetic resonance imaging (fMRI) as the signal ...
IEEE

Autonomous Deformable Tissue Retraction System Based on 2-D Visual Representation and Asymmetric Reinforcement Learning for Robotic Surgery

Abstract: Deformable tissue retraction is a common but time-consuming task in robotic surgery. An autonomous robotic deformable tissue retraction system has the potential to help surgeons reduce ...