Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding

Lingdong Kong, Xiang Xu, Jun Cen, Wenwei Zhang, Liang Pan, Kai Chen, Ziwei Liu.
Winter Conf. on Applications of Computer Vision (WACV), 2025

PDF Code

L4GM: Large 4D Gaussian Reconstruction Model

Jiawei Ren, Kevin Xie, Ashkan Mirzaei, Hanxue Liang, Xiaohui Zeng, Karsten Kreis, Ziwei Liu, Antonio Torralba, Sanja Fidler, Seung Wook Kim, Huan Ling.
Neural Information Processing Systems (NeurIPS), 2024

PDF Project Page

Make-it-Real: Unleashing Large Multimodal Model's Ability for Painting 3D Objects with Realistic Materials

Ye Fang, Zeyi Sun, Tong Wu, Jiaqi Wang, Ziwei Liu, Gordon Wetzstein, Dahua Lin.
Neural Information Processing Systems (NeurIPS), 2024

PDF Project Page Code Demo

AID: Attention Interpolation of Text-to-Image Diffusion

Qiyuan He, Jinghao Wang, Ziwei Liu, Angela Yao.
Neural Information Processing Systems (NeurIPS), 2024

PDF Project Page Code Demo

ReVersion: Diffusion-Based Relation Inversion from Images

Ziqi Huang*, Tianxing Wu*, Yuming Jiang, Kelvin C.K. Chan, Ziwei Liu.
SIGGRAPH Asia (Conference Track), 2024

PDF Project Page Code Demo

TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Model

Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Hang Zhou, Shengyi He, Zhiliang Xu, Haocheng Feng, Errui Ding, Jingdong Wang, Hongtao Xie, Youjian Zhao, Ziwei Liu.
SIGGRAPH Asia (Conference Track), 2024

PDF Project Page Demo

LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation

Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024 (Oral)

PDF Project Page Code Demo

MMBench: Is Your Multi-modal Model an All-around Player?

Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, Conghui He, Ziwei Liu, Kai Chen, Dahua Lin.
European Conference on Computer Vision (ECCV), 2024 (Oral)

PDF Project Page Code

ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer

Jiazhi Guan, Zhiliang Xu, Hang Zhou, Kaisiyuan Wang, Shengyi He, Zhanwang Zhang, Borong Liang, Haocheng Feng, Errui Ding, Jingtuo Liu, Jingdong Wang, Youjian Zhao, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024 (Oral)

PDF Project Page Demo

Large Motion Model for Unified Multi-Modal Motion Generation

Mingyuan Zhang, Daisheng Jin, Chenyang Gu, Fangzhou Hong, Zhongang Cai, Jingfang Huang, Chongzhi Zhang, Xinying Guo, Lei Yang, Ying He, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

FreeInit: Bridging Initialization Gap in Video Diffusion Models

Tianxing Wu, Chenyang Si, Yuming Jiang, Ziqi Huang, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

StructLDM: Structured Latent Diffusion for 3D Human Generation

Tao Hu, Fangzhou Hong, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidance

Yongwei Chen, Tengfei Wang, Tong Wu, Xingang Pan, Kui Jia, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Demo

Octopus: Embodied Vision-Language Programmer from Environmental Feedback

Jingkang Yang, Yuhao Dong, Shuai Liu, Bo Li, Ziyue Wang, Chencheng Jiang, Haoran Tan, Jiamu Kang, Yuanhan Zhang, Kaiyang Zhou, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

FunQA: Towards Surprising Video Comprehension

Binzhu Xie, Sicheng Zhang, Zitang Zhou, Bo Li, Yuanhan Zhang, Jack Hessel, Jingkang Yang, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo

Tianqi Liu, Guangcong Wang, Shoukang Hu, Liao Shen, Xinyi Ye, Yuhang Zang, Zhiguo Cao, Wei Li, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

GroupDiff: Diffusion-based Group Portrait Editing

Yuming Jiang, Nanxuan Zhao, Qing Liu, Krishna Kumar Singh, Shuai Yang, Chen Change Loy, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2024

PDF

WHAC: World-grounded Humans and Cameras

Wanqi Yin, Zhongang Cai, Ruisi Wang, Fanzhou Wang, Chen Wei, Haiyi Mei, Weiye Xiao, Zhitao Yang, Qingping Sun, Atsushi Yamashita, Ziwei Liu, Lei Yang.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code Demo

Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation

Mengchen Zhang, Tong Wu, Tai Wang, Tengfei Wang, Ziwei Liu, Dahua Lin.
European Conference on Computer Vision (ECCV), 2024

PDF Code Demo

Deep Nets with Subsampling Layers Unwittingly Discard Useful Activations at Test-Time

Chiao-An Yang, Ziwei Liu, Raymond A. Yeh.
European Conference on Computer Vision (ECCV), 2024

PDF Code

4D Contrastive Superflows are Dense 3D Representation Learners

Xiang Xu, Lingdong Kong, Hui Shuai, Wenwei Zhang, Liang Pan, Kai Chen, Ziwei Liu, Qingshan Liu.
European Conference on Computer Vision (ECCV), 2024

PDF Code

TC4D: Trajectory-Conditioned Text-to-4D Generation

Sherwin Bahmani, Xian Liu, Yifan Wang, Ivan Skorokhodov, Victor Rong, Ziwei Liu, Xihui Liu, Jeong Joon Park, Sergey Tulyakov, Gordon Wetzstein, Andrea Tagliasacchi, David B. Lindell.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page Code

Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild

Lingni Ma, Yuting Ye, Fangzhou Hong, Vladimir Guzov, Yifeng Jiang, Rowan Postyeni, Luis Pesqueira, Alexander Gamino, Vijay Baiyya, Hyo Jin Kim, Kevin Bailey, David Soriano Fosas, C. Karen Liu, Ziwei Liu, Jakob Engel, Renzo De Nardi, Richard Newcombe.
European Conference on Computer Vision (ECCV), 2024

PDF Project Page

FreeU: Free Lunch in Diffusion U-Net

Chenyang Si, Ziqi Huang, Yuming Jiang, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024 (Oral)

PDF Project Page Code Demo

URHand: Universal Relightable Hands

Zhaoxi Chen, Gyeongsik Moon, Kaiwen Guo, Chen Cao, Stanislav Pidhorskyi, Tomas Simon, Rohan Joshi, Yuan Dong, Yichen Xu, Bernardo Pires, He Wen, Lucas Evans, Bo Peng, Julia Buffalini, Autumn Trimble, Kevyn McPhail, Melissa Schoeller, Shoou-I Yu, Javier Romero, Michael Zollhöfer, Yaser Sheikh, Ziwei Liu, Shunsuke Saito.
Computer Vision and Pattern Recognition (CVPR), 2024 (Oral)

PDF Project Page Code Demo

VBench: Comprehensive Benchmark Suite for Video Generative Models

Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, Yaohui Wang, Xinyuan Chen, Limin Wang, Dahua Lin, Yu Qiao, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024 (Highlight)

PDF Project Page Code Demo

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting

Xian Liu, Xiaohang Zhan, Jiaxiang Tang, Ying Shan, Gang Zeng, Dahua Lin, Xihui Liu, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024 (Highlight)

PDF Project Page Code Demo

Digital Life Project: Autonomous 3D Characters with Social Intelligence

Zhongang Cai, Jianping Jiang, Zhongfei Qing, Xinying Guo, Mingyuan Zhang, Zhengyu Lin, Haiyi Mei, Chen Wei, Ruisi Wang, Wanqi Yin, Xiangyu Fan, Han Du, Liang Pan, Peng Gao, Zhitao Yang, Yang Gao, Jiaqi Li, Tianxiang Ren, Yukun Wei, Xiaogang Wang, Chen Change Loy, Lei Yang, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

VideoBooth: Diffusion-based Video Generation with Image Prompts

Yuming Jiang, Tianxing Wu, Shuai Yang, Chenyang Si, Dahua Lin, Yu Qiao, Chen Change Loy, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

CityDreamer: Compositional Generative Model of Unbounded 3D Cities

Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

GauHuman: Articulated Gaussian Splatting from Monocular Human Videos

Shoukang Hu, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering

Tao Hu, Fangzhou Hong, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

Link-Context Learning for Multimodal LLMs

Yan Tai, Weichen Fan, Zhao Zhang, Feng Zhu, Rui Zhao, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Code

AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimation

Qingping Sun, Yanjun Wang, Ailing Zeng, Wanqi Yin, Chen Wei, Wenjia Wang, Haiyi Mei, Chi Sing Leung, Ziwei Liu, Lei Yang, Zhongang Cai.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code

GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation

Tong Wu, Guandao Yang, Zhibing Li, Kai Zhang, Ziwei Liu, Leonidas Guibas, Dahua Lin, Gordon Wetzstein.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code

Move Anything with Layered Scene Diffusion

Jiawei Ren, Mengmeng Xu, Jui-Chieh Wu, Ziwei Liu, Tao Xiang, Antoine Toisoul.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF

FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation

Shuai Yang, Yifan Zhou, Ziwei Liu, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

Towards Language-Driven Video Inpainting via Multimodal Large Language Models

Jianzong Wu, Xiangtai Li, Chenyang Si, Shangchen Zhou, Jingkang Yang, Jiangning Zhang, Yining Li, Kai Chen, Yunhai Tong, Ziwei Liu, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

Multi-Space Alignments Towards Universal LiDAR Segmentation

Youquan Liu, Lingdong Kong, Xiaoyang Wu, Runnan Chen, Xin Li, Liang Pan, Ziwei Liu, Yuexin Ma.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Code

Vlogger: Make Your Dream A Vlog

Shaobin Zhuang, Kunchang Li, Xinyuan Chen, Yaohui Wang, Ziwei Liu, Yu Qiao, Yali Wang.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code Demo

SinSR: Diffusion-Based Image Super-Resolution in a Single Step

Yufei Wang, Wenhan Yang, Xinyuan Chen, Yaohui Wang, Lanqing Guo, Lap-Pui Chau, Ziwei Liu, Yu Qiao, Alex C. Kot, Bihan Wen.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Code

InstructVideo: Instructing Video Diffusion Models with Human Feedback

Hangjie Yuan, Shiwei Zhang, Xiang Wang, Yujie Wei, Tao Feng, Yining Pan, Yingya Zhang, Ziwei Liu, Samuel Albanie, Dong Ni.
Computer Vision and Pattern Recognition (CVPR), 2024

PDF Project Page Code

DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation

Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, Gang Zeng.
Inter. Conference on Learning Representations (ICLR), 2024 (Oral)

PDF Project Page Code Demo

InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation

Yi Wang, Yinan He, Yizhuo Li, Kunchang Li, Jiashuo Yu, Xin Ma, Xinyuan Chen, Yaohui Wang, Ping Luo, Ziwei Liu, Yali Wang, Limin Wang, Yu Qiao.
Inter. Conference on Learning Representations (ICLR), 2024 (Spotlight)

PDF Code

SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction

Xinyuan Chen, Yaohui Wang, Lingjun Zhang, Shaobin Zhuang, Xin Ma, Jiashuo Yu, Yali Wang, Dahua Lin, Yu Qiao, Ziwei Liu.
Inter. Conference on Learning Representations (ICLR), 2024

PDF Project Page Code Demo

FreeNoise: Tuning-Free Longer Video Diffusion via Noise Rescheduling

Haonan Qiu, Menghan Xia, Yong Zhang, Yingqing He, Xintao Wang, Ying Shan, Ziwei Liu.
Inter. Conference on Learning Representations (ICLR), 2024

PDF Project Page Code Demo

Large-Vocabulary 3D Diffusion Model with Transformer

Ziang Cao, Fangzhou Hong, Tong Wu, Liang Pan, Ziwei Liu.
Inter. Conference on Learning Representations (ICLR), 2024

PDF Project Page Code Demo

HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusion

Xian Liu, Jian Ren, Aliaksandr Siarohin, Ivan Skorokhodov, Yanyu Li, Dahua Lin, Xihui Liu, Ziwei Liu, Sergey Tulyakov.
Inter. Conference on Learning Representations (ICLR), 2024

PDF Project Page Code Demo

Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment

Siyao Li, Tianpei Gu, Zhitao Yang, Zhengyu Lin, Ziwei Liu, Henghui Ding, Lei Yang, Chen Change Loy.
Inter. Conference on Learning Representations (ICLR), 2024

PDF Project Page Code Demo

ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars

Zhenwei Wang, Tengfei Wang, Gerhard Hancke, Ziwei Liu, Rynson W.H. Lau.
SIGGRAPH (Conference Track), 2024

PDF Project Page Code

MMHead: Towards Fine-grained Multi-modal 3D Facial Animation

Sijing Wu, Yunhao Li, Yichao Yan, Huiyu Duan, Ziwei Liu, Guangtao Zhai.
ACM Multimedia (ACM MM), 2024

PDF Project Page Code Demo

Long Context Transfer from Language to Vision

Peiyuan Zhang, Kaichen Zhang, Bo Li, Guangtao Zeng, Jingkang Yang, Yuanhan Zhang, Ziyue Wang, Haoran Tan, Chunyuan Li, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code Demo

WorldQA: Multimodal World Knowledge in Videos through Long-Chain Reasoning

Yuanhan Zhang, Kaichen Zhang, Bo Li, Fanyi Pu, Christopher Arif Setiadharma, Jingkang Yang, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code Demo

DreamGaussian4D: Generative 4D Gaussian Splatting

Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang, Ang Cao, Gang Zeng, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code

CrowdMoGen: Zero-Shot Text-Driven Collective Motion Generation

Xinying Guo, Mingyuan Zhang, Haozhe Xie, Chenyang Gu, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code Demo

GaussianCity: Generative Gaussian Splatting for Unbounded 3D City Generation

Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code Demo

FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Models

Haonan Qiu, Zhaoxi Chen, Zhouxia Wang, Yingqing He, Menghan Xia, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code

3DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors

Fangzhou Hong, Jiaxiang Tang, Ziang Cao, Min Shi, Tong Wu, Zhaoxi Chen, Shuai Yang, Tengfei Wang, Liang Pan, Dahua Lin, Ziwei Liu.
ArXiv, 2023

PDF Code Demo

InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpainting

Jiaxiang Tang, Ruijie Lu, Xiaokang Chen, Xiang Wen, Gang Zeng, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code

MMInA: Benchmarking Multihop Multimodal Internet Agents

Ziniu Zhang, Shulin Tian, Liangyu Chen, Ziwei Liu.
ArXiv, 2024

PDF Project Page Code Demo

Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Qing Yu, Go Irie, Yixuan Li, Hai Li, Ziwei Liu, Kiyoharu Aizawa.
ArXiv, 2024

PDF Code

FashionEngine: Interactive Generation and Editing of 3D Clothed Humans

Tao Hu, Fangzhou Hong, Zhaoxi Chen, Ziwei Liu.
ArXiv, 2024

PDF Project Page Demo

A Comprehensive Survey on 3D Content Generation

Jian Liu, Xiaoshui Huang, Tianyu Huang, Lu Chen, Yuenan Hou, Shixiang Tang, Ziwei Liu, Wanli Ouyang, Wangmeng Zuo, Junjun Jiang, Xianming Liu.
ArXiv, 2024

PDF Code

Multi-scale 2D Temporal Map Diffusion Models for Natural Language Video Localization

Chongzhi Zhang, Mingyuan Zhang, Zhiyang Teng, Jiayi Li, Xizhou Zhu, Lewei Lu, Ziwei Liu, Aixin Sun.
ArXiv, 2024

PDF

Fast-Vid2Vid++: Spatial-Temporal Distillation for Real-Time Video-to-Video Synthesis

Long Zhuo, Guangcong Wang, Shikai Li, Wayne Wu, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Project Page Code Demo

Playing for 3D Human Recovery

Zhongang Cai*, Mingyuan Zhang*, Jiawei Ren*, Chen Wei, Daxuan Ren, Jiatong Li, Zhengyu Lin, Haiyu Zhao, Shuai Yi, Lei Yang, Chen Change Loy, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Project Page Code Dataset Demo

Pair then Relation: Pair-Net for Panoptic Scene Graph Generation

Jinghao Wang, Zhengyu Wen, Xiangtai Li, Jingkang Yang, Zujing Guo, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Code

Transformer-Based Visual Segmentation: A Survey

Xiangtai Li, Henghui Ding, Wenwei Zhang, Haobo Yuan, Jiangmiao Pang, Guangliang Cheng, Kai Chen, Ziwei Liu, Chen Change Loy.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Code

Neural Prompt Search

Yuanhan Zhang, Kaiyang Zhou, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Project Page Code Press

Class-Incremental Learning: A Survey

Da-Wei Zhou, Qi-Wei Wang, Zhi-Hong Qi, Han-Jia Ye, De-Chuan Zhan, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Code

PERF: Panoramic Neural Radiance Field from a Single Panorama

Guangcong Wang, Peng Wang, Zhaoxi Chen, Wenping Wang, Chen Change Loy, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Project Page Code Demo

Detecting and Grounding Multi-Modal Media Manipulation and Beyond

Rui Shao, Tianxing Wu, Jianlong Wu, Liqiang Nie, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Project Page Code Demo

Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer

Zhipeng Luo, Changqing Zhou, Liang Pan, Gongjie Zhang, Tianrui Liu, Yueru Luo, Haiyu Zhao, Ziwei Liu, Shijian Lu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

PDF Code

LaVie: High-Quality Video Generation with Cascaded Latent Diffusion Models

Yaohui Wang, Xinyuan Chen, Xin Ma, Shangchen Zhou, Ziqi Huang, Yi Wang, Ceyuan Yang, Yinan He, Jiashuo Yu, Peiqing Yang, Yuwei Guo, Tianxing Wu, Chenyang Si, Yuming Jiang, Cunjian Chen, Chen Change Loy, Bo Dai, Dahua Lin, Yu Qiao, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2024

PDF Project Page Code Demo

DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection

Rui Shao, Tianxing Wu, Liqiang Nie, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2024

PDF Code

MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation

Jiahao Xie, Wei Li, Xiangtai Li, Ziwei Liu, Yew Soon Ong, Chen Change Loy.
International Journal of Computer Vision (IJCV), 2024

PDF Code

Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need

Da-Wei Zhou, Zi-Wen Cai, Han-Jia Ye, De-Chuan Zhan, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2024

PDF Code

Generalized Out-of-Distribution Detection: A Survey

Jingkang Yang, Kaiyang Zhou, Yixuan Li, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2024

PDF Code

ReliTalk: Relightable Talking Portrait Generation from a Single Video

Haonan Qiu, Zhaoxi Chen, Yuming Jiang, Hang Zhou, Xiangyu Fan, Lei Yang, Wayne Wu, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2024

PDF Project Page Code Demo

OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detection

Jingyang Zhang, Jingkang Yang, Pengyun Wang, Haoqi Wang, Yueqian Lin, Haoran Zhang, Yiyou Sun, Xuefeng Du, Kaiyang Zhou, Wayne Zhang, Yixuan Li, Ziwei Liu, Yiran Chen, Hai Li.
Data-centric Machine Learning Research (DMLR), 2024

PDF Project Page Code

Robust Partial-to-Partial Point Cloud Registration in a Full Range

Liang Pan, Zhongang Cai, Ziwei Liu.
IEEE Robotics and Automation Letters (RA-L), 2024

PDF Code Dataset

Exploiting Hierarchical Interactions for Protein Surface Learning

Yiqun Lin, Liang Pan, Yi Li, Ziwei Liu, and Xiaomeng Li.
IEEE Journal of Biomedical and Health Informatics (JBHI), 2024

PDF Code

Generative Networks

Ziwei Liu, Shuai Yang, Yuming Jiang, Ziqi Huang.
Handbook of Face Recognition, Third Edition, 2024

PDF

4D Panoptic Scene Graph Generation

Jingkang Yang, Jun Cen, Wenxuan Peng, Shuai Liu, Fangzhou Hong, Xiangtai Li, Kaiyang Zhou, Qifeng Chen, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023 (Spotlight)

PDF Code

Segment Any Point Cloud Sequences by Distilling Vision Foundation Models

Youquan Liu, Lingdong Kong, Jun Cen, Runnan Chen, Wenwei Zhang, Liang Pan, Kai Chen, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023 (Spotlight)

PDF Project Page Code Demo

InsActor: Instruction-driven Physics-based Characters

Jiawei Ren, Mingyuan Zhang, Cunjun Yu, Xiao Ma, Liang Pan, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023

PDF Project Page Code Demo

FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editing

Mingyuan Zhang, Huirong Li, Zhongang Cai, Jiawei Ren, Lei Yang, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023

PDF Project Page Code Demo

PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation

Zhaoxi Chen, Fangzhou Hong, Haiyi Mei, Guangcong Wang, Lei Yang, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023

PDF Project Page Code Demo

What Makes Good Examples for Visual In-Context Learning?

Yuanhan Zhang, Kaiyang Zhou, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023

PDF Code

Large Language Models are Visual Reasoning Coordinators

Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023

PDF Code

Towards Robust and Expressive Whole-body Human Pose and Shape Estimation

Hui En Pang, Zhongang Cai, Lei Yang, Qingyi Tao, Zhonghua Wu, Tianwei Zhang, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2023

PDF Project Page Code

SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation

Zhongang Cai, Wanqi Yin, Ailing Zeng, Chen Wei, Qingping Sun, Yanjun Wang, Hui En Pang, Haiyi Mei, Mingyuan Zhang, Lei Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
NeurIPS (Datasets and Benchmarks Track), 2023

PDF Project Page Code Demo

RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars

Dongwei Pan, Long Zhuo, Jingtan Piao, Huiwen Luo, Wei Cheng, Yuxin Wang, Siming Fan, Shengqi Liu, Lei Yang, Bo Dai, Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, Kwan-Yee Lin.
NeurIPS (Datasets and Benchmarks Track), 2023

PDF Project Page Code Press Demo

HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Image

Tong Wu, Zhibing Li, Shuai Yang, Pan Zhang, Xinggang Pan, Jiaqi Wang, Dahua Lin, Ziwei Liu.
SIGGRAPH Asia (Conference Track), 2023

PDF Project Page Code

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

Shuai Yang, Yifan Zhou, Ziwei Liu, Chen Change Loy.
SIGGRAPH Asia (Conference Track), 2023

PDF Project Page Code Demo

Text2Performer: Text-Driven Human Video Generation

Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Demo

SHERF: Generalizable Human NeRF from a Single Image

Shoukang Hu, Fangzhou Hong, Liang Pan, Haiyi Mei, Lei Yang, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Demo

ReMoDiffuse: Retrieval-Augmented Motion Diffusion Model

Mingyuan Zhang, Xinying Guo, Liang Pan, Zhongang Cai, Fangzhou Hong, Huirong Li, Lei Yang, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Demo

SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesis

Guangcong Wang, Zhaoxi Chen, Chen Change Loy, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Demo

Robo3D: Towards Robust and Reliable 3D Perception against Corruptions

Lingdong Kong, Youquan Liu, Xin Li, Runnan Chen, Wenwei Zhang, Jiawei Ren, Liang Pan, Kai Chen, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023
(ICLR 2023 SR4AD Best Paper Award)

PDF Project Page Code Demo

Rethinking Range View Representation for LiDAR Segmentation

Lingdong Kong, Youquan Liu, Runnan Chen, Yuexin Ma, Xinge Zhu, Yikang Li, Yuenan Hou, Yu Qiao, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page

UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation

Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Wayne Wu, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Demo

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling

Zhitao Yang, Zhongang Cai, Haiyi Mei, Shuai Liu, Zhaoxi Chen, Weiye Xiao, Yukun Wei, Zhongfei Qing, Chen Wei, Bo Dai, Wayne Wu, Chen Qian, Dahua Lin, Ziwei Liu, Lei Yang.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Press Demo

DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Rendering

Wei Cheng, Ruixiang Chen, Wanqi Yin, Siming Fan, Keyu Chen, Honglin He, Huiwen Luo, Zhongang Cai, Jingbo Wang, Yang Gao, Zhengming Yu, Zhengyu Lin, Daxuan Ren, Lei Yang, Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, Bo Dai, Kwan-Yee Lin.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Press Demo

StyleGANEX: StyleGAN-Based Manipulation Beyond Cropped Aligned Faces

Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code Demo

DeformToon3D: Deformable 3D Toonification from Neural Radiance Fields

Junzhe Zhang, Yushi Lan, Shuai Yang, Fangzhou Hong, Quan Wang, Chai Kiat Yeo, Ziwei Liu, Chen Change Loy.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page Code

Deep Geometrized Cartoon Line Inbetweening

Siyao Li, Tianpei Gu, Weiye Xiao, Henghui Ding, Ziwei Liu, Chen Change Loy.
International Conference on Computer Vision (ICCV), 2023

PDF Code Demo

Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing

Lu Dai, Liqian Ma, Shenhan Qian, Hao Liu, Ziwei Liu, Hui Xiong.
International Conference on Computer Vision (ICCV), 2023

PDF Project Page

OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation

Tong Wu, Jiarui Zhang, Xiao Fu, Yuxin Wang, Jiawei Ren, Liang Pan, Wayne Wu, Lei Yang, Jiaqi Wang, Chen Qian, Dahua Lin, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2023
(Best Paper Award Candidate, 12 out of 9155)

PDF Project Page Code Demo Press

LaserMix for Semi-Supervised LiDAR Semantic Segmentation

Lingdong Kong, Jiawei Ren, Liang Pan, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2023 (Highlight)
(PREMIA Best Student Paper Award)

PDF Project Page Code Demo Press

F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories

Peng Wang, Yuan Liu, Zhaoxi Chen, Lingjie Liu, Ziwei Liu, Taku Komura, Christian Theobalt, Wenping Wang.
Computer Vision and Pattern Recognition (CVPR), 2023 (Highlight)

PDF Project Page Code Press

Panoptic Video Scene Graph Generation

Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Wayne Zhang, Kaiyang Zhou, Chen Change Loy, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2023

PDF Project Page Code Demo

Detecting and Grounding Multi-Modal Media Manipulation

Rui Shao, Tianxing Wu, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2023

PDF Project Page Code Demo

Collaborative Diffusion for Multi-Modal Face Generation and Editing

Ziqi Huang, Kelvin C.K. Chan, Yuming Jiang, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2023

PDF Project Page Code Demo

Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation

Lingting Zhu, Xian Liu, Xuanyu Liu, Rui Qian, Ziwei Liu, Lequan Yu.
Computer Vision and Pattern Recognition (CVPR), 2023

PDF Code

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator

Jiazhi Guan, Zhanwang Zhang, Hang Zhou, Tianshu Hu, Kaisiyuan Wang, Dongliang He, Haocheng Feng, Jingtuo Liu, Errui Ding, Ziwei Liu, Jingdong Wang.
Computer Vision and Pattern Recognition (CVPR), 2023

PDF Project Page Code Demo

Sparse Mixture-of-Experts are Domain Generalizable Learners

Bo Li, Yifei Shen, Jingkang Yang, Yezhen Wang, Jiawei Ren, Tong Che, Jun Zhang, Ziwei Liu.
Inter. Conference on Learning Representations (ICLR), 2023 (Oral)

PDF Code

EVA3D: Compositional 3D Human Generation from 2D Image Collections

Fangzhou Hong, Zhaoxi Chen, Yushi Lan, Liang Pan, Ziwei Liu.
Inter. Conference on Learning Representations (ICLR), 2023 (Spotlight)

PDF Project Page Code Demo Press

Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstruction

Tong Wu, Jiaqi Wang, Xingang Pan, Xudong Xu, Christian Theobalt, Ziwei Liu, Dahua Lin.
Inter. Conference on Learning Representations (ICLR), 2023 (Spotlight)

PDF Code

DiffMimic: Efficient Motion Mimicking with Differentiable Physics

Jiawei Ren*, Cunjun Yu*, Siwei Chen, Xiao Ma, Liang Pan, Ziwei Liu.
Inter. Conference on Learning Representations (ICLR), 2023

PDF Project Page Code Demo

Masked Frequency Modeling for Self-Supervised Visual Pre-Training

Jiahao Xie, Wei Li, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy.
Inter. Conference on Learning Representations (ICLR), 2023

PDF Project Page Code

BiBench: Benchmarking and Analyzing Network Binarization

Haotong Qin, Mingyuan Zhang, Yifu Ding, Aoyu Li, Zhongang Cai, Ziwei Liu, Fisher Yu, Xianglong Liu.
International Conference on Machine Learning (ICML), 2023

PDF Project Page Code

Efficient Video Portrait Reenactment via Grid-based Codebook

Kaisiyuan Wang, Hang Zhou, Qianyi Wu, Jiaxiang Tang, Zhiliang Xu, Borong Liang, Tianshu Hu, Errui Ding, Jingtuo Liu, Ziwei Liu, Jingdong Wang.
SIGGRAPH (Conference Track), 2023

PDF Code

Robust Video Portrait Reenactment via Personalized Representation Quantization

Kaisiyuan Wang, Changcheng Liang, Hang Zhou, Jiaxiang Tang, Qianyi Wu, Dongliang He, Zhibin Hong, Jingtuo Liu, Errui Ding, Ziwei Liu, Jingdong Wang.
AAAI Conference on Artificial Intelligence (AAAI), 2023

PDF Code

Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis

Lingting Zhu, Zeyue Xue, Zhenchao Jin, Xian Liu, Jingzhen He, Ziwei Liu, Lequan Yu.
Medical Image Comp. and Computer Assisted Interv. (MICCAI), 2023

PDF

Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation

Yasheng Sun, Qianyi Wu, Hang Zhou, Kaisiyuan Wang, Tianshu Hu, Chen-Chieh Liao, Dongliang He, Jingtuo Liu, Errui Ding, Jingdong Wang, Shio Miyafuji, Ziwei Liu, Hideki Koike.
International Conference on Multimodal Interaction (ICMI), 2023 (Oral)

PDF Project Page

SAD: Segment Any RGBD

Jun Cen, Yizheng Wu, Kewei Wang, Xingyi Li, Jingkang Yang, Yixuan Pei, Lingdong Kong, Ziwei Liu, Qifeng Chen.
NeurIPS 2023 Workshop on Robustness of Foundation Models, 2023

PDF Code

Multimodal Foundation Models for Zero-shot Animal Species Recognition in Camera Trap Images

Zalan Fabian, Zhongqi Miao, Chunyuan Li, Yuanhan Zhang, Ziwei Liu, Andrés Hernández, Andrés Montes-Rojas, Rafael Escucha, Laura Siabatto, Andrés Link, Pablo Arbeláez, Rahul Dodhia, Juan Lavista Ferres.
NeurIPS 2023 Workshop on Instruction Tuning and Following, 2023

PDF

Gemini vs GPT-4V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases

Zhangyang Qi, Ye Fang, Mengchen Zhang, Zeyi Sun, Tong Wu, Ziwei Liu, Dahua Lin, Jiaqi Wang, Hengshuang Zhao.
ArXiv, 2023

PDF Code

Latte: Latent Diffusion Transformer for Video Generation

Xin Ma, Yaohui Wang, Gengyun Jia, Xinyuan Chen, Ziwei Liu, Yuan-Fang Li, Cunjian Chen, Yu Qiao.
ArXiv, 2023

PDF Project Page Code

OtterHD: A High-Resolution Multi-modality Model

Bo Li, Peiyuan Zhang, Jingkang Yang, Yuanhan Zhang, Fanyi Pu, Ziwei Liu.
ArXiv, 2023

PDF

Robust Sequential DeepFake Detection

Rui Shao, Tianxing Wu, Ziwei Liu.
ArXiv, 2023

PDF Project Page Code Dataset Press

PointHPS: Cascaded 3D Human Pose and Shape Estimation from Point Clouds

Zhongang Cai*, Liang Pan*, Chen Wei, Wanqi Yin, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
ArXiv, 2023

PDF Project Page Code Video

HumanLiff: Layer-wise 3D Human Generation with Diffusion Model

Shoukang Hu, Fangzhou Hong, Tao Hu, Liang Pan, Haiyi Mei, Weiye Xiao, Lei Yang, Ziwei Liu.
ArXiv, 2023

PDF Project Page Code Demo

Hierarchy Flow For High-Fidelity Image-to-Image Translation

Weichen Fan, Jinghuan Chen, Ziwei Liu.
ArXiv, 2023

PDF Code

Temporally-Adaptive Models for Efficient Video Understanding

Ziyuan Huang, Shiwei Zhang, Liang Pan, Zhiwu Qing, Mingqian Tang, Ziwei Liu, Marcelo H. Ang Jr.
ArXiv, 2023

PDF Project Page Code

Benchmarking and Analyzing Generative Data for Visual Recognition

Bo Li, Haotian Liu, Liangyu Chen, Yong Jae Lee, Chunyuan Li, Ziwei Liu.
ArXiv, 2023

PDF Code

MIMIC-IT: Multi-Modal In-Context Instruction Tuning

Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Fanyi Pu, Jingkang Yang, Chunyuan Li, Ziwei Liu.
ArXiv, 2023

PDF Project Page Code Demo

Otter: A Multi-Modal Model with In-Context Instruction Tuning

Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Jingkang Yang, Ziwei Liu.
ArXiv, 2023

PDF Project Page Code Demo

RoboBEV: Towards Robust Bird's Eye View Perception under Corruptions

Shaoyuan Xie, Lingdong Kong, Wenwei Zhang, Jiawei Ren, Liang Pan, Kai Chen, Ziwei Liu.
ArXiv, 2023

PDF Code

ConsistentNeRF: Enhancing Neural Radiance Fields with 3D Consistency for Sparse View Synthesis

Shoukang Hu, Kaichen Zhou, Kaiyu Li, Longhui Yu, Lanqing Hong, Tianyang Hu, Zhenguo Li, Gim Hee Lee, Ziwei Liu.
ArXiv, 2023

PDF Project Page Code Demo

Learning without Forgetting for Vision-Language Models

Da-Wei Zhou, Yuanhan Zhang, Jingyi Ning, Han-Jia Ye, De-Chuan Zhan, Ziwei Liu.
ArXiv, 2023

PDF

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

Ce Zhou, Qian Li, Chen Li, Jun Yu, Yixin Liu, Guangjing Wang, Kai Zhang, Cheng Ji, Qiben Yan, Lifang He, Hao Peng, Jianxin Li, Jia Wu, Ziwei Liu, Pengtao Xie, Caiming Xiong, Jian Pei, Philip S. Yu, Lichao Sun.
ArXiv, 2023

PDF

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model

Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Demo Press

Talk-to-Edit: Fine-Grained 2D and 3D Facial Editing Via Dialog

Yuming Jiang, Ziqi Huang, Tianxing Wu, Xingang Pan, Chen Change Loy, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Dataset

Unified 3D and 4D Panoptic Segmentation via Dynamic Shifting Network

Fangzhou Hong, Lingdong Kong, Hui Zhou, Xinge Zhu, Hongsheng Li, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Code

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections

Zhaoxi Chen, Guangcong Wang, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Demo Press

Bailando++: 3D Dance GPT with Choreographic Memory

Siyao Li, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Demo

Variational Relational Point Completion Network for Robust 3D Classification

Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang, Haiyu Zhao, Shuai Yi, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Dataset Demo

Reference-based Image and Video Super-Resolution via C²-Matching

Yuming Jiang, Kelvin C.K. Chan, Xintao Wang, Chen Change Loy, Ziwei Liu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Dataset

Towards Real-World Visual Tracking with Temporal Contexts

Ziang Cao, Ziyuan Huang, Liang Pan, Shiwei Zhang, Ziwei Liu, Changhong Fu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Code Demo

GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation

Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF Project Page Code Demo

Semi-Supervised Domain Generalization with Stochastic StyleMatch

Kaiyang Zhou, Chen Change Loy, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2023

PDF Code

Full-Spectrum Out-of-Distribution Detection

Jingkang Yang, Kaiyang Zhou, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2023

PDF Code

Lifting 2D Human Pose to 3D with Domain Adapted 3D Body Concept

Qiang Nie, Ziwei Liu, Yunhui Liu.
International Journal of Computer Vision (IJCV), 2023

PDF

Few-shot Forgery Detection via Guided Adversarial Interpolation

Haonan Qiu, Siyu Chen, Bei Gan, Kun Wang, Huafeng Shi, Jing Shao, Ziwei Liu.
Pattern Recognition (PR), 2023

PDF

Computation-Efficient Knowledge Distillation via Uncertainty-Aware Mixup

Guodong Xu, Ziwei Liu, Chen Change Loy.
Pattern Recognition (PR), 2023

PDF Code

Text2Light: Zero-Shot Text-Driven HDR Panorama Generation

Zhaoxi Chen, Guangcong Wang, Ziwei Liu.
ACM Transactions on Graphics (SIGGRAPH Asia), 2022

PDF Project Page Code Demo Product Transfer

VToonify: Controllable High-Resolution Portrait Video Style Transfer

Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy.
ACM Transactions on Graphics (SIGGRAPH Asia), 2022
(Selected as TOG Cover)

PDF Project Page Code Demo

Masked Lip-Sync Prediction by Uniformed Audio-Visual Context Exploiting with Transformer

Yasheng Sun, Hang Zhou, Kaisiyuan Wang, Qianyi Wu, Zhibin Hong, Jingtuo Liu, Jingdong Wang, Errui Ding, Ziwei Liu, Koike Hideki.
SIGGRAPH Asia (Conference Track), 2022

PDF Project Page Demo

Audio-Driven Co-Speech Gesture Video Generation

Xian Liu, Qianyi Wu, Hang Zhou, Yuanqi Du, Wayne Wu, Dahua Lin, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2022 (Spotlight)

PDF Project Page Code Dataset Demo

OpenOOD: Benchmarking Generalized Out-of-Distribution Detection

Jingkang Yang, Pengyun Wang, Dejian Zou, Zitang Zhou, Kunyuan Ding, Wenxuan Peng, Haoqi Wang, Guangyao Chen, Bo Li, Yiyou Sun, Xuefeng Du, Kaiyang Zhou, Wayne Zhang, Dan Hendrycks, Yixuan Li, Ziwei Liu.
NeurIPS (Datasets and Benchmarks Track), 2022

PDF Code

Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms

Hui En Pang, Zhongang Cai, Lei Yang, Tianwei Zhang, Ziwei Liu.
NeurIPS (Datasets and Benchmarks Track), 2022

PDF Code

AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies

Siyao Li, Yuhang Li, Bo Li, Chao Dong, Ziwei Liu, Chen Change Loy.
NeurIPS (Datasets and Benchmarks Track), 2022

PDF Project Page Code Dataset Demo

HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling

Zhongang Cai*, Daxuan Ren*, Ailing Zeng*, Zhengyu Lin*, Tao Yu*, Wenjia Wang*, Xiangyu Fan, Yang Gao, Yifan Yu, Liang Pan, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022 (Oral)

PDF Project Page Code Dataset Demo Press

Relighting4D: Neural Relightable Human from Videos

Zhaoxi Chen, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Demo

Panoptic Scene Graph Generation

Jingkang Yang, Yi Zhe Ang, Zujin Guo, Kaiyang Zhou, Wayne Zhang, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Dataset Demo Press

Detecting and Recovering Sequential DeepFake Manipulation

Rui Shao, Tianxing Wu, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Dataset Press

Benchmarking Omni-Vision Representation through the Lens of Visual Realms

Yuanhan Zhang, Zhenfei Yin, Jing Shao, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Dataset

StyleLight: HDR Panorama Generation for Lighting Estimation and Editing

Guangcong Wang, Yinuo Yang, Chen Change Loy, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Demo

Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis

Long Zhuo, Guangcong Wang, Shikai Li, Wayne Wu, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Demo

StyleGAN-Human: A Data-Centric Odyssey of Human Generation

Jianglin Fu*, Shikai Li*, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy, Wayne Wu, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Dataset Demo Press

CelebV-HQ: A Large-Scale Video Facial Attributes Dataset

Hao Zhu*, Wayne Wu*, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Dataset Demo

Mind the Gap in Distilling StyleGANs

Guodong Xu, Yuenan Hou, Ziwei Liu, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2022

PDF Code

UNIF: United Neural Implicit Functions for Clothed Human Reconstruction and Animation

Shenhan Qian, Jiale Xu, Ziwei Liu, Liqian Ma, Shenghua Gao.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Demo

X-Learner: Learning Cross Sources and Tasks for Universal Visual Representation

Yinan He, Gengshi Huang, Siyu Chen, Jianing Teng, Wang Kun, Zhenfei Yin, Lu Sheng, Ziwei Liu, Yu Qiao, Jing Shao.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code

StyleSwap: Style-Based Generator Empowers Robust Face Swapping

Zhiliang Xu, Hang Zhou, Zhibin Hong, Ziwei Liu, Jiaming Liu, Zhizhi Guo, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang.
European Conference on Computer Vision (ECCV), 2022

PDF Project Page Code Demo

AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars

Fangzhou Hong*, Mingyuan Zhang*, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu.
ACM Transactions on Graphics (SIGGRAPH), 2022

PDF Project Page Code Demo Press

Text2Human: Text-Driven Controllable Human Image Generation

Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy, Ziwei Liu.
ACM Transactions on Graphics (SIGGRAPH), 2022

PDF Project Page Code Dataset Demo

Benchmarking and Analyzing Point Cloud Classification under Corruptions

Jiawei Ren, Liang Pan, Ziwei Liu.
International Conference on Machine Learning (ICML), 2022

PDF Project Page Code Dataset Demo

Versatile Multi-Modal Pre-Training for Human-Centric Perception

Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)

PDF Project Page Code Dataset

Balanced MSE for Imbalanced Visual Regression

Jiawei Ren, Mingyuan Zhang, Cunjun Yu, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)

PDF Project Page Code Demo

Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory

Siyao Li, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)

PDF Project Page Code Demo

Conditional Prompt Learning for Vision-Language Models

Kaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2022

PDF Code

Delving Deep into the Generalization of Vision Transformers under Distribution Shifts

Chongzhi Zhang*, Mingyuan Zhang*, Shanghang Zhang*, Daisheng Jin, Qiang Zhou, Zhongang Cai, Haiyu Zhao, Shuai Yi, Xianglong Liu, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2022

PDF Code

Full-Range Virtual Try-On with Recurrent Tri-Level Transform

Han Yang, Xinrui Yu, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2022

PDF Project Page Demo

Unsupervised Image-to-Image Translation with Generative Prior

Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2022

PDF Project Page Code Demo

Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer

Shuai Yang, Liming Jiang, Ziwei Liu, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2022

PDF Project Page Code Demo

TCTrack: Temporal Contexts for Aerial Tracking

Ziang Cao, Ziyuan Huang, Liang Pan, Shiwei Zhang, Ziwei Liu, Changhong Fu.
Computer Vision and Pattern Recognition (CVPR), 2022

PDF Code Demo

TAda! Temporally-Adaptive Convolutions for Video Understanding

Ziyuan Huang, Shiwei Zhang, Liang Pan, Zhiwu Qing, Mingqian Tang, Ziwei Liu, Marcelo H. Ang Jr.
Inter. Conference on Learning Representations (ICLR), 2022

PDF Project Page Code

BiBERT: Accurate Fully Binarized BERT

Haotong Qin, Yifu Ding, Mingyuan Zhang, Qinghua Yan, Aishan Liu, Qingqing Dang, Ziwei Liu, Xianglong Liu.
Inter. Conference on Learning Representations (ICLR), 2022

PDF Code

Visual Sound Localization in-the-Wild by Cross-Modal Interference Erasing

Xian Liu, Rui Qian, Hang Zhou, Weiyao Lin, Ziwei Liu, Bolei Zhou, Xiaowei Zhou.
AAAI Conference on Artificial Intelligence (AAAI), 2022

PDF Code

SepFusion: Finding Optimal Fusion Structures for Visual Sound Separation

Dongzhan Zhou, Xinchi Zhou, Di Hu, Hang Zhou, Lei Bai, Ziwei Liu, Wanli Ouyang.
AAAI Conference on Artificial Intelligence (AAAI), 2022

PDF

Free Lunch for Surgical Video Understanding by Distilling Self-Supervisions

Xinpeng Ding, Ziwei Liu, Xiaomeng Li.
Medical Image Comp. and Computer Assisted Interv. (MICCAI), 2022

PDF Code

PointCloud-C: Benchmarking and Analyzing Point Cloud Perception Robustness under Corruptions

Jiawei Ren*, Lingdong Kong*, Liang Pan, Ziwei Liu.
ArXiv, 2022

PDF Project Page Code Dataset Demo

TripleE: Easy Domain Generalization via Episodic Replay

Xiaomeng Li, Hongyu Ren, Huifeng Yao, Ziwei Liu.
ArXiv, 2022

PDF Code

On-Device Domain Generalization

Kaiyang Zhou, Yuanhan Zhang, Yuhang Zang, Jingkang Yang, Chen Change Loy, Ziwei Liu.
ArXiv, 2022

PDF Code

StyleFaceV: Face Video Generation via Decomposing and Recomposing Pretrained StyleGAN3

Haonan Qiu, Yuming Jiang, Hang Zhou, Wayne Wu, Ziwei Liu.
ArXiv, 2022

PDF Project Page Code Demo

Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy

Yuanhan Zhang, Qinghong Sun, Yichun Zhou, Zexin He, Zhenfei Yin, Kun Wang, Lu Sheng, Yu Qiao, Jing Shao, Ziwei Liu.
arXiv Preprint, 2022

PDF Project Page Code Dataset Demo

Robust Face Anti-Spoofing with Dual Probabilistic Modeling

Yuanhan Zhang, Yichao Wu, Zhenfei Yin, Jing Shao, Ziwei Liu.
arXiv Preprint, 2022

PDF

Open Long-Tailed Recognition in a Dynamic World

Ziwei Liu*, Zhongqi Miao*, Xiaohang Zhan, Jiayun Wang, Boqing Gong, Stella X. Yu.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022

PDF Project Page Code Demo Press

Domain Generalization: A Survey

Kaiyang Zhou, Ziwei Liu, Yu Qiao, Tao Xiang, Chen Change Loy.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022

PDF Code

Learning to Prompt for Vision-Language Models

Kaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei Liu.
International Journal of Computer Vision (IJCV), 2022

PDF Code

Delving into Inter-Image Invariance for Unsupervised Visual Representations

Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew-Soon Ong, Chen Change Loy.
International Journal of Computer Vision (IJCV), 2022

PDF Code

Chasing the Tail in Monocular 3D Human Reconstruction with Prototype Memory

Yu Rong, Ziwei Liu, Chen Change Loy.
IEEE Transactions on Image Processing (TIP), 2022

PDF Project Page Code

Multi-View Partial (MVP) Point Cloud Challenge 2021 on Completion and Registration: Methods and Results

Liang Pan, Tong Wu, Zhongang Cai, Ziwei Liu, et al.
arXiv Preprint, 2021

PDF Project Page Code

ForgeryNet - Face Forgery Analysis Challenge 2021: Methods and Results

Yinan He, Lu Sheng, Jing Shao, Ziwei Liu, et al.
arXiv Preprint, 2021

PDF Project Page Code

Multi-Forgery Detection Challenge 2022: Push the Frontier of Unconstrained and Diverse Forgery Detection

Jianshu Li, Man Luo, Jian Liu, Tao Chen, Chengjie Wang, Ziwei Liu, et al.
arXiv Preprint, 2022

PDF Project Page

Iterative Human and Automated Identification of Wildlife Images

Zhongqi Miao*, Ziwei Liu*, Kaitlyn M. Gaynor, Meredith S. Palmer, Stella X. Yu, Wayne M. Getz.
Nature - Machine Intelligence, 2021
(WAIC Young Researcher Outstanding Paper Award)

PDF Code Dataset Demo Press

Garment4D: Garment Reconstruction from Point Cloud Sequences

Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu.
Neural Information Processing Systems (NeurIPS), 2021

PDF Project Page Code Demo Press

Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completion

Tong Wu, Liang Pan, Junzhe Zhang, Tai Wang, Ziwei Liu, Dahua Lin.
Neural Information Processing Systems (NeurIPS), 2021

PDF Code

Few-Shot Object Detection via Association and DIscrimination

Yuhang Cao, Jiaqi Wang, Ying Jin, Tong Wu, Kai Chen, Ziwei Liu, Dahua Lin.
Neural Information Processing Systems (NeurIPS), 2021

PDF Code

Unsupervised Object-Level Representation Learning from Scene Images

Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew-Soon Ong, Chen Change Loy.
Neural Information Processing Systems (NeurIPS), 2021

PDF Project Page Code

Talk-to-Edit: Fine-Grained Facial Editing via Dialog

Yuming Jiang*, Ziqi Huang*, Xingang Pan, Chen Change Loy, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2021

PDF Project Page Code Dataset

Semantically Coherent Out-of-Distribution Detection

Jingkang Yang, Haoqi Wang, Litong Feng, Xiaopeng Yan, Huabin Zheng, Wayne Zhang, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2021

PDF Project Page Code Dataset

Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency

Zhipeng Luo, Zhongang Cai, Changqing Zhou, Gongjie Zhang, Haiyu Zhao, Shuai Yi, Shijian Lu, Hongsheng Li, Shanghang Zhang, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2021

PDF Code

Differentiable Dynamic Wirings for Neural Networks

Kun Yuan, Quanquan Li, Shaopeng Guo, Dapeng Chen, Aojun Zhou, Fengwei Yu, Ziwei Liu.
International Conference on Computer Vision (ICCV), 2021

PDF

Incorporating Convolution Designs into Visual Transformers

Kun Yuan, Shaopeng Guo, Ziwei Liu, Aojun Zhou, Fengwei Yu, Wei Wu.
International Conference on Computer Vision (ICCV), 2021

PDF Code

Energy-Based Open-World Uncertainty Modeling for Confidence Calibration

Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, Dongsheng Li.
International Conference on Computer Vision (ICCV), 2021

PDF Code

BlockPlanner: City Block Generation with Vectorized Graph Representation

Linning Xu, Yuanbo Xiangli, Anyi Rao, Nanxuan Zhao, Bo Dai, Ziwei Liu, Dahua Lin.
International Conference on Computer Vision (ICCV), 2021

PDF Project Page Code

Variational Relational Point Completion Network

Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang, Haiyu Zhao, Shuai Yi, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)

PDF Project Page Code Dataset Demo

ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis

Yinan He*, Bei Gan*, Siyu Chen*, Yichun Zhou*, Guojun Yin, Luchuan Song, Lu Sheng, Jing Shao, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)

PDF Project Page Code Demo

Adversarial Robustness under Long-Tailed Distribution

Tong Wu, Ziwei Liu, Qingqiu Huang, Yu Wang, Dahua Lin.
Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)

PDF Code

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

Fangzhou Hong, Hui Zhou, Xinge Zhu, Hongsheng Li, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2021 (Winning Entry of SemanticKITTI Panoptic Segmentation Track)

PDF Code

Robust Reference-based Super-Resolution via C²-Matching

Yuming Jiang, Kelvin C.K. Chan, Xintao Wang, Chen Change Loy, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2021

PDF Project Page Code Dataset

Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation

Hang Zhou, Yasheng Sun, Wayne Wu, Chen Change Loy, Xiaogang Wang, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2021

PDF Project Page Code Demo

Deep Animation Video Interpolation in the Wild

Siyao Li*, Shiyu Zhao*, Weijiang Yu, Wenxiu Sun, Dimitris N. Metaxas, Chen Change Loy, Ziwei Liu.
Computer Vision and Pattern Recognition (CVPR), 2021

PDF Code Demo

Visually Informed Binaural Audio Generation without Binaural Audios

Xudong Xu*, Hang Zhou*, Ziwei Liu, Bo Dai, Xiaogang Wang, Dahua Lin.
Computer Vision and Pattern Recognition (CVPR), 2021

PDF Project Page Code Demo

Seesaw Loss for Long-Tailed Instance Segmentation

Jiaqi Wang, Wenwei Zhang, Yuhang Zang, Yuhang Cao, Jiangmiao Pang, Tao Gong, Kai Chen, Ziwei Liu, Chen Change Loy, Dahua Lin.
Computer Vision and Pattern Recognition (CVPR), 2021

PDF Code

Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination

Xudong Wang, Ziwei Liu, Stella X. Yu.
Computer Vision and Pattern Recognition (CVPR), 2021

PDF Project Page Code

Do 2D GANs Know 3D Shape? Unsupervised 3D Shape Reconstruction from 2D Image GANs

Xingang Pan, Bo Dai, Ziwei Liu, Chen Change Loy, Ping Luo.
Inter. Conference on Learning Representations (ICLR), 2021 (Oral)

PDF Project Page Code

Long-Tailed Recognition by Routing Diverse Distribution-Aware Experts

Xudong Wang, Long Lian, Zhongqi Miao, Ziwei Liu, Stella X. Yu.
Inter. Conference on Learning Representations (ICLR), 2021 (Spotlight)

PDF Project Page Code

CARAFE++: Unified Content-Aware ReAssembly of FEatures

Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021

PDF Code

PTeacher: a Computer-Aided Personalized Pronunciation Training System with Exaggerated Audio-Visual Corrective Feedback

Yaohua Bu*, Tianyi Ma*, Weijun Li, Hang Zhou, Jia Jia, Shengqi Chen, Kaiyuan Xu, Dachuan Shi, Haozhe Wu, Zhihan Yang, Kun Li, Zhiyong Wu, Yuanchun Shi, Xiaobo Lu, Ziwei Liu.
ACM Conference on Human Factors in Computing Systems (CHI), 2021

PDF Demo

Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinements

Yu Rong, Jingbo Wang, Ziwei Liu, Chen Change Loy.
International Conference on 3D Vision (3DV), 2021

PDF Project Page Code Demo Press

Speech2Talking-Face: Inferring and Driving a Face with Synchronized Audio-Visual Representation

Yasheng Sun*, Hang Zhou*, Ziwei Liu, Hideki Koike.
International Joint Conference on Artificial Intelligence (IJCAI), 2021

PDF

Person-in-Context Synthesis with Compositional Structural Space

Weidong Yin, Ziwei Liu, Leonid Sigal.
Winter Conf. on Applications of Computer Vision (WACV), 2021 (Oral)

PDF

ShineOn: Illuminating Design Choices for Practical Video-based Virtual Clothing Try-on

Gaurav Kuppa, Andrew Jong, Vera Liu, Ziwei Liu, Teng-Sheng Moh.
WACV Workshop on Generation of Human Behavior, 2021 (Winning Entry)

PDF Project Page Code Demo

MMFashion: An Open-Source Toolbox for Visual Fashion Analysis

Xin Liu, Jiancheng Li, Jiaqi Wang, Ziwei Liu.
ACM Multimedia (ACM MM), 2021 (Open Source Software Competition)

PDF Code

CelebA-Spoof Challenge 2020 on Face Anti-Spoofing: Methods and Results

Yuanhan Zhang, Zhenfei Yin, Jing Shao, Ziwei Liu, et al.
arXiv Preprint, 2021

PDF Project Page Code

DeeperForensics Challenge 2020 on Real-World Face Forgery Detection: Methods and Results

Liming Jiang, Zhengkui Guo, Wayne Wu, Zhaoyang Liu, Ziwei Liu, Chen Change Loy, et al.
arXiv Preprint, 2021

PDF Project Page Code

Distribution-Balanced Loss for Multi-Label Classification in Long-Tailed Datasets

Tong Wu, Qingqiu Huang, Ziwei Liu, Yu Wang, Dahua Lin.
European Conference on Computer Vision (ECCV), 2020 (Spotlight)

PDF Code

CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotations

Yuanhan Zhang*, Zhenfei Yin*, Yidong Li, Guojun Yin, Junjie Yan, Jing Shao, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2020

PDF Dataset Code Demo

Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation

Hang Zhou*, Xudong Xu*, Dahua Lin, Xiaogang Wang, Ziwei Liu.
European Conference on Computer Vision (ECCV), 2020

PDF Project Page Code Demo

Placepedia: Comprehensive Place Understanding with Multi-Faceted Annotations

Huaiyi Huang, Yuqi Zhang, Qingqiu Huang, Zhengkui Guo, Ziwei Liu, Dahua Lin.
European Conference on Computer Vision (ECCV), 2020

PDF Project Page Code

Knowledge Distillation Meets Self-Supervision

Guodong Xu, Ziwei Liu, Xiaoxiao Li, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2020

PDF Code

Unsupervised 3D Human Pose Representation with Viewpoint and Pose Disentanglement

Qiang Nie, Ziwei Liu, Yunhui Liu.
European Conference on Computer Vision (ECCV), 2020

PDF Code Demo

Open Compound Domain Adaptation

Ziwei Liu*, Zhongqi Miao*, Xingang Pan, Xiaohang Zhan, Dahua Lin, Stella X. Yu, Boqing Gong.
Computer Vision and Pattern Recognition (CVPR), 2020 (Oral)

PDF Project Page Code Demo Press

Self-Supervised Scene De-occlusion

Xiaohang Zhan, Xingang Pan, Bo Dai, Ziwei Liu, Dahua Lin, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2020 (Oral)

PDF Project Page Code Demo

Online Deep Clustering for Unsupervised Representation Learning

Xiaohang Zhan*, Jiahao Xie*, Ziwei Liu, Yew-Soon Ong, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2020

PDF Code

When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks

Minghao Guo*, Yuzhe Yang*, Rui Xu, Ziwei Liu, Dahua Lin.
Computer Vision and Pattern Recognition (CVPR), 2020

PDF Project Page Code Demo

Rotate-and-Render: Unsupervised Photorealistic Face Rotation without Paired Data

Hang Zhou, Jihao Liu, Ziwei Liu, Yu Liu, Xiaogang Wang.
Computer Vision and Pattern Recognition (CVPR), 2020

PDF Code Demo

MaskGAN: Towards Diverse and Interactive Facial Image Manipulation

Cheng-Han Lee, Ziwei Liu, Lingyun Wu, Ping Luo.
Computer Vision and Pattern Recognition (CVPR), 2020

PDF Dataset Code Demo

Unsupervised Landmark Learning from Unpaired Data

Yinghao Xu, Ceyuan Yang, Ziwei Liu, Bo Dai, Bolei Zhou.
arXiv Preprint, 2020

PDF Code

Learning Diverse Fashion Collocation by Neural Graph Filtering

Xin Liu, Yongbin Sun, Ziwei Liu, Dahua Lin.
IEEE Transactions on Multimedia (TMM), 2020

PDF Code

PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attention

Yongbin Sun, Yue Wang, Ziwei Liu, Joshua E. Siegel, Sanjay E. Sarma.
Winter Conf. on Applications of Computer Vision (WACV), 2020 (Oral)

PDF Project Page Code Demo

CARAFE: Content-Aware ReAssembly of FEatures

Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin.
International Conference on Computer Vision (ICCV), 2019 (Oral)

PDF Code

Delving Deep into Hybrid Annotations for 3D Human Recovery in the Wild

Yu Rong, Ziwei Liu, Cheng Li, Kaidi Cao, Chen Change Loy.
International Conference on Computer Vision (ICCV), 2019

PDF Project Page Code Demo

Vision-Infused Deep Audio Inpainting

Hang Zhou, Ziwei Liu, Xudong Xu, Ping Luo, Xiaogang Wang.
International Conference on Computer Vision (ICCV), 2019

PDF Project Page Code Demo

One-shot Face Reenactment

Yunxuan Zhang, Siwei Zhang, Yue He, Cheng Li, Chen Change Loy, Ziwei Liu.
British Machine Vision Conference (BMVC), 2019 (Spotlight)

PDF Project Page Code Demo

Large-scale Long-Tailed Recognition in an Open World

Ziwei Liu*, Zhongqi Miao*, Xiaohang Zhan, Jiayun Wang, Boqing Gong, Stella X. Yu.
Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
(HKSTP Best Paper Award)

PDF Project Page Code Demo Press

Self-Supervised Learning via Conditional Motion Propagation

Xiaohang Zhan, Xingang Pan, Ziwei Liu, Dahua Lin, Chen Change Loy.
Computer Vision and Pattern Recognition (CVPR), 2019

PDF Project Page Code Demo

Hybrid Task Cascade for Instance Segmentation

Kai Chen, Jiangmiao Pang, Jiaqi Wang, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jianping Shi, Wanli Ouyang, Chen Change Loy, Dahua Lin.
Computer Vision and Pattern Recognition (CVPR), 2019 (Winning Entry of COCO 2018 Challenge)

PDF Project Page Code

MMDetection: Open MMLab Detection Toolbox and Benchmark

Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jiarui Xu, Zheng Zhang, Dazhi Cheng, Chenchen Zhu, Tianheng Cheng, Qijie Zhao, Buyu Li, Xin Lu, Rui Zhu, Yue Wu, Jifeng Dai, Jingdong Wang, Jianping Shi, Wanli Ouyang, Chen Change Loy, Dahua Lin.
arXiv Preprint, 2019

PDF Code

Learning to Synthesize Fashion Textures

Wu Shi, Tak-Wai Hui, Ziwei Liu, Dahua Lin, Chen Change Loy.
arXiv Preprint, 2019

PDF

Insights and Approaches using Deep Learning to Classify Wildlife

Zhongqi Miao, Kaitlyn M Gaynor, Jiayun Wang, Ziwei Liu, Oliver Muellerklein, Mohammad S Norouzzadeh, Alex McInturff, Rauri C K Bowie, Ran Nathon, Stella X. Yu, Wayne M. Getz.

Nature - Scientific Reports, 2019

PDF

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo, Xiaogang Wang.
AAAI Conference on Artificial Intelligence (AAAI), 2019 (Oral)

PDF Project Page Code Demo

Instance-level Facial Attributes Transfer with Geometry-Aware Flow

Weidong Yin, Ziwei Liu, Chen Change Loy.
AAAI Conference on Artificial Intelligence (AAAI), 2019 (Spotlight)

PDF Project Page Code

DPatch: An Adversarial Patch Attack on Object Detectors

Xin Liu, Huanrui Yang, Ziwei Liu, Linghao Song, Hai Li, Yiran Chen.
AAAI Workshop on Artificial Intelligence Safety (SafeAI), 2019

PDF Code Demo

Dynamic Graph CNN for Learning on Point Clouds

Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay Sarma, Michael Bronstein, Justin Solomon.
ACM Transactions on Graphics (TOG), 2019
(ICBS Frontiers of Science Award)

PDF Project Page Code

A Comparison of Visual Features used by Humans and Machines to Classify Wildlife

Zhongqi Miao, Kaitlyn M Gaynor, Jiayun Wang, Ziwei Liu, Oliver Muellerklein, Mohammad S Norouzzadeh, Alex McInturff, Rauri C K Bowie, Ran Nathon, Stella X. Yu, Wayne M. Getz.
BiorXiv Preprint, 2018

PDF

Im2Avatar: Colorful 3D Reconstruction from a Single Image

Yongbin Sun, Ziwei Liu, Yue Wang, Sanjay E. Sarma.
arXiv Preprint, 2018

PDF Project Page Dataset Code

Consensus-Driven Propagation in Massive Unlabeled Data for Face Recognition

Xiaohang Zhan, Ziwei Liu, Junjie Yan, Dahua Lin, Chen Change Loy.
European Conference on Computer Vision (ECCV), 2018

PDF Project Page Code

Adaptive Affinity Field for Semantic Segmentation

Tsung-Wei Ke*, Jyh-Jing Hwang*, Ziwei Liu, Stella X. Yu.
European Conference on Computer Vision (ECCV), 2018

PDF Project Page Code

Mix-and-Match Tuning for Self-Supervised Semantic Segmentation

Xiaohang Zhan, Ziwei Liu, Ping Luo, Xiaoou Tang, Chen Change Loy.
AAAI Conference on Artificial Intelligence (AAAI), 2018 (Spotlight)

PDF Project Page Code

Video Frame Synthesis using Deep Voxel Flow

Ziwei Liu, Raymond A. Yeh, Xiaoou Tang, Yiming Liu, Aseem Agarwala.
International Conference on Computer Vision (ICCV), 2017 (Oral)

PDF Project Page Code Product Transfer

Unconstrained Fashion Landmark Detection via Hierarchical Recurrent Transformer Networks

Sijie Yan, Ziwei Liu, Ping Luo, Shi Qiu, Xiaogang Wang, Xiaoou Tang.
ACM Multimedia (ACM MM), 2017 (Full Research Paper)

PDF Project Page Code Demo

Video Object Segmentation with Re-identification

Xiaoxiao Li, Yuankai Qi, Zhe Wang, Kai Chen, Ziwei Liu, Jianping Shi, Ping Luo, Xiaoou Tang, Chen Change Loy.
CVPR Workshop on DAVIS Video Seg. Challenge, 2017 (Winning Entry)

PDF Project Page Code

Not All Pixels Are Equal: Difficulty-Aware Semantic Segmentation via Deep Layer Cascade

Xiaoxiao Li, Ziwei Liu, Ping Luo, Chen Change Loy, Xiaoou Tang.
Computer Vision and Pattern Recognition (CVPR), 2017 (Spotlight)

PDF Project Page Code Demo

Deep Learning Markov Random Field for Semantic Segmentation

Ziwei Liu*, Xiaoxiao Li*, Ping Luo, Chen Change Loy, Xiaoou Tang.
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2017

PDF Project Page

Vision-Based Calibration of Dual RCM-Based Robot Arms in Human-Robot Collaborative Minimally Invasive Surgery

Zerui Wang, Ziwei Liu, Qianli Ma, Alexis Cheng, Yun-hui Liu, Sungmin Kim, Anton Deguet, Austin Reiter, Peter Kazanzides, Russell H. Taylor.
International Conference on Intelligent Robots and Systems (IROS), 2017 IEEE Robotics and Automation Letters (RA-L), 2017

PDF Code

Semantic Facial Expression Editing using Autoencoded Flow

Raymond A. Yeh, Ziwei Liu, Dan B Goldman, Aseem Agarwala.
arXiv Preprint, 2016

PDF Project Page

Fashion Landmark Detection in the Wild

Ziwei Liu*, Sijie Yan*, Ping Luo, Xiaogang Wang, Xiaoou Tang.
European Conference on Computer Vision (ECCV), 2016

PDF Project Page Dataset Code

DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations

Ziwei Liu, Ping Luo, Shi Qiu, Xiaogang Wang, Xiaoou Tang.
Computer Vision and Pattern Recognition (CVPR), 2016

PDF Project Page Dataset Code Demo

Face Model Compression by Distilling Knowledge from Neurons

Ping Luo*, Zhenyao Zhu*, Ziwei Liu, Xiaogang Wang, Xiaoou Tang.
AAAI Conference on Artificial Intelligence (AAAI), 2016 (Oral)

PDF Project Page Code

Semantic Image Segmentation via Deep Parsing Network

Ziwei Liu*, Xiaoxiao Li*, Ping Luo, Chen Change Loy, Xiaoou Tang.
International Conference on Computer Vision (ICCV), 2015 (Oral)

PDF Project Page Demo

Deep Learning Face Attributes in the Wild

Ziwei Liu, Ping Luo, Xiaogang Wang, Xiaoou Tang.
International Conference on Computer Vision (ICCV), 2015
(PAMI Mark Everingham Prize)

PDF Project Page Dataset

Fast Burst Images Denoising

Ziwei Liu, Lu Yuan, Xiaoou Tang, Matt Uyttendaele, Jian Sun.
ACM Transactions on Graphics (SIGGRAPH Asia), 2014 (Oral)

PDF Project Page Dataset Product Transfer