Focused on introducing inductive bias into neural network to achieve data-efficiency by few-shot learning, generative model, etc.
Have a conviction that generative modelling will be the future of discriminative modelling.
I'm on the job market. Feel free to contact me. [AIGC expert]
|
News:
[May. 2023] A paper about the flow matching is submitted, thanks to my coorporators~
[Apr. 2023] Co-supervise new master students: Junjie Xu(Umich), Zeqiu Yu(Northwestern Uni) with Meng Tang from UCMerced, welcome on board!
[Apr. 2023] I am selected for CVPR 2023 Doctoral Consortium. Here is the Summary of my PhD Research.
[March. 2023] One CVPR 2023 and New Blog: Flow Matching: Make CNF great again or diffusion model++?
[Jan. 2023] Committee members confirmed: Theo Gevers, Marcel Worring, Efstratios Gavves, Bernard Ghanem, Tim Salimans
[Oct. 2022] "Self-Guided Diffusion Models" was accepted by two NeurIPS 2022 workshops.
[Dec. 2021] My mentee Martine Toering's Master Thesis won the ADS Thesis Awards.
Publications
(Full Publication), * Equal contribution
 |
|
A paper about Flow Matching
In submission.
Project
|
Code
|
 |
|
Self-Guided Diffusion Models
Vincent Tao Hu*,David W Zhang*, Yuki M. Asano, Gertjan J. Burghouts, Cees G. M. Snoek
CVPR 2023, NeurIPS 2022 SSL and SBM workshops.
A bridge between the community of self-supervised learning and diffusion models.
Paper
|
Project
|
Code(Coming soon)
|
Bibtex |
@inproceedings{hu2022selfguided,
title={Self-Guided Diffusion Models},
author={Vincent Tao Hu and David W Zhang and Yuki M. Asano and Gertjan J. Burghouts and Cees G. M. Snoek},
year={2023},
booktitle={CVPR}
}
 |
|
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting
Martine Toering, Ioannis Gatopoulos, Maarten Stol, Vincent Tao Hu
WACV 2022
Improve video representation by constrasting Prototypical features.
Paper|Code |
Bibtex |
@inproceedings{toering2022self,
title={Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting},
author={Toering, Martine and Gatopoulos, Ioannis and Stol, Maarten and Hu, Vincent Tao},
booktitle={Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
pages={108--118},
year={2022}
}
 |
|
PointMixup: Augmentation for Point Clouds
Yunlu Chen*, Vincent Tao Hu*,Efstratios Gavves, Thomas Mensink, Pascal Mettes, Pengwan Yang, Cees G. M. Snoek
ECCV 2020,Spotlight
A simple augmentation method based on MixUp to boost the performance on related tasks of point cloud.
Paper|Code |
Bibtex |
@INPROCEEDINGS{ChenECCV20,
author = {Yunlu Chen and Vincent Tao Hu and Efstratios Gavves and Thomas Mensink and Pascal Mettes and Pengwan Yang and Cees G. M. Snoek},
title = {PointMixup: Augmentation for Point Clouds},
booktitle = {European Conference on Computer Vision},
month = {August},
year = {2020},
address = {Glasgow, UK},
pdf = {},
note = {Spotlight presentation, top 5%},
abstract = { }
}
 |
|
Localizing the Common Action Among a Few Videos
Pengwan Yang*, Vincent Tao Hu*, Pascal Mettes, Cees G. M. Snoek
ECCV 2020
Localizing the temporal extent of an action in a long untrimmed video by attention techniques.
Paper| Code |
Bibtex |
@INPROCEEDINGS{YangECCV20,
author = {Pengwan Yang and Vincent Tao Hu and Pascal Mettes and Cees G. M. Snoek},
title = {Localizing the Common Action Among a Few Videos},
booktitle = {European Conference on Computer Vision},
month = {August},
year = {2020},
address = {Glasgow, UK},
pdf = {},
abstract = { }
}
 |
|
SILCO: Show a Few Images, Localize the Common Object
Tao Hu, Pascal Mettes, Jia-Hong Huang, Cees G. M. Snoek
ICCV 2019
Design a graph network and apply attention on them to solve the problem of common object localization.
Project |
Paper |
Code |
Poster |
Bibtex |
@article{silco2019,
title={SILCO: Show a Few Images, Localize the Common Object},
author={Tao HU and Pascal Mettes and Jia-Hong Huang and Cees Snoek},
booktitle=ICCV,
year={2019}
}
 |
|
Attention-based Multi-Context Guiding for Few-Shot Semantic Segmentation
Tao Hu, Pengwan Yang, Chiliang Zhang, Gang Yu, Yadong Mu, Cees G.M. Snoek
AAAI 2019,Spotlight
Solve the few-shot segmentation problem by applying attention in multi-scales.
Paper |
Supp |
Poster |
Code |
Bibtex |
@article{tao2018fss,
title={Attention-based Multi-Context Guiding for Few-Shot Semantic Segmentation},
author={Tao HU and Pengwan Yang and Chiliang Zhang and Gang Yu and Yadong Mu and Cees Snoek},
booktitle=AAAI,
year={2019}
}
 |
|
Query by Activity Video in the Wild
Tao Hu, William Thong, Pascal Mettes, Cees G.M. Snoek
draft
Few-shot video retrieval.
Paper |
Code
Bibtex |
@article{huvideoretrieval,
title={Query by Activity Video in the Wild},
author={Tao Hu, William Thong, Pascal Mettes, Cees G.M. Snoek},
booktitle=WIP,
year={2019}
}
Academic Activities
Reviewer for CVPR 20/21/22/23, ECCV20/22, ICLR22/23, NeurIPS22, AAAI-23 Program Committee Member, BMVC21/22/23, WACV21/22/23, ICRA, TMM, ACCV, etc.
Teaching Assistant for deep learning course(2019/20) with Efstratios Gavves in University of Amsterdam.
Sicily Summer School 2019, Gran Canaria summer school 2021
Supervision
Andrea Rigo(M.S.),2022=>Depth-aware generative modeling
Master Thesis(2022)
Martine Toering(M.S.),2021=>Self-supervised Video Representation Learningwith Cross-Stream Prototypical Contrasting
Master Thesis(2021)
Hinrik Snær(M.S.),2021=>Improvement in efficiency for automated quality control for fish processing using semantic segmentation
Master Thesis(2020)
Martine Toering(B.A.),2019=>Video Classification from scratch
Bachelor Thesis(2019)
Paulien Rouwendaal(M.S.),2019=>Full and point supervised learning strategies for table cell detection
Master Thesis(2019)
Misc
Youtube(For Fun): Vincent Talk
Template is borrowed from Yan-Jun Zhu.
.