Publications

2024

1. ToddlerDiffusion: Flash Interpretable Controllable Diffusion Model

   Eslam Mohamed BAKR, Liangbing Zhao, Vincent Tao Hu, Matthieu Cord, Patrick Perez, and Mohamed Elhoseiny

   In Submission, 2024

   Bib PDF

   @inproceedings{ToddlerDiffusion,
     title = {ToddlerDiffusion: Flash Interpretable Controllable Diffusion Model},
     author = {BAKR, Eslam Mohamed and Zhao, Liangbing and Hu, Vincent Tao and Cord, Matthieu and Perez, Patrick and Elhoseiny, Mohamed},
     year = {2024},
     booktitle = {Submission},
   }

2023

1. 

   Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation

   Jacob Schnell, Jieke Wang, Lu Qi, Vincent Tao Hu, and Meng Tang

   In ARXIV, 2023

   Explore diffusion model for data augmention in segmentation task.

   Bib PDF

   @inproceedings{hu_fsinr,
     title = {Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation},
     author = {Schnell, Jacob and Wang, Jieke and Qi, Lu and Hu, Vincent Tao and Tang, Meng},
     year = {2023},
     booktitle = {ARXIV},
   }

2. 

   On the Few-Shot Generalization of Learning on Implicit Neural Representations

   Tao Hu, David W Zhang, Yunlu Chen, Teng Long, Yuki Asano, Pascal Mettes, Efstratios Gavves, Basura Fernando, and Cees G.M. Snoek

   In ICCV NeRF4ADR Workshop, 2023

   Explore few-shot generalization of INR on images.

   Bib

   @inproceedings{hu_fsins,
     title = {On the Few-Shot Generalization of Learning on Implicit Neural Representations},
     author = {Hu, Tao and Zhang, David W and Chen, Yunlu and Long, Teng and Asano, Yuki and Mettes, Pascal and Gavves, Efstratios and Fernando, Basura and Snoek, Cees G.M.},
     year = {2023},
     booktitle = {ICCV NeRF4ADR Workshop},
   }

3. Query by Activity Video in the Wild

   Tao Hu, William Thong, Pascal Mettes, and Cees G.M. Snoek

   In ICIP, 2023

   Few-shot video retrieval.

   Bib PDF Code

   @inproceedings{huvideoretrieval,
     title = {Query by Activity Video in the Wild},
     author = {Hu, Tao and Thong, William and Mettes, Pascal and Snoek, Cees G.M.},
     booktitle = {ICIP},
     year = {2023},
   }

4. 

   Flow Matching for Conditional Text Generation in a Single Sampling Step

   Tao Hu, Di Wu, Yuki M. Asano, Pascal Mettes, Basura Fernando, and Cees G.M. Snoek

   In Submission, 2023

   Flow Matching for text generation

   Bib Website

   @inproceedings{huflowseq,
     title = {Flow Matching for Conditional Text Generation in a Single Sampling Step},
     author = {Hu, Tao and Wu, Di and Asano, Yuki M. and Mettes, Pascal and Fernando, Basura and Snoek, Cees G.M.},
     year = {2023},
     booktitle = {Submission},
   }

5. 

   Latent Space Editing in Transformer-based Flow Matching

   Tao Hu, David W Zhang, Pascal Mettes, Meng Tang, Deli Zhao, and Cees G.M. Snoek

   In ICML 2023 Workshop, New Frontiers in Learning, Control, and Dynamical Systems, 2023

   Bib PDF Code Poster Website

   @inproceedings{hulfm,
     title = {Latent Space Editing in Transformer-based Flow Matching},
     author = {Hu, Tao and Zhang, David W and Mettes, Pascal and Tang, Meng and Zhao, Deli and Snoek, Cees G.M.},
     year = {2023},
     booktitle = {ICML 2023 Workshop, New Frontiers in Learning, Control, and Dynamical Systems},
   }

6. 

   Self-Guided Diffusion Models

   Tao Hu*, David W Zhang*, Yuki M. Asano, Gertjan J. Burghouts, and Cees G.M. Snoek

   In CVPR, 2023

   A bridge between the community of self-supervised learning and diffusion models. Short version to appear in NeurIPS 2022 Workshop on Score-Based Methods and NeurIPS 2022 Workshop Self-Supervised Learning Theory and Practice.

   Bib PDF Code Website

   @inproceedings{hu2022selfguided,
     title = {Self-Guided Diffusion Models},
     author = {Hu*, Tao and Zhang*, David W and Asano, Yuki M. and Burghouts, Gertjan J. and Snoek, Cees G.M.},
     year = {2023},
     booktitle = {CVPR},
                      NeurIPS 2022 Workshop Self-Supervised Learning Theory and Practice.},
   }

2021

1. 

   Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting

   Martine Toering, Ioannis Gatopoulos, Maarten Stol, and Tao Hu

   In WACV, 2021

   Improve video representation by constrasting Prototypical features.

   Bib PDF Code

   @inproceedings{toering2022self,
     title = {Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting},
     author = {Toering, Martine and Gatopoulos, Ioannis and Stol, Maarten and Hu, Tao},
     booktitle = {WACV},
     year = {2021},
   }

2020

1. 

   Localizing the Common Action Among a Few Videos

   Pengwan Yang*, Tao Hu*, Pascal Mettes, and Cees G.M. Snoek

   In European Conference on Computer Vision(ECCV), 2020

   Localizing the temporal extent of an action in a long untrimmed video by attention techniques.

   Bib PDF Code

   @inproceedings{YangECCV20,
     author = {Yang*, Pengwan and Hu*, Tao and Mettes, Pascal and Snoek, Cees G.M.},
     title = {Localizing the Common Action Among a Few Videos},
     booktitle = {European Conference on Computer Vision(ECCV)},
     year = {2020},
   }

2. 

   Pointmixup: Augmentation for point clouds

   Yunlu Chen*, Tao Hu*, Efstratios Gavves, Thomas Mensink, Pascal Mettes, Pengwan Yang, and Cees G.M. Snoek

   In European Conference on Computer Vision(ECCV), 2020

   A simple augmentation method based on MixUp to boost the performance on related tasks of point cloud.

   Bib PDF Code Spotlight

   @inproceedings{chen2020pointmixup,
     title = {Pointmixup: Augmentation for point clouds},
     author = {Chen*, Yunlu and Hu*, Tao and Gavves, Efstratios and Mensink, Thomas and Mettes, Pascal and Yang, Pengwan and Snoek, Cees G.M.},
     booktitle = {European Conference on Computer Vision(ECCV)},
     highlight = {Spotlight},
     year = {2020},
   }

3. Interactivity proposals for surveillance videos

   Shuo Chen, Pascal Mettes, Tao Hu, and Cees G.M. Snoek

   In International Conference on Multimedia Retrieval(ICMR), 2020

   Bib PDF Code Oral

   @inproceedings{chen2020interactivity,
     title = {Interactivity proposals for surveillance videos},
     author = {Chen, Shuo and Mettes, Pascal and Hu, Tao and Snoek, Cees G.M.},
     booktitle = {International Conference on Multimedia Retrieval(ICMR)},
     highlight = {Oral},
     year = {2020},
   }

2019

1. 

   Attention-based Multi-Context Guiding for Few-Shot Semantic Segmentation

   Tao Hu, Pengwan Yang, Chiliang Zhang, Gang Yu, Yadong Mu, and Cees G.M. Snoek

   In AAAI, 2019

   Solve the few-shot segmentation problem by applying attention in multi-scales.

   Bib PDF Code Poster Spotlight

   @inproceedings{tao2018fss,
     title = {Attention-based Multi-Context Guiding for Few-Shot Semantic Segmentation},
     author = {Hu, Tao and Yang, Pengwan and Zhang, Chiliang and Yu, Gang and Mu, Yadong and Snoek, Cees G.M.},
     booktitle = {AAAI},
     highlight = {Spotlight},
     year = {2019},
   }

2. 

   SILCO: Show a Few Images, Localize the Common Object

   Tao Hu, Pascal Mettes, Jia-Hong Huang, and Cees G.M. Snoek

   In International Conference on Computer Vision(ICCV), 2019

   Design a graph network and apply attention on them to solve the problem of common object localization.

   Bib PDF Code Poster Website

   @inproceedings{silco2019,
     title = {SILCO: Show a Few Images, Localize the Common Object},
     author = {Hu, Tao and Mettes, Pascal and Huang, Jia-Hong and Snoek, Cees G.M.},
     booktitle = {International Conference on Computer Vision(ICCV)},
     year = {2019},
   }

2018

1. Dense In Dense: Training Segmentation from Scratch

   Tao Hu

   In Asian Conference on Computer Vision(ACCV), 2018

   Bib

   @inproceedings{hu2018dense,
     title = {Dense In Dense: Training Segmentation from Scratch},
     author = {Hu, Tao},
     booktitle = {Asian Conference on Computer Vision(ACCV)},
     year = {2018},
   }

2. Sobel heuristic kernel for aerial semantic segmentation

   Tao Hu, Yao Wang, Yisong Chen, Peng Lu, and Heng Wang

   In IEEE International Conference on Image Processing (ICIP), 2018

   Bib

   @inproceedings{hu2018sobel,
     title = {Sobel heuristic kernel for aerial semantic segmentation},
     author = {Hu, Tao and Wang, Yao and Chen, Yisong and Lu, Peng and Wang, Heng},
     booktitle = {IEEE International Conference on Image Processing (ICIP)},
     year = {2018},
   }

3. Accelerating convolutional neural networks with dynamic channel pruning

   Chiliang Zhang, Tao Hu, Yingda Guan, and Zuochang Ye

   In Data Compression Conference (DCC), 2018

   Bib

   @inproceedings{chiliang2019accelerating,
     title = {Accelerating convolutional neural networks with dynamic channel pruning},
     author = {Zhang, Chiliang and Hu, Tao and Guan, Yingda and Ye, Zuochang},
     booktitle = {Data Compression Conference (DCC)},
     year = {2018},
   }