I am currently a Research Fellow at the School of Computing - National University of Singapore (NUS), working with Professor Leong Tze Yun. My research interests include causal inference, causal discovery, reinforcement learning, and point processes.

I completed my PhD in computer science at the NUS on problems related to causal inference from observational data. I was advised by Professor Leong Tze Yun.

News

19 Sep 2025Our paper 'Centralized Reward Agent for Knowledge Sharing and Transfer in Multi-Task Reinforcement Learning' was just accepted to NeurIPS 2025.
14 Jun 2025Our paper 'Federated Causal Inference from Observational Data' was just accepted to Machine Learning.
01 May 2025Our paper 'Catching Two Birds with One Stone: Reward Shaping with Dual Random Networks for Balancing Exploration and Exploitation' was just accepted to ICML 2025.
23 Jan 2025Our paper 'Highly Efficient Self-Adaptive Reward Shaping for Reinforcement Learning' was just accepted to ICLR 2025.

Selected publications

  1. Centralized Reward Agent for Knowledge Sharing and Transfer in Multi-Task Reinforcement Learning.
    Haozhe Ma, Zhengding Luo, Thanh Vinh Vo, Kuankuan Sima, Tze-Yun Leong.
    39th Conference on Neural Information Processing Systems (NeurIPS), 2025.
    [PDF]
  2. Federated Causal Inference from Observational Data.
    Thanh Vinh Vo, Young Lee, Tze-Yun Leong.
    Machine Learning, Springer, 2025.
    [ArXiv] [PDF]
  3. Catching Two Birds with One Stone: Reward Shaping with Dual Random Networks for Balancing Exploration and Exploitation.
    Haozhe Ma, Fangling Li, Jing Yu Lim, Zhengding Luo, Thanh Vinh Vo, Tze-Yun Leong.
    42nd International Conference on Machine Learning (ICML), 2025.
    [PDF] [OpenReview]
  4. Highly Efficient Self-Adaptive Reward Shaping for Reinforcement Learning.
    Haozhe Ma, Zhengding Luo, Thanh Vinh Vo, Kuankuan Sima, Tze-Yun Leong.
    International Conference on Learning Representations (ICLR), 2025.
    [PDF] [OpenReview]
  5. Reward Shaping for Reinforcement Learning with An Assistant Reward Agent.
    Haozhe Ma, Kuankuan Sima, Thanh Vinh Vo, Di Fu, Tze-Yun Leong.
    41st International Conference on Machine Learning (ICML), 2024.
    [PDF] [OpenReview]
  6. Decoupled Prompt-Adapter Tuning for Continual Activity Recognition.
    Di Fu, Thanh Vinh Vo, Haozhe Ma, Tze-Yun Leong.
    Conference on Lifelong Learning Agents (CoLLAs), 2024.
    [PDF]
  7. Mixed-Initiative Bayesian Sub-Goal Optimization in Hierarchical Reinforcement Learning.
    Haozhe Ma, Thanh Vinh Vo, Tze-Yun Leong.
    23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2024.
    (full paper)
    [PDF]
  8. Hierarchical Reinforcement Learning with Human-AI Collaborative Sub-Goals Optimization.
    Haozhe Ma, Thanh Vinh Vo, Tze-Yun Leong.
    22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2023.
    (extended abstract)
    [PDF]
  9. An Adaptive Kernel Approach to Federated Learning of Heterogeneous Causal Effects.
    Thanh Vinh Vo, Arnab Bhattacharyya, Young Lee, Tze-Yun Leong.
    36th Conference on Neural Information Processing Systems (NeurIPS), 2022.
    [PDF] [OpenReview] [Supplementary] [Slides] [Poster] [Code]
  10. Bayesian Federated Estimation of Causal Effects from Observational Data.
    Thanh Vinh Vo, Young Lee, Trong Nghia Hoang, Tze-Yun Leong.
    38th Conference on Uncertainty in Artificial Intelligence (UAI), 2022.
    [PDF] [OpenReview] [Supplementary] [Code]
  11. Adaptive Multi-Source Causal Inference from Observational Data.
    Thanh Vinh Vo, Pengfei Wei, Trong Nghia Hoang, Tze-Yun Leong.
    31st ACM International Conference on Information and Knowledge Management (CIKM), 2022.
    (full paper track)
    [PDF] [Slides] [Code]
  12. Transfer Kernel Learning for Multi-source Transfer Regression.
    Pengfei Wei, Thanh Vinh Vo, Xinghua Qu, Yew Soon Ong, Zejun Ma.
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
    [PDF]
  13. Causal Modeling with Stochastic Confounders.
    Thanh Vinh Vo, Pengfei Wei, Wicher Bergsma, Tze-Yun Leong.
    24th International Conference on Artificial Intelligence and Statistics (AISTATS), 2021.
    [PDF] [Supplementary] [Code]
  14. Z-Transforms and its Inference on Partially Observable Point Processes.
    Young Lee, Thanh Vinh Vo, Kar Wai Lim, Harold Soh.
    27th International Joint Conference on Artificial Intelligence (IJCAI), 2018.
    [PDF]

Preprints and work in progress

  1. Causal Policy Learning in Reinforcement Learning: Backdoor-Adjusted Soft Actor-Critic.
    Thanh Vinh Vo, Young Lee, Haozhe Ma, Chien Lu, Tze-Yun Leong.
  2. A Distribution Over DAGs for Uncertain Causal Discovery.
    Thanh Vinh Vo, Young Lee, Arnab Bhattacharyya, Tze-Yun Leong.

Academic Services

  • Area Chair:
    • ICLR 2027
    • ICML 2027
  • Conference reviewer/PC member:
    • NeurIPS 2023, 2025, 2026
    • ICLR 2024, 2025, 2026
    • UAI 2023, 2024, 2025, 2026
    • AAAI 2023, 2024, 2025, 2026, 2027
    • AISTATS 2022, 2023, 2024, 2025, 2026, 2027
    • IJCAI 2024, 2025, 2026
    • AAMAS 2025
    • KDD 2024, 2025, 2026, 2027
    • ECAI 2025
  • Journal reviewer:
    • Neurocomputing
    • Neural Networks
    • Data Mining and Knowledge Discovery
    • Knowledge-Based Systems
    • Expert Systems with Applications
    • ACM Transactions on Intelligent Systems and Technology
    • Computers & Industrial Engineering