Biography

I am a fourth year PhD student at The Chinese university of Hong Kong, Shenzhen (CUHKSZ), supervised by Prof. Xiao Li. Before that, I obtained my bachelor degree in computer science from CUHKSZ in 2021.

My research interest lies in understanding modern large-scale deep learning models through its empirical behaviors, including the problem modeling, optimization, and generalizaztion. Based on thses insights, my objective is to develop effective, explainable, and applicable model. Recently, my research interests center on the optimization of foundation models.

I am actively looking for collaborations and visiting opportunities. Feel free to reach me if you believe our research background is a good match.

Contact: qijunluo at link.cuhk.edu.cn

I will attend NeurIPS 2024 in Vancouver. Feel free to reach me if your are interested in having a discussion!

Publications and Preprints

• BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models. [OpenReview] [arXiv] [code]
  Advances in Neural Information Processing Systems (NeurIPS), 2024.
  Qijun Luo, Hengxu Yu, Xiao Li.

• Finite-Time Analysis of Fully Decentralized Single-Timescale Actor-Critic. [arXiv] [OpenReview]
  Transactions on Machine Learning Research (TMLR), 2023.
  Qijun Luo, Xiao Li.

• Batch Group Normalization. [arXiv]
  Xiaoyun Zhou, Jiacheng Sun, Nanyang Ye, Xu Lan, Qijun Luo, Bolin Lai, Pedro Esperanca, Guangzhong Yang, Zhenguo Li.

• Relaxed Conditional Image Transfer for Semi-supervised Domain Adaptation. [arXiv]
  Qijun Luo*, Zhili Liu*, Lanqing Hong, Chongxuan Li, Kuo yang, Liyuan Wang, Fengwei Zhou, Guilin Li, Zhenguo Li, Jun Zhu.

Research Experiences

• Microsoft Research Asia. Research Intern, 2024.7–present

• The Chinese University of Hong Kong, Shenzhen. Research Assistant, 2021.1–2021.5

• Huawei Noah’s Ark Lab. Research Intern, 2019.10–2020.9

• Shenzhen Research Institute of Big Data. Research Assistant, 2019.6–2019.8

Awards

• NeurIPS scholar award, 2024.
• Top reviewer @ NeurIPS, 2024
• PhD fellowship, Shenzhen research institute of big data, 2022, 2023.
• Teaching assistant award, school of data science, CUHKSZ, 2023.

Services

• Reviewer: ICLR, ICML, TMLR, AISTATS, SIMODS.

Teaching Experiences

• MDS5210: Machine Learning. Teaching Assistant, 2022 spring & fall, 2023 fall, 2024 fall
• MAT3007: Optimization I. Teaching Assistant, 2021 fall & summer