I’m Xiaolin Hu, pursuing Ph.D. at Gaoling School of Artificial Intelligence , Renmin University of China. I am fortunate to be advised by Prof. Yong Liu. Currently I am a Research Intern at Xiaomi’s AI Lab , where I focus on Edge Large Language Models (LLMs), mentored by Wei Liu and Jian Luan. Previously, I received my B.E. and M.E. degrees in communication and information system from Shanghai University in 2018 and 2021, respectively. Between 2018 and 2021, I collaborated with Prof. Nicholas E. Buris as part of the Intelligent Multi-Input Multi-Output Systems (i-MIMOs) research group. Additionally, I gained research experience as an Intern at the OPPO Research Institute from October 2020 to February 2021, under the mentorship of Xianyue Wu and Tehuang Liu.
I am currently bridging LLMs and personal edge devices. With a long-term goal of contributing to a human-centered application ecosystem based on large models, I am particularly interested in:
(1) Science-Driven LLMs Training: Exploring the scientific principles of LLMs training and fine-tuning.
(2) Personal Edge LLMs Serving: Developing efficient algorithms for LLMs on edge devices to enhance personalized services.
I won the Shanghai University President Scholarship (The highest honor among the scholarships at Shanghai University).
🔥 News
- 2024.9: One paper is accepted by NeurIPS 2025! Enhancing In-Context Learning with just SVD-Based Pruning: A Theoretical Perspective
- 2024.6: Xiaomi Young Scholar Research Program (PI: Yong Liu) received approval, focusing on fine-tuning edge LLMs for personalized services.
- 2024.5: One Paper is accepted by KDD 2025! LLMs may Dominate Information Access
- 2023.12: Started internship at Xiaomi AI Lab, focusing on efficient fine-tuning of edge LLMs.
- 2023.10: Our work on LLMs may Dominate Information Access: Neural Retrievers are Biased Towards LLM-Generated Texts is out!
- 2023.06: Excited to be awarded as Third Prize in the MindSpore Large Language Model Innovation Training Camp.
- 2023.03: Prof. Yong Liu presents our paper on generalization error of gederated leanring at AI TIME [Video].
- 2023.03: I attend the 2023 Workshop on Machine Learning Theory and Foundations, Microsoft Research Asia.
- 2023.03: I Write a blog on statistical learning theory to AI4Science Community. See in AI4Science101 blogs.
- 2023.01: One paper is accepted by ICLR!
📝 Publications
🎙 Generalization
Generalization Bounds for Federated Learning: Fast Rates, Unparticipating Clients and Unbounded Losses
Xiaolin Hu, Shaojie Li, Yong Liu
- This paper provides a theoretical analysis of generalization error of federated learning.
- We assume that the heterogeneous clients are sampled from a meta-distribution. In this framework, we characterize the generalization error for unparticipating clients.
- We further derive convergence bounds for heavy-tail losses.
🧬 AI+Science
A Deep Learning Framework for Solving Rectangular Waveguide Problems
Xiaolin Hu, Nicholas E. Buri, APMC 2020 (Oral) |
- We employ Physics Informed Neural Networks (PINNs) to solve rectangular waveguide problems.
- We successfully apply PINNs to the task of solving electric and magnetic fields, which can be described by partial differential equations (PDEs).
- We also show the applicability of the framework for predicting the unknown parameters such as wavenumber.
-
APMC 2019
Capacity Estimation of MIMO Systems via Support Vector Regression
Xiaolin Hu, Nicholas E. Buri, APMC 2019 (Oral) -
APMC 2020
Multiple Signal DoA Estimation with Unknown Electromagnetic Coupling using Gaussian Process
Qifeng Wang, Nicholas E. Buris, Xiaolin Hu, APMC 2020
🧑🎨 Generative Model
ICIP 2021
3D Grid Transformation Network For Point Cloud Completion
Xiaobao Deng, Xiaolin Hu, Nicholas E. Buris, Ping An, Yilei Chen, ICIP 2021
🚍 Others
- Wavelength-tunable Q-switched fiber laser based on a 45 tilted fiber grating
Xiaolin Hu, Zhijun Yan, Qianqian Huang, Chuanhang Zou, Tianxing Wang, Chengbo Mou, Opto-Electronic Engineering 2018
🎖 Honors and Awards
- 2022.10 First-class Scholarship, Renmin University of China, Beijing, China
- 2021.10 Second-class Scholarship, Renmin University of China, Beijing, China
- 2019.12 Second Prize, China Post-graduate Mathematical Contest in Modeling, China
- 2019.12 Third Prize in Shanghai, China Graduate Electronics Design Contest, Shanghai, China
- 2018.07 Provincial Outstanding Graduates, Shanghai, China. (top 5% of graduating students)
- 2018.07 President Scholarship, Shanghai University. (top 15 of 4900 graduating students)
- 2017.11 First prize in Shanghai, National Undergraduate Electronics Design Contest, Shanghai, China
📖 Educations
- 2021.09 - Present, Ph.D. in Artificial Intelligence, Renmin University of China, Beijing.
- 2018.09 - 2021.07, M.S. in Communication and Information System, Shanghai Univeristy, Shanghai.
- 2014.09 - 2018.07, B.S. in Communication Engineering, Shanghai Univeristy, Shanghai.
💻 Internships
- 2020.10 - 2021.02, OPPO Research Institute, Intelligent Communication Lab, Shanghai.