Jun Zhang
 |
Associate Professor, IEEE Fellow Distinguished Lecturer, IEEE Communications Society Office: Room 2430 |
What's new
(Student Awards) Congratulations to Yuanfang, Yufei, Yuchang, Xinyu, Ruiqi, and Jiawei!
(Aug 2024) Yuanfang received the Hong Kong PhD Fellowship.
(July 2024) Yuanfang and Yufei received the HKUST RedBird PhD Award.
(July 2024) Yuchang received the HKUST RedBird Academic Excellence Award for Continuing PhD Students.
(May 2024) Yuchang and Xinyu passed their thesis exams. Congratulations, Dr. Sun and Dr. Bian!
(May 2024) Ruiqi received the Hong Kong PhD Fellowship.
(March 2024) Jiawei received the School of Engineering (SENG) PhD Research Excellence Award 2023-24! [SENG News]
(INFOCOM 25) “WRF-GS: Wireless radiation field reconstruction with 3D Gaussian splatting,” accepted by INFOCOM 2025. [Paper] [Code]
(AAAI 25) Two papers accepted by AAAI 2025.
(DimensionX) “DimensionX: Create any 3D and 4D scenes from a single image with controllable video diffusion,” preprint. [Paper] [Code] [Project Page]
(ReconX) “ReconX: Reconstruct any scene from sparse views with video diffusion model,” preprint. [Paper] [Code] [Project Page]
(HarmoniCa) “HarmoniCa: Harmonizing training and inference for better feature cache in diffusion transformer acceleration,” preprint. [Paper]
(MEGA) “MEGA: Memory-efficient 4D Gaussian splatting for dynamic scenes,” preprint. [Paper]
(GI-GS) “GI-GS: Global illumination decomposition on Gaussian splatting for inverse rendering,” preprint. [Paper] [Project Page]
(EVA-Gaussian) “EVA-Gaussian: 3D Gaussian-based real-time human novel view synthesis under diverse camera settings,” preprint. [Paper] [Project Page]
(NeurIPS 24) Two papers accepted to NeurIPS 2024.
(ECCV 24) Two papers accepted to ECCV 2024.
(ICML 24) “Individual contributions as intrinsic exploration scaffolds for multi-agent reinforcement learning”, accepted by ICML 2024. [Paper] [Code]
(CVPR 24) Three papers accepted to CVPR 2024.
(Nature Communications) Paper “Selective knowledge sharing for privacy-preserving federated distillation without a good teacher” was accepted by Nature Communications. [Paper]
Research Interests
Generative AI, Foundation Models
Neural Data Representation and Compression
Reinforcement Learning
Safe and Trustworthy AI
O-RAN, Edge AI Systems
 |
Our Group WeChat Account (in Chineses) |
Selected Publications
GenAI, Foundation Models, and Applications
W. Sun, S. Chen, F. Liu, Z. Chen, Y. Duan, J. Zhang, and Y. Wang, “DimensionX: Create any 3D and 4D scenes from a single image with controllable video diffusion,” preprint. [Paper] [Code] [Project Page]
Y. Huang, Z. Wang, R. Gong, J. Liu, X. Zhang, J. Guo, X. Liu, and J. Zhang, “HarmoniCa: Harmonizing training and inference for better feature cache in diffusion transformer acceleration,” preprint. [Paper]
F. Liu*, W. Sun*, H. Wang*, Y. Wang, H. Chen, J. Ye, J. Zhang, and Y. Duan, “ReconX: Reconstruct any scene from sparse views with video diffusion model,” preprint. (* equal contribution) [Paper] [Code] [Project Page]
S. Gao, J. Yang, L. Chen, K. Chitta, Y. Qiu, A. Geiger, J. Zhang, and H. Li, “Vista: A generalizable driving world model with high fidelity and versatile controllability,” Advances in neural information processing systems (NeurIPS), Vancouver, Canada, Dec. 2024. [Paper] [Code] [Demo] (Acceptance Rate: 25.8%)
J. Yang*, S. Gao*, Y. Qiu*, L. Chen, T. Li, B. Dai, K. Chitta, P. Wu, J. Zeng, J. Zhang, A. Geiger, Y. Qiao, and H. Li, “Generalized predictive model for autonomous driving,” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, USA, Jun. 2024. (* equal contribution) (Acceptance Rate: 23.6%) (Highlight, Top 2.8%) [Paper]
J. Tong, J. Shao, Q. Wu, W. Guo, Z. Li, Z. Lin, and J. Zhang, “WirelessAgent: Large language model agents for intelligent wireless networks,” submitted. [Paper]
J. Shao, J. Tong, Q. Wu, W. Guo, Z. Li, Z. Lin, and Jun Zhang, “WirelessLLM: Empowering large language models towards wireless intelligence,” Journal of Communications and Information Networks, vol. 9, no. 2, pp. 99-112, June 2024. [Paper]
Neural Data Representation and Compression
Z. Liu, Y. Hu, X. Zhang, J. Shao, Z. Lin, and J. Zhang, “Dynamics-aware Gaussian splatting streaming towards fast on-the-fly training for 4D reconstruction,” preprint. [Paper] [Project Page]
X. Zhang, Z. Liu, Y. Zhang, X. Ge, D. He, T. Xu, Y. Wang, Z. Lin, S. Yan, and J. Zhang, “MEGA: Memory-efficient 4D Gaussian splatting for dynamic scenes,” preprint. [Paper]
H. Chen, Z. Lin, and J. Zhang, “GI-GS: Global illumination decomposition on Gaussian splatting for inverse rendering,” preprint. [Paper] [Project Page]
Y. Hu, Z. Liu, J. Shao, Z. Lin, and J. Zhang, “EVA-Gaussian: 3D Gaussian-based real-time human novel view synthesis under diverse camera settings,” preprint. [Paper] [Project Page]
X. Zhang*, X. Ge*, T. Xu, D. He, Y. Wang, H. Qin, G. Lu, J. Geng, and J. Zhang, “GaussianImage: 1000 FPS image representation and compression by 2D Gaussian splatting,” European Conference on Computer Vision (ECCV), Milano, Italy, Sept.-Oct. 2024. (* equal contribution) (Acceptance Rate: 27.9%) [Paper] [Code]
X. Zhang, R. Yang, D. He, X. Ge, T. Xu, Y. Wang, H. Qin, and J. Zhang, “Boosting neural representations for videos with a conditional decoder,” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, USA, Jun. 2024. (Acceptance Rate: 23.6%) (Highlight, Top 2.8%) [Paper] [Code]
X. Zhang, J. Shao, and J. Zhang, “LDMIC: Learning-based distributed multi-view image coding,” International Conference on Learning Representations (ICLR), Kigali, Rwanda, May 2023. [Paper] [GitHub]
Reinforcement Learning
X. Li, L. Pan, and J. Zhang, “Kaleidoscope: Learnable masks for heterogeneous multi-agent reinforcement learning,” Advances in neural information processing systems (NeurIPS), Vancouver, Canada, Dec. 2024. (Acceptance Rate: 25.8%) [Paper] [Code]
X. Li, Z. Liu, S. Chen, and J. Zhang, “Individual contributions as intrinsic exploration scaffolds for multi-agent reinforcement learning,” International Conference on Machine Learning (ICML), Vienna, Austria, July 2024. (Acceptance Rate: 27.5%) [Paper] [Code] [Video]
X. Li, J. Zhang, “Context-aware communication for multi-agent reinforcement learning,” International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Auckland, New Zealand, May 2024. (Acceptance Rate: 25%) [Paper]
X. Wang*, X. Li*, J. Shao, and J. Zhang, “AC2C: Adaptively controlled two-hop communication for multi-agent reinforcement learning,” International Conference on Autonomous Agents and Multiagent Systems (AAMAS), London, United Kingdom, May-June 2023. (Acceptance Rate: 23.3%) (* equal contribution) [Paper]
Safe/Trustworthy AI
Y. Sun, X. Li, T. Lin, and J. Zhang, “Learn how to query from unlabeled data streams in federated learning,” Pro. AAAI Conference on Artificial Intelligence, Philadelphia, Pennsylvania, USA, Feb.-Mar. 2025. (Acceptance Rate: 23.4%) [Paper]
J. Shao, F. Wu, and J. Zhang, “Selective knowledge sharing for privacy-preserving federated distillation without a good teacher,” Nature Communications, Jan 2024. [Paper]
Y. Sun, Y. Mao, and J. Zhang, “MimiC: Combating client dropouts in federated learning by mimicking central updates,” IEEE Trans. Mobile Computing, vol. 23, no. 7, pp. 7572-7584, July 2024. [Paper]
T. Zhou, J. Zhang, and D. Tsang, “FedFA: Federated learning with feature anchors to align feature and classifier for heterogeneous data,” IEEE Trans. Mobile Computing, vol. 23, no. 6, pp. 6731-6742, June 2024. [Paper] [Code]
B. Li*, Y. Shen*, J. Yang, Y. Wang, J. Ren, T. Che, J. Zhang, and Z. Liu, “Sparse Mixture-of-Experts are Domain Generalizable Learners,” International Conference on Learning Representations (ICLR), Kigali, Rwanda, May 2023. (Oral presentation) [Paper] [GitHub]
J. Shao, Y. Sun, S. Li, and J. Zhang, “DReS-FL: Dropout-resilient secure federated learning for non-IID clients via secret data sharing,” NeurIPS 2022. [Paper] (Acceptance Rate: 25.6%)
O-RAN, Edge AI
B. Liu, J. Tong, and J. Zhang, “LLM-Slice: Dedicated wireless network slicing for large language models,” The 22nd ACM Conference on Embedded Networked Sensor Systems - Posters and Demos, Hangzhou, China, Nov. 2024. [Paper]
Y. Mao, X. Yu, K. Huang, A.-Y. Zhang, and J. Zhang, “Green edge AI: A contemporary survey,” Proc. IEEE, vol. 112, no. 7, pp. 880-911, July 2024. [Paper]
J. Shao, X. Zhang, and J. Zhang, “Task-oriented communication for edge video analytics,” IEEE Trans. Wireless Commun., vol. 23, no. 5, pp. 4141-4154, May 2024. [Paper] [GitHub]
J. Shao, Y. Mao, and J. Zhang, “Task-oriented communication for multidevice cooperative edge inference,” IEEE Trans. Wireless Commun., vol. 11, no. 1, pp. 73-87, Jan. 2023. [Paper]
J. Shao, Y. Mao, and J. Zhang, “Learning task-oriented communication for edge inference: An information bottleneck approach,” IEEE J. Select. Areas Commun, vol. 40, no. 1, pp. 197-211, Jan. 2022. [Paper] [GitHub]
J. Zhang and K. B. Letaief, “Mobile edge intelligence and computing for the Internet of vehicles,” Proc. IEEE, vol. 108, no. 2, pp. 246–261, Feb. 2020. [Paper]
Integrated AI and Communications
C. Wen, J. Tong, Z. Lin, and J. Zhang, “WRF-GS: Wireless radiation field reconstruction with 3D Gaussian splatting,” Proc. IEEE INFOCOM, London, United Kingdom, May 2025. (Acceptance Rate: 18.7%) [Paper] [Code]
W. Yu, H. He, X. Yu, S. Song, J. Zhang, R. D. Murch, and K. B. Letaief, “Bayes-optimal unsupervised learning for channel estimation in near-field holographic MIMO,” IEEE J. Sel. Topics Signal Process., vol. 18, no. 4, pp. 714-729, July 2024. [Paper]
W. Yu, Y. Shen, H. He, X. Yu, S.H. Song, J. Zhang, and K. B. Letaief, “An adaptive and robust deep learning framework for THz ultra-massive MIMO channel estimation,” IEEE J. Sel. Topics Signal Process., vol. 17, no. 4, pp. 761-776, July 2023. [Paper] [GitHub]
Y. Shen, J. Zhang, S.H. Song, and K. B. Letaief, “Graph neural networks for wireless communications: From theory to practice,” IEEE Trans. Wireless Commun., vol. 22, no. 5, pp. 3554-3569, May 2023. [Paper] [GitHub]
Y. Shen, Y. Shi, J. Zhang, and K. B. Letaief, “Graph neural networks for scalable radio resource management: architecture design and theoretical analysis,” IEEE J. Select. Areas Commun, vol. 39, no. 1, pp. 101–115, Jan. 2021. [Paper]