Jie Liu (刘杰)
jieliu [at] link [dot] cuhk [dot] edu [dot] hk

Selected Publications

1. Arxiv

   Improving Video Generation with Human Feedback

   Jie Liu*, Gongye Liu*, Jiajun Liang, Ziyang Yuan, Xiaokun Liu, Mingwu Zheng, Xiele Wu, Qiulin Wang, Wenyu Qin, Menghan Xia, Xintao Wang, Xiaohong Liu, Fei Yang, Pengfei Wan, Di Zhang, Kun Gai, Yujiu Yang, Wanli Ouyang

   Arxiv, 2024

   PDF CODE MODEL Dataset
2. Arxiv

   Iterative Length-Regularized Direct Preference Optimization: A Case Study on Improving 7B Language Models to GPT-4 Level

   Jie Liu*, Zhanhui Zhou*, Jiaheng Liu, Xingyuan Bu, Chao Yang, Han-Sen Zhong, Wanli Ouyang

   Arxiv, 2024

   PDF
3. NeurIPS

   Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models

   Zhanhui Zhou, Zhixuan Liu, Jie Liu, Zhichen Dong, Chao Yang, Yu Qiao

   Neural Information Processing Systems (NeurIPS), 2024

   PDF CODE
4. NN

   Adaptive pessimism via target Q-value for offline reinforcement learning

   Jie Liu*, Yinmin Zhang*, Chuming Li, Yaodong Yang, Yu Liu, Wanli Ouyang

   Neural Networks, 2024

   PDF
5. ACL

   Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization

   Zhanhui Zhou*, Jie Liu*, Chao Yang, Jing Shao, Yu Liu, Xiangyu Yue, Wanli Ouyang, Yu Qiao

   Findings of Association for Computational Linguistics (ACL), 2024

   PDF CODE
6. ACL

   MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues

   Ge Bai*, Jie Liu*, Xingyuan Bu, Yancheng He, Jiaheng Liu, Zhanhui Zhou, Zhuoran Lin, Wenbo Su, Tiezheng Ge, Bo Zheng, Wanli Ouyang

   Association for Computational Linguistics (ACL), 2024

   PDF CODE
7. ACL

   ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models

   Yanan Wu*, Jie Liu*, Xingyuan Bu, Jiaheng Liu, Zhanhui Zhou, Yuanxing Zhang, Chenchen Zhang, Zhiqi Bai, Haibin Chen, Tiezheng Ge, Wanli Ouyang, Wenbo Su, Bo Zheng

   Findings of Association for Computational Linguistics (ACL), 2024

   PDF CODE
8. ACL

   Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!

   Zhanhui Zhou, Jie Liu, Zhichen Dong, Jiaheng Liu, Chao Yang, Wanli Ouyang, Yu Qiao

   Association for Computational Linguistics (ACL), 2024, 🏆Outstanding Paper Award (< 1% of submission)

   PDF CODE
9. AAAI

   A Perspective of Q-value Estimation on Offline-to-Online Reinforcement Learning

   Yinmin Zhang*, Jie Liu*, Chuming Li* , Yazhe Niu, Yaodong Yang, Yu Liu, Wanli Ouyang

   Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024

   PDF Code
10. TMLR

    Masked Pretraining for Multi-Agent Decision Making

    Jie Liu*, Yinmin Zhang*, Chuming Li, Chao Yang, Yaodong Yang, Yu Liu, Wanli Ouyang

    Transactions on Machine Learning Research, 2024

    PDF
11. RSS

    Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors

    Letian Wang, Jie Liu, Hao Shao, Wenshuo Wang, Ruobing Chen, Yu Liu, Steven L Waslander

    Robotics: Science and Systems (RSS), 2023

    PDF Code Video
12. AAAI

    ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency

    Chuming Li*, Jie Liu*, Yinmin Zhang, Yuhong Wei, Yazhe Niu, Yaodong Yang, Yu Liu, Wanli Ouyang

    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2023

    PDF Code
13. ECAI

    Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning

    Chuming Li, Ruonan Jia, Jie Liu, Yinmin Zhang, Yazhe Niu, Yaodong Yang, Yu Liu, Wanli Ouyang

    Proceedings of the European Conference on Artificial Intelligence (ECAI), 2023

    PDF
14. CVPR Oral

    Inception convolution with efficient dilation search

    Jie Liu*, Chuming Li*, Feng Liang, Chen Lin, Ming Sun, Junjie Yan, Wanli Ouyang, Dong Xu

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021, Oral (< 4% of submission)

    PDF Code
15. Arxiv

    Adaptive Gradient Method with Resilience and Momentum

    Jie Liu, Chen Lin, Chuming Li, Lu Sheng, Ming Sun, Junjie Yan, Wanli Ouyang

    Arxiv, 2020

    PDF