publications

publications by categories in reversed chronological order. generated by jekyll-scholar.

2025

  1. ICLR
    AdaGrad under Anisotropic Smoothness
    Yuxing Liu*Rui Pan*, and Tong Zhang
    ICLR, 2025
  2. ICLR
    Personalized visual instruction tuning
    Renjie Pi, Jianshu Zhang, Tianyang Han, and 3 more authors
    ICLR, 2025

2024

  1. NeurIPS
    lisa.png
    LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
    Rui Pan*, Xiang Liu*, Shizhe Diao, and 4 more authors
    NeurIPS, 2024
  2. NeurIPS
    Image Textualization: An Automatic Framework for Creating Accurate and Detailed Image Descriptions
    Renjie Pi, Jianshu Zhang, Jipeng Zhang, and 3 more authors
    NeurIPS, 2024
  3. ICLR
    Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
    Rui Pan*, Yuxing Liu*, Xiaoyu Wang, and 1 more author
    ICLR, 2024
  4. ECCV
    Strengthening multimodal large language model with bootstrapped preference optimization
    Renjie Pi, Tianyang Han, Wei Xiong, and 4 more authors
    ECCV, 2024
  5. ACL
    Active prompting with chain-of-thought for large language models
    Shizhe Diao, Pengcheng Wang, Yong Lin, and 3 more authors
    ACL, 2024
  6. ACL
    Plum: Prompt Learning using Metaheuristic
    Rui Pan, Shuo Xing, Shizhe Diao, and 6 more authors
    ACL Findings, 2024
  7. EMNLP
    MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance
    Renjie Pi, Tianyang Han, Jianshu Zhang, and 6 more authors
    EMNLP, 2024
  8. EMNLP
    The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs
    Tianyang Han*, Qing Lian*Rui Pan*, and 5 more authors
    EMNLP, 2024
  9. EMNLP
    Theoremllama: Transforming general-purpose llms into lean4 experts
    Ruida Wang, Jipeng Zhang, Yizhen Jia, and 4 more authors
    EMNLP, 2024
  10. EMNLP
    Speciality vs generality: An empirical study on catastrophic forgetting in fine-tuning foundation models
    Yong Lin, Lu Tan, Hangyu Lin, and 8 more authors
    EMNLP, 2024
  11. NAACL
    lmflow.png
    LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
    Shizhe Diao*Rui Pan*, Hanze Dong*, and 4 more authors
    NAACL, 2024

2023

  1. TMLR
    Raft: Reward ranked finetuning for generative foundation model alignment
    Hanze Dong, Wei Xiong, Deepanshu Goyal, and 7 more authors
    TMLR, 2023

2022

  1. ICLR
    eigencurve.gif
    Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objects with Skewed Hessian Spectrums
    Rui Pan*, Haishan Ye*, and Tong Zhang*
    ICLR, 2022