Skip to content
@LCM-Lab

LCM-Lab

Towards an unbounded context for foundation models

Hi there 👋

This is LCM-Lab, an open-source research team within the OpenNLG Group that focuses on long sequence modeling and optimization. Below is a list of our work—please feel free to explore!

If you have any questions about the code or paper details, please don’t hesitate to open an issue or contact this email zecheng.tang@foxmail.com.


🔹 Long Sequence Reward

  • LongRM: Pushing the limits of reward modeling beyond 128K tokens
    Zecheng Tang, Baibei Ji, Quantong Qiu, Haitian Wang, Xiaobo Liang, Juntao Li, Min Zhang.
    GitHubarXiv

  • MemoryRewardBench: Benchmarking Reward Models for Long-Term Memory Management in Large Language Models
    Zecheng Tang, Baibei Ji, Ruoxi Sun, Haitian Wang, WangJie You, Zhang Yijun, Wenpeng Zhu, Ji Qi, Juntao Li, Min Zhang.
    GitHubarXiv

🔹 Long Sequence Evaluation

  • LOOM-Eval: A comprehensive and efficient framework for long-context model evaluation
    Zecheng Tang, Haitian Wang, Quantong Qiu, Baibei Ji, Ruoxi Sun, Keyan Zhou, Juntao Li, Min Zhang .
    GitHubarXiv

  • L-CiteEval (ACL 2025): A faithfulness-oriented benchmark for long-context citation
    Zecheng Tang, Keyan Zhou, Juntao Li, Baibei Ji, Jianye Hou, Min Zhang.
    GitHubACL Anthology

  • MMLongCite: A Benchmark for Evaluating Fidelity of Long-Context Vision-Language Models
    Keyan Zhou, Zecheng Tang, Lingfeng Ming, Guanghao Zhou, Qiguang Chen, Dan Qiao, Zheming Yang, Libo Qin, Minghui Qiu, Juntao Li, Min Zhang.
    GitHubarXiv

🔹 Long Sequence Modeling & Aligning

  • Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers
    Zecheng Tang, Quantong Qiu, Yi Yang, Zhiyi Hong, Haiya Xiang, Kebin Liu, Qingqing Dang, Juntao Li, Min Zhang.
    GitHubICML

  • CDT (ICLR 2026): Context Denoising Training for Long-Context Modeling
    Zecheng Tang, Baibei Ji, Juntao Li, Lijun Wu, Haijia Gui, Min Zhang.
    GitHubICLR

  • LOGO (ICML 2025): Long cOntext aliGnment via efficient preference Optimization
    Zecheng Tang, Zechen Sun, Juntao Li, Qiaoming Zhu, Min Zhang.
    GitHubICML

  • Global-Mamba (ACL 2025): Efficient long-context modeling architecture
    Wangjie You, Zecheng Tang, Juntao Li, Lili Yao, Min Zhang.
    GitHubACL Anthology

Pinned Loading

  1. LOOM-EvalLOOM-EvalPublic

    A comprehensive and efficient long-context model evaluation framework

    Python 31 4

  2. L-CITEEVALL-CITEEVALPublic

    Evaluating the faithfulness of long-context language models

    Python 30 2

  3. context-denoising-trainingcontext-denoising-trainingPublic

    context denoising training for long-context modeling

    Python 17 1

  4. LongRMLongRMPublic

    Revealing and unlocking the context boundary of reward models

    Python 21 1

  5. LOGOLOGOPublic

    Code for paper: Long cOntext aliGnment via efficient preference Optimization

    Jupyter Notebook 26

  6. MemRewardBenchMemRewardBenchPublic

    A benchmark to systematically evaluate Reward Models' ability to assess long-term memory management of LLMs

    10 1

Repositories

Showing 10 of 13 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…