Publications

LLMBox: A Comprehensive Library for Large Language Models

Published in ACL 2024-Demo, 2024

Tianyi Tang, Yiwen Hu, Bingqian Li, Wenyang Luo, Zijing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Yuanqian Zhao, Luran Ding, Yuhao Wang, Zican Dong, Chunxuan Xia, Junyi Li, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen

Download here

JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models

Published in NeurIPS 2024, 2024

Kun Zhou, Beichen Zhang, Jiapeng Wang, Zhipeng Chen, Wayne Xin Zhao, Jing Sha, Zhichao Sheng, Shijin Wang, Ji-Rong Wen

Download here

Low-Redundant Optimization for Large Language Model Alignment

Published in EMNLP 2024, 2024

Zhipeng Chen, Kun Zhou, Wayne Xin Zhao, Jingyuan Wang, Ji-Rong Wen

Download here

Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models

Published in ACL 2024, 2024

Yuchong Sun, Che Liu, Kun Zhou, Jinwen Huang, Ruihua Song, Wayne Xin Zhao, Fuzheng Zhang, Di Zhang, Kun Gai

Download here

Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation

Published in EACL 2024 (Evaluation and Model Insight Award), 2024

Kun Zhou, Yifan Li, Xin Zhao, Ji-Rong Wen

Download here

Images are Achilles’ Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Models

Published in ECCV 2024, 2024

Yifan Li, Hangyu Guo, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen

Download here

MS MARCO Web Search: a Large-scale Information-rich Web Dataset with Millions of Real Click Labels

Published in WWW 2024, 2024

Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Nikhil Rao, Anlei Dong, Wenqi Jiang, Zheng Liu, Mingqin Li, Chuanjie Liu, Zengzhong Li, Rangan Majumder, Jennifer Neville, Andy Oakley, Knut Magne Risvik, Harsha Vardhan Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang

Download here

Improving large language models via fine-grained reinforcement learning with minimum editing constraint

Published in ACL 2024-Findings, 2024

Zhipeng Chen, Kun Zhou, Wayne Xin Zhao, Junchen Wan, Fuzheng Zhang, Di Zhang, Ji-Rong Wen

Download here

Data-CUBE: Data Curriculum for Instruction-based Sentence Representation Learning

Published in ACL 2024-Findings, 2024

Yingqian Min, Kun Zhou, Dawei Gao, Wayne Xin Zhao, He Hu, Yaliang Li

Download here

Evaluating and Improving Tool-Augmented Computation-Intensive Math Reasoning

Published in NeurIPS 2023, 2023

Beichen Zhang, Kun Zhou, Xilin Wei, Wayne Xin Zhao, Jing Sha, Shijin Wang, Ji-Rong Wen

Download here

Evaluating Object Hallucination in Large Vision-Language Models

Published in EMNLP 2023, 2023

Yifan Li, Yifan Du, Kun Zhou, Jinpeng Wang, Wayne Xin Zhao, Ji-Rong Wen

Download here

StructGPT: A General Framework for Large Language Model to Reason over Structured Data

Published in EMNLP 2023, 2023

Jinhao Jiang, Kun Zhou, Zican Dong, Keming Ye, Wayne Xin Zhao, Ji-Rong Wen

Download here

ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph

Published in EMNLP 2023, 2023

Jinhao Jiang, Kun Zhou, Wayne Xin Zhao, Yaliang Li, Ji-Rong Wen

Download here

ChatCoT: Tool-Augmented Chain-of-Thought Reasoning on Chat-based Large Language Models

Published in EMNLP 2023-Findings, 2023

Zhipeng Chen, Kun Zhou, Beichen Zhang, Zheng Gong, Wayne Xin Zhao, Ji-Rong Wen

Download here

Alleviating the Long-Tail Problem in Conversational Recommender Systems

Published in RecSys 2023, 2023

Zhipeng Zhao, Kun Zhou, Xiaolei Wang, Wayne Xin Zhao, Fan Pan, Zhao Cao, Ji-Rong Wen

Download here

Learning to Perturb for Contrastive Learning of Unsupervised Sentence Representations

Published in TASLP 2023, 2023

Kun Zhou, Yuanhang Zhou, Wayne Xin Zhao, Ji-Rong Wen

Download here

MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers

Published in ECML-PKDD 2023 Research Track, 2023

Kun Zhou, Xiao Liu, Yeyun Gong, Wayne Xin Zhao, Daxin Jiang, Nan Duan, Ji-Rong Wen

Download here

JiuZhang 2.0: A Unified Chinese Pre-trained Language Model for Multi-task Mathematical Problem Solving

Published in KDD 2023 Applied Data Science Track, 2023

Wayne Xin Zhao, Kun Zhou, Beichen Zhang, Zheng Gong, Zhipeng Chen, Yuanhang Zhou, Ji-Rong Wen, Jing Sha, Shijin Wang, Cong Liu, Guoping Hu

Download here

Improving Conversational Recommendation Systems via Counterfactual Data Simulation

Published in KDD 2023 Research Track, 2023

Xiaolei Wang, Kun Zhou, Xinyu Tang, Xin Zhao, Fan Pan, Zhao Cao, Ji-Rong Wen

Download here

Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization

Published in ACL 2023, 2023

Ze-Feng Gao, Kun Zhou, Peiyu Liu, Wayne Xin Zhao, Ji-Rong Wen

Download here

Visually-augmented Pretrained Language Models for NLP Tasks without Images

Published in ACL 2023, 2023

Hangyu Guo*, Kun Zhou*, Wayne Xin Zhao, Qinyu Zhang, Ji-Rong Wen. (* Equal Contribution)

Download here

Diffusion Models for Non-autoregressive Text Generation: A Survey

Published in IJCAI 2023 Survey Track, 2023

Yifan Li, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen

Download here

Improving News Recommendation via Bottlenecked Multi-task Pre-training

Published in SIGIR 2023 Short Paper, 2023

Xiongfeng Xiao, Qing Li, Songlin Liu, Kun Zhou*. (* Corresponding Author)

Download here

UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph

Published in ICLR 2023, 2023

Jinhao Jiang*, Kun Zhou*, Wayne Xin Zhao, Ji-Rong Wen. (* Equal Contribution)

Download here

Enhancing Multi-View Smoothness for Sequential Recommendation Models

Published in TOIS 2023, 2023

Kun Zhou, Hui Wang, Ji-Rong Wen, Wayne Xin Zhao.

Download here

SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval

Published in EMNLP 2022 Industry Track, 2022

Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-Rong Wen, Nan Duan, Weizhu Chen.

Download here

Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning

Published in KDD 2022 Research Track, 2022

Xiaolei Wang*, Kun Zhou*, Ji-Rong Wen and Wayne Xin Zhao. (* Equal Contribution)

Download here

JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understanding

Published in KDD 2022 ADS Track, 2022

Wayne Xin Zhao, Kun Zhou*, Zheng Gong*, Beichen Zhang*, Yuanhang Zhou*, Jing Sha, Zhigang Chen, Shijin Wang, Cong Liu and Ji-Rong Wen. (* Equal Contribution)

Download here

Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models

Published in NAACL 2022 Findings, 2022

Jinhao Jiang*, Kun Zhou*, Ji-Rong Wen and Wayne Xin Zhao. (* Equal Contribution)

Download here

Curriculum Pre-Training Heterogeneous Subgraph Transformer for Top-N Recommendation

Published in TOIS, 2022

Hui Wang*, Kun Zhou*, Wayne Xin Zhao, Jingyuan Wang, Ji-Rong Wen (* Equal Contribution)

Download here

Debiased Contrastive Learning of Unsupervised Sentence Representations

Published in ACL 2022 Main Conference, 2022

Kun Zhou, Beichen Zhang, Wayne Xin Zhao and Ji-Rong Wen.

Download here

Continual Pre-training of Language Models for Math Problem Understanding with Syntax-Aware Memory Network

Published in ACL 2022 Main Conference, 2022

Zheng Gong*, Kun Zhou*, Xin Zhao, Jing Sha, Shijin Wang and Ji-Rong Wen. (* Equal Contribution)

Download here

Filter-enhanced MLP is All You Need for Sequential Recommendation

Published in WWW 2022 Research Track, 2022

Kun Zhou*, Hui Yu*, Wayne Xin Zhao and Ji-Rong Wen. (* Equal Contribution)

Download here

C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System

Published in WSDM 2022 Regular Paper, 2021

Yuanhang Zhou* Kun Zhou*, Wayne Xin Zhao, Cheng Wang, Peng Jiang and He Hu. (* Equal Contribution)

Download here

Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models

Published in EMNLP 2021 Main Conference, 2021

Kun Zhou, Wayne Xin Zhao, Sirui Wang, Fuzheng Zhang, Wei Wu and Ji-Rong Wen.

Download here

Contrastive Curriculum Learning for Sequential User Behavior Modeling via Data Augmentation

Published in CIKM 2021 Applied Track, 2021

Shuqing Bian, Wayne Xin Zhao, Kun Zhou, Jing Cai, Yancheng He, Cunxiang Yin, Ji-Rong Wen. This paper has been implemented in Tencent Kuaibao online system.

Download here

CRSLab: An Open-Source Toolkit for Building Conversational Recommender System

Published in ACL 2021 Demo Track, 2021

Kun Zhou, Xiaolei Wang, Yuanhang Zhou, Chenzhan Shang, Yuan Cheng, Wayne Xin Zhao, Yaliang Li, Ji-Rong Wen

Download here

Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goals

Published in SIGIR 2021 short paper, 2021

Yutao Zhu, Jian-Yun Nie, Kun Zhou, Pan Du, Hao Jiang, Zhicheng Dou

Download here

A Novel Macro-Micro Fusion Network for User Representation Learning on Mobile Apps

Published in WWW 2021, 2021

Shuqing Bian, Wayne Xin Zhao, Kun Zhou, Xu Chen, Jing Cai, Yancheng He, Xingji Luo, Ji-Rong Wen. This paper has been implemented in Tencent Kuaibao online system.

Download here

BERT4SO: Neural Sentence Ordering by Fine-tuning BERT

Published in Arxiv, 2021

Yutao Zhu, Jian-Yun Nie, Kun Zhou, Shengchao Liu, Yabo Ling, Pan Du

Download here

Content Selection Network for Document-grounded Retrieval-based Chatbots

Published in ECIR 2021, 2020

Yutao Zhu, Jian-Yun Nie, Kun Zhou, Pan Du, Zhicheng Dou

Download here

Neural Sentence Ordering Based on Constraint Graphs

Published in AAAI 2021, 2020

Yutao Zhu, Kun Zhou, Jian-Yun Nie, Shengchao Liu, Zhicheng Dou

Download here

Learn with Noisy Data via Unsupervised Loss Correction for Weakly Supervised Reading Comprehension

Published in COLING 2020, 2020

Xuemiao Zhang, Kun Zhou, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, Junfei Liu

Download here

Towards Topic-Guided Conversational Recommender System

Published in COLING 2020, 2020

Kun Zhou, Yuanhang Zhou, Wayne Xin Zhao, Xiaoke Wang, Ji-Rong Wen

Download here

Learning to Match Jobs with Resumes from Sparse Interaction Data using Multi-View Co-Teaching Network

Published in CIKM 2020, 2020

Shuqing Bian, Xu Chen, Wayne Xin Zhao, Kun Zhou, Yupeng Hou, Yang Song, Tao Zhang, Ji-Rong Wen

Download here

Multi-modal knowledge graphs for recommender systems

Published in CIKM 2020, 2020

Rui Sun, Xuezhi Cao, Yan Zhao, Junchen Wan, Kun Zhou, Fuzheng Zhang, Zhongyuan Wang, Kai Zheng

Download here

Leveraging historical interaction data for improving conversational recommender system

Published in CIKM 2020 Short Paper, 2020

Kun Zhou, Wayne Xin Zhao, Hui Wang, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, Ji-Rong Wen

Download here

S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization

Published in CIKM 2020, 2020

Kun Zhou, Hui Wang, Wayne Xin Zhao, Yutao Zhu, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, Ji-Rong Wen. This paper is selected as the most influential CIKM papers by Paperdigest, and has been implemented in Meituan online recommendation system.

Download here

Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion

Published in KDD 2020, 2020

Kun Zhou, Wayne Xin Zhao, Shuqing Bian, Yuanhang Zhou, Ji-Rong Wen, Jingsong Yu

Download here

Improving Multi-turn Response Selection Models with Complementary Last-Utterance Selection by Instance Weighting

Published in PAKDD 2020, 2020

Kun Zhou, Wayne Xin Zhao, Yutao Zhu, Ji-Rong Wen, Jingsong Yu

Download here

Unsupervised Context Rewriting for Open Domain Conversation

Published in EMNLP-IJCNLP 2019, 2019

Kun Zhou, Kai Zhang, Yu Wu, Shujie Liu, Jingsong Yu. This paper has been implemented in Microsoft XiaoICe online dialog system.

Download here