Posts by Collection

Summer Traveling

Short description of portfolio item number 1

Winter Traveling

Short description of portfolio item number 2

Klara and The Sun

Published in , 2021

Retrieval Meets Long Context Large Language Models

Published in ICLR, 2024

This paper aims to explore the performence of RAG and long context large language model. A very interesting point is that retrival can significantly improve the performance of LLMs regardless of their extended context window sizes. In addition, they also explore why retrieval enhancement fails to improve the performance of large models with long contexts for small numbers of parameters. This is because the bottleneck of the model at this point is not in the length of the context that the model can input, but rather in its own performance.

Download Paper

Talk 1 on Relevant Topic in Your Field

Published: March 01, 2012

This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!

Tutorial 1 on Relevant Topic in Your Field

Published: March 01, 2013

More information here

Talk 2 on Relevant Topic in Your Field

Published: February 01, 2014

More information here

Conference Proceeding talk 3 on Relevant Topic in Your Field

Published: March 01, 2014

This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.