How "lost in the middle"? Evaluating LLMs on information retrieval with long input contexts
LLMs have become increasingly powerful over the past two years. Across 2023 and 2024, we saw new models flourish — every few months, a new model would reach new heights in reasoning, retrieval, math and other benchmarks. From a practical standpoint, one of the most significant advancements has been the explosion