Show HN: Aflow achieves 96.2% on HumanEval at 4.55% of GPT-4's cost t twitter.com 1 metagpt 2 years ago 0 comments
Show HN: Data Interpreter: An LLM Agent for Data Science a arxiv.org 2 metagpt 2 years ago 0 comments
MetaGPT Selected for Oral Presentation at ICLR 2024 o openreview.net 1 metagpt 2 years ago 0 comments
To tackle this, we introduce Find All Crucial Texts (FACT), an iterative retrieval method that refines context through successive rewriting rounds. FACT significantly boosts multi-fact retrieval performance, improving accuracy from ~70% to 99.4% in specific tasks like NIAH. While the improvements are less pronounced in general-purpose QA scenarios, FACT still enhances performance by over 20% on some datasets.
Our findings highlight the limitations of current LLMs in handling long-context retrieval and underscore the need for more robust strategies. The code will soon be available on GitHub, allowing the community to explore and build upon our work.