Research· 🧪 Worth Testing
Optimizing In-Context Learning Efficiency Through Shorter Demonstrations
Recent research demonstrates that for in-context learning (ICL), using a higher volume of shorter examples is more effective than using fewer long ones under a fixed token budget. By testing six instruction-tuned LLMs on QA benchmarks like 'Beat the AI' and 'Natural Questions', the authors found that demonstration granularity is a critical factor in performance.