TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement
Learning
TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement
Learning
The increasing prevalence of large language models (LLMs) such as GPT-4 in various applications has led to a surge in the size of prompts required for optimal performance, leading to challenges in computational efficiency. Prompt compression aims to reduce the inference cost by minimizing input tokens without compromising on the …