Post

just came accross llm lingua. usually i dont like microsoft, but llm lingua is a great tool for prompt compression. just ran an experiment in qwen and llm lingua. the original promt was compared with prompt passed by llm lingua. the output was same but llm lingua gave 52% token reduction