Provide a mechanism algorithm for automatic context compression #447
Description
Support for memory compression: Once the memory exceeds the context size, it will become unusable, and once error messages appear in the memory. It can lead to memory poisoning, or an extremely long memory length can cause memory confusion and reduce the model's concentration. An effective memory compression mechanism needs to be provided and integrated into the question-answering process to be automatically triggered based on a threshold