Add message limit to chat history management

Updated `ChatService` to enforce a message limit based on the new `MessageLimit` property in `AppSettings`. Excess messages are removed before updating the cache to optimize performance. Adjusted `appsettings.json` to reflect the new configuration, changing `MaxInputTokens` from 16385 to 16384 and adding `MessageLimit` with a default value of 20.
This commit is contained in:
Marco Minerva
2025-02-20 10:30:55 +01:00
parent 596aa7cf6f
commit 8472775333
3 changed files with 13 additions and 3 deletions
+3 -2
View File
@@ -24,9 +24,10 @@
"MaxTokensPerParagraph": 1000,
"OverlapTokens": 100,
"MaxRelevantChunks": 10,
"MaxInputTokens": 16385,
"MaxInputTokens": 16384,
"MaxOutputTokens": 800,
"MessageExpiration": "00:05:00"
"MessageExpiration": "00:05:00",
"MessageLimit": 20
},
"Logging": {
"LogLevel": {