Remove delay in /api/ask-streaming endpoint response

Eliminated the 50ms delay in the asynchronous streaming response
logic of the /api/ask-streaming endpoint by removing the line
`await Task.Delay(50);`. This change improves the response time
by removing unnecessary latency after each delta in the response
stream.
This commit is contained in:
Marco Minerva
2025-01-28 11:24:51 +01:00
parent 1ef2d384ec
commit 86f161697a
-1
View File
@@ -151,7 +151,6 @@ app.MapPost("/api/ask-streaming", (Question question, VectorSearchService vector
await foreach (var delta in responseStream) await foreach (var delta in responseStream)
{ {
yield return delta; yield return delta;
await Task.Delay(50);
} }
} }