mirrors/zed
1
0
Fork 0
mirror of https://github.com/zed-industries/zed.git synced 2025-01-12 13:24:19 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8

Fuse LLM completion stream to avoid a panic (#21914)

Browse source 
`LanguageModel::stream_completion_text` can poll the `stream_completion`
stream (ultimately a `futures::Unfold`) after it's returned
`Ready(None)`, which leads to a panic; avoid this by fusing the stream.

Release Notes:

- Fixed a panic when streaming language model completions
This commit is contained in:
Cole Miller 2024-12-12 11:39:35 -05:00 committed by GitHub
parent b4c8e04544
commit ee6f834028
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
crates/language_model/src/language_model.rs
View file

@ -147,7 +147,7 @@ pub trait LanguageModel: Send + Sync {
let events = self.stream_completion(request, cx); let events = self.stream_completion(request, cx);
async move { async move {
let mut events = events.await?; let mut events = events.await?.fuse();
let mut message_id = None; let mut message_id = None;
let mut first_item_text = None; let mut first_item_text = None;