Does it support streaming responses when generating them

[redpintings]

Does it support streaming responses when generating them？

[li131766]

I have the same needs and I would like to ask if I can read directly from memory。

[sansyrox]

Hey @redpintings ,

Not yet. It is definitely one of the high priority issues but we still have to fix some other things before we get to it.

You can use websockets meanwhile?

[sansyrox]

@li131766 , what do you mean by reading directly from memory?