Streaming is an important UX consideration for LLM applications. We’ve put a lot of work into making sure streaming works for your chains and agents.
Jupyter Notebook (to follow along): https://github.com/hwchase17/langchain-0.1-guides/blob/master/streaming.ipynb
JavaScript Notebook: https://github.com/bracesproul/langchainjs-0.1-guides/blob/main/streaming.ipynb
Links:
Streaming with LCEL: https://python.langchain.com/docs/expression_language/interface#stream
Streaming with RAG: https://python.langchain.com/docs/use_cases/question_answering/streaming
Streaming with Agents: https://python.langchain.com/docs/modules/agents/how_to/streaming
Add comment