Streaming is an important part of most LLM apps. Both streaming of individual tokens, as well as streaming of events that happen along the way.
We recently introduced `stream_events` – a new method to make this as easy possible. This video goes over how to use that method, as well as how to best use traditional streaming methods.
This has a particular focus on agents.

General streaming docs: https://python.langchain.com/docs/expression_language/streaming

Agent Executor streaming: https://python.langchain.com/docs/modules/agents/how_to/streaming

LangGraph streaming: https://github.com/langchain-ai/langgraph/blob/main/examples/streaming-tokens.ipynb

Add comment

Your email address will not be published. Required fields are marked *

Categories

All Topics