LLM

Bring a large language model into a flow. The LLM chat client sends text to the model and emits its answer. An AI tool turns a branch of the flow into a function the model can call, so the model can look up data or act through your flow.

Http listener → LLM chat client → Http response
                AI tool → Sql query

See AI in flows for the full picture.

Plugins

Plugin	What it does	Pins
AI tool	Exposes a branch of the flow as a tool (function) that an LLM chat client can call. The model decides when to call it, the arguments are sent to the components on Output, and whatever comes back on Input is returned to the model as the tool result.	Register, Output, Input
LLM chat client	Sends the input text to a large language model on an OpenAI-compatible endpoint (vLLM, Ollama, llama.cpp, OpenAI, Gemini's OpenAI endpoint, ...) and emits the model's answer. Tools defined with AI tool components can be attached, so the model can call flow logic while answering.	Register, Input, Output