---
id: plugins-llm
title: "LLM"
summary: "The 2 plugins in LLM: AI tool, LLM chat client."
audience: user
keywords: "LlmTool, LlmChatClient"
---
# LLM

Bring a large language model into a flow. The **LLM chat client** sends text to the model and emits its answer. An **AI tool** turns a branch of the flow into a function the model can call, so the model can look up data or act through your flow.

```text
Http listener → LLM chat client → Http response
                AI tool → Sql query
```

See [AI in flows](/documentation/ai/flows) for the full picture.

## Plugins

| Plugin | What it does | Pins |
|---|---|---|
| [AI tool](/documentation/plugins/llm/llm-tool) | Exposes a branch of the flow as a tool (function) that an **LLM chat client** can call. The model decides when to call it, the arguments are sent to the components on `Output`, and whatever comes back on `Input` is returned to the model as the tool result. | `Register`, `Output`, `Input` |
| [LLM chat client](/documentation/plugins/llm/llm-chat-client) | Sends the input text to a large language model on an OpenAI-compatible endpoint (vLLM, Ollama, llama.cpp, OpenAI, Gemini's OpenAI endpoint, ...) and emits the model's answer. Tools defined with **AI tool** components can be attached, so the model can call flow logic while answering. | `Register`, `Input`, `Output` |