OpenAI Compatible¶
This node supplies a language model through an OpenAI-compatible API endpoint. Use it when an Agent should work with a compatible hosted or self-hosted model instead of the standard OpenAI endpoint.
Category: LLM
Purpose: Connects to any service that speaks the OpenAI API format (OpenRouter, vLLM, LocalAI, self-hosted models).
Inputs: None (configured through fields)
Outputs:
llm- Model instance for agentsconfig_info- Resolved connection settings
Configuration — Basic:
- API Key (Credential): Required for commercial providers, optional for some local servers. Base URL and model name are stored inside the credential
- Temperature: 0.0–2.0, default 0.7
- Max Tokens: 1–200000, default 4096. The upper bound is deliberately wide; exceeding the target model's capacity causes an error
Configuration — Advanced:
- Streaming: Default off. Streams the response word by word
- Top Probability: 0.0–1.0, default 1.0. Narrows the token selection pool. Adjust either this or Temperature, not both
- Frequency Penalty: -2.0 to 2.0, default 0.0. Reduces repetition of the same words
- Presence Penalty: -2.0 to 2.0, default 0.0. Encourages moving to new topics
- Timeout: 1–600 seconds, default 60
- SSL Certificate Verification: Default on. Disable only for internal servers with self-signed certificates
- Strip Reasoning/Thinking Tags: Default off. Removes reasoning blocks from models that emit them
- Extra Body Parameters (JSON): Additional parameters appended to the request body, for provider-specific options
Usage: Connection settings live in the credential rather than the node, so switching to a different provider or model means selecting a different credential.