Skip to content

OpenAI Compatible

This node supplies a language model through an OpenAI-compatible API endpoint. Use it when an Agent should work with a compatible hosted or self-hosted model instead of the standard OpenAI endpoint.

Category: LLM

Purpose: Connects to any service that speaks the OpenAI API format (OpenRouter, vLLM, LocalAI, self-hosted models).

Inputs: None (configured through fields)

Outputs:

  • llm - Model instance for agents
  • config_info - Resolved connection settings

Configuration — Basic:

  • API Key (Credential): Required for commercial providers, optional for some local servers. Base URL and model name are stored inside the credential
  • Temperature: 0.0–2.0, default 0.7
  • Max Tokens: 1–200000, default 4096. The upper bound is deliberately wide; exceeding the target model's capacity causes an error

Configuration — Advanced:

  • Streaming: Default off. Streams the response word by word
  • Top Probability: 0.0–1.0, default 1.0. Narrows the token selection pool. Adjust either this or Temperature, not both
  • Frequency Penalty: -2.0 to 2.0, default 0.0. Reduces repetition of the same words
  • Presence Penalty: -2.0 to 2.0, default 0.0. Encourages moving to new topics
  • Timeout: 1–600 seconds, default 60
  • SSL Certificate Verification: Default on. Disable only for internal servers with self-signed certificates
  • Strip Reasoning/Thinking Tags: Default off. Removes reasoning blocks from models that emit them
  • Extra Body Parameters (JSON): Additional parameters appended to the request body, for provider-specific options

Usage: Connection settings live in the credential rather than the node, so switching to a different provider or model means selecting a different credential.