Skip to main content

Return to Changelog

v1.7.4

ยท 2 min read

This patch release completes tool calling on the OpenAI-compatible API and fixes authentication and Python client issues.

New featuresโ€‹

  • Full tool/function-calling support: The OpenAI-compatible /v1/chat/completions and /v1/responses endpoints now support the complete tool-calling round trip, with both streamed and non-streamed responses returning tool calls.
    • Requests can pass tools, tool_choice, and parallel_tool_calls, or the legacy functions/function_call form, which is automatically translated to the modern form.
    • /v1/responses also emits per-call streaming lifecycle events for tool calls.
  • Additional passthrough parameters: response_format, logit_bias, stop, reasoning_effort, frequency_penalty, presence_penalty, and user are now forwarded to the upstream model on both endpoints.

Bug fixesโ€‹

OpenAI-compatible API

  • Fixed chat completion choices returning the index field under the key id instead of index, which could break clients that correlate parallel or streamed choices.
  • Fixed non-streamed responses being sent without a Content-Type header, which crashed the openai-node SDK and integrations built on it, such as n8n.

Authentication and access

  • Fixed users who signed in with only a bearer token showing a blank email address, for example when sharing a collection. The email is now backfilled from the JWT claim.

Python client

  • Fixed the client crashing on construction when a proxy, ingress, or WAF redirected its cookie-session capability check to an HTML page instead of a JSON response.

Feedback