Skip to content

feat: add env var support for custom endpoint default models#12661

Draft
carbap wants to merge 1 commit intodanny-avila:mainfrom
carbap:feat/custom-endpoint-models-default-env-var
Draft

feat: add env var support for custom endpoint default models#12661
carbap wants to merge 1 commit intodanny-avila:mainfrom
carbap:feat/custom-endpoint-models-default-env-var

Conversation

@carbap
Copy link
Copy Markdown

@carbap carbap commented Apr 14, 2026

Summary

Adds support for configuring the default models of custom endpoints via environment variables.

Change Type

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Testing

Here is an example configuration:

librechat.yaml

endpoints:
 custom:
   - name: "Mistral"
     apiKey: "${MISTRAL_API_KEY}"
     baseURL: "${MISTRAL_BASE_URL}"
     models:
       default: ["${MISTRAL_MODEL}"]
       fetch: false
     modelDisplayLabel: "Mistral"
     dropParams: ["stop", "user", "frequency_penalty", "presence_penalty"]

.env

MISTRAL_MODEL=mistral-small-latest

Checklist

Please delete any irrelevant options.

  • I have made pertinent documentation changes
  • I have written tests demonstrating that my changes are effective or that my feature works
  • Local unit tests pass with my changes
  • A pull request for updating the documentation has been submitted.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant