feat(lightspeed): replace RAG init container with OKP deployment - #500
feat(lightspeed): replace RAG init container with OKP deployment#500maysunfaisal wants to merge 1 commit into
Conversation
…DP-16102] Replace the RAG init container / FAISS vector store with an OKP (Offline Knowledge Portal) Deployment, Service, and Route. Add platform-aware config selection: OpenShift (or K8s with okp.ingress.host set) uses the full OKP config; vanilla K8s uses the lightspeed-stack-no-okp.yaml variant so LCORE does not crash without an OKP backend. Add OKP Ingress support, imagePullSecrets, vector_store config, and align/pin the OKP and LCORE (OGX) images. Sync vendored Lightspeed configs from lightspeed-configs@main. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
8780222 to
73fafce
Compare
|
|
Corresponding rhdh-operator PR redhat-developer/rhdh-operator#3370 |
There was a problem hiding this comment.
@maysunfaisal Note that the charts/backstage is being deprecated on main in favor of a brand-new standalone charts/rhdh chart - see #438
I'm just back from vacation but I'm hoping we can get #438 merged as soon as possible. So it'll be great if your changes here could be applied against this new rhdh chart instead. Thanks for your understanding.
|
/hold |
rm3l
left a comment
rm3l
left a comment
There was a problem hiding this comment.
@maysunfaisal FYI, #438 has just been merged. So it'll be great if your changes here could be applied against this new rhdh chart instead. Thanks.
|
PR needs rebase. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
@rm3l Thanks Armel, let me take a look on Tuesday |
2 participants
Description of the change
Replace the Lightspeed RAG init container / FAISS vector store with an OKP (Offline Knowledge Portal) backend and swap the Lightspeed dynamic plugins to the Intelligent Assistant plugins.
OKP deployment
Deployment,Service,Route, andIngresstemplates (Solr8983+ httpd8080) undertemplates/lightspeed/._helpers.tpl): OpenShift — or K8s withokp.ingress.hostset — uses the full OKP config; vanilla K8s useslightspeed-stack-no-okp.yamlso LCORE does not crash without an OKP backend.okp.*values (image, replicas, Solr memory, ingress, imagePullSecrets); OKP image pinned toregistry.redhat.io/offline-knowledge-portal/rhokp-rhel9:1.2.10-1786628394.Plugin swap (Intelligent Assistant)
values.yamlFE + BE plugins →oci://quay.io/rhdh/red-hat-developer-hub-backstage-plugin-intelligent-assistant(-backend):{{ "{{inherit}}" }},enabled: true.Config & images
lightspeed-stack.yaml(OKP) +lightspeed-stack-no-okp.yaml(no-OKP), addvector_storeconfig, updaterhdh-profile.py/secret.yaml.quay.io/lightspeed-core/lightspeed-stack:dev-20260811-0da4b12); drop the RAG init container frombackstage-deployment.yaml.lightspeed-configs@main(hack/sync-lightspeed-configs.sh).Which issue(s) does this PR fix or relate to
https://redhat.atlassian.net/browse/RHIDP-16102
How to test changes / Special notes to the reviewer
On OpenShift:
lightspeedenabled and provide your inference key (e.g.OPENAI_API_KEY) via the Lightspeed secret.lightspeed-coresidecar (no RAG init container); OKPDeployment/Service/Route1/1 Running.OKP_SERVICE_URLinjected into the sidecar; LCOREGET /v1/modelsreturns 200.On vanilla K8s:
okp.ingress.host: OKP is skipped,lightspeed-stack-no-okp.yamlis used, LCORE starts without crashing.okp.ingress.hostset: OKP + Ingress are deployed and used.Checklist
Chart.yamlaccording to Semantic Versioning.values.yamland added to the corresponding README.md (regenerated via thehelm-docspre-commit hook).pre-commithook.ct lintcommand.orchestrator-infrachart not touched.