Skip to content

Fixed dependency typos and conflicts#1

Open
chrisxie-fw wants to merge 1 commit intocoleam00:mainfrom
chrisxie-fw:main
Open

Fixed dependency typos and conflicts#1
chrisxie-fw wants to merge 1 commit intocoleam00:mainfrom
chrisxie-fw:main

Conversation

@chrisxie-fw
Copy link
Copy Markdown

Fixed dependency typos and conflicts. One of the langchain libs will pull the appropriate version of openai lib, so comment out the openai line because. Otherwise, version conflict will result.

@Netshadows
Copy link
Copy Markdown

I've diagnosed the issue. It looks like a combination of two things:

  1. The April container crashed with a Segmentation Fault (Exit 139), likely due to the aggressive 128k context window on the 31B model pushing the 24GB VRAM limit.
  2. Several of the new *-llama services (including April) were missing their network aliases in docker-compose.yml, which caused the "Name or service not known" error when they weren't resolvable by other services.

I've posted an implementation plan to fix the aliases and restore connectivity. Should I also try reducing the context window slightly (e.g., to 96k) to stabilize the 31B model on that GPU?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants