Pr/multilingual#121
Open
raghavm243512 wants to merge 18 commits into
Open
Conversation
raghavm243512
force-pushed
the
pr/multilingual
branch
from
bd0e0d9 to
81923ab
Compare
raghavm243512
force-pushed
the
pr/multilingual
branch
from
68fb05a to
f5a5b52
Compare
raghavm243512
force-pushed
the
pr/multilingual
branch
from
606dc7d to
ada9699
Compare
Collaborator
katstankiewicz
left a comment
katstankiewicz
left a comment
There was a problem hiding this comment.
can you also add ensure_ascii=False to AuditLog save()
| ), | ||
| audit_log=audit_log, | ||
| api_key=params["api_key"], | ||
| base_url=params.get("url", ""), |
Collaborator
There was a problem hiding this comment.
Suggested change
| base_url=params.get("url", ""), |
we don't need a url for openai services
Collaborator
Author
There was a problem hiding this comment.
I added this because I was testing a side project (self hosted S2S agent). With any luck we will need this so we can leave or remove up to you
raghavm243512
force-pushed
the
pr/multilingual
branch
from
aa152bd to
b3ad5dc
Compare
raghavm243512
force-pushed
the
pr/multilingual
branch
from
26fa5ec to
ff7bd59
Compare
…behavioral_fidelity judge prompt
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
initial multilingual version
Easily extendable to many language using the add_culture_data script. This will do translation, gender consistent naming, suggest names, extend data, etc. So if anyone wants to run a language not committed in EVA data, it is trivially easy to do so.
Readme section showing basic of adding a language.
This adds:
Multilingual data schema and content (initial utterances, system prompt, name aliases)
multilingual support in code
Prompt updates to support multi languages
Script to "add a language" with high degree of automation
WER metric normalization rules, dynamically set per language and creatable via LLM through adding script
Automatic .env.example adjustments (maintains config app accuracy)
Still TODO: