Repair surrogates in encode_with_unstable (Fixes #541)#553

jbbqqf wants to merge 1 commit into

openai:mainopenai/tiktoken:mainfrom

jbbqqf:fix/541-encode-with-unstable-surrogatesjbbqqf/tiktoken:fix/541-encode-with-unstable-surrogatesCopy head branch name to clipboard