jyapayne/dify
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fix: typo and check (#5287)

Browse source
This commit is contained in:
crazywoola 2024-06-17 09:15:43 +08:00 • committed by GitHub
commit 9a64aa76c1
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
api/core/model_runtime/model_providers/localai/llm/llm.py
View file

@ -73,7 +73,7 @@ class LocalAILanguageModel(LargeLanguageModel):
def tokens(text: str):
"""
We cloud not determine which tokenizer to use, cause the model is customized.
We could not determine which tokenizer to use, cause the model is customized.
So we use gpt2 tokenizer to calculate the num tokens for convenience.
"""
return self._get_num_tokens_by_gpt2(text)