4 commits

Author	SHA1	Message	Date
Jyong	a63a9c7d45	text spliter length method use default embedding model tokenizer (#2011) ... Co-authored-by: jyong <jyong@dify.ai>	2024-01-12 18:45:34 +08:00
Bowen Liang	cc9e74123c	improve: introduce isort for linting Python imports (#1983)	2024-01-12 12:34:01 +08:00
Yeuoly	9134849744	fix: remove tiktoken from text splitter (#1876)	2024-01-03 13:02:56 +08:00
John Wang	3241e4015b	feat: upgrade langchain (#430) ... Co-authored-by: jyong <718720800@qq.com>	2023-06-25 16:49:14 +08:00