Commit graph

7,638 commits

Author SHA1 Message Date
Yassine Selmi
843e7a6b50 Removed Weaviate from config.yaml 2023-12-19 18:45:14 +00:00
Yassine Selmi
3a5320a098 Migrated Weaviate to custom component 2023-12-19 18:36:29 +00:00
Gabriel Luiz Freitas Almeida
96d12b6259 Update import statements in memories.py 2023-12-19 13:38:33 -03:00
Atharva J
52b6bc4ad4 Merge branch 'Vectara-component-update' of https://github.com/JAtharva22/langflowdev into Vectara-component-update 2023-12-19 15:09:33 +05:30
Atharva J
a5c6683609 . 2023-12-19 15:09:29 +05:30
Gabriel Luiz Freitas Almeida
34e116ddf2 Add process_json endpoint for processing JSON data 2023-12-18 10:52:33 -03:00
Gabriel Luiz Freitas Almeida
826a6d07e0 Refactor ProcessResponse schema in schemas.py 2023-12-18 10:50:43 -03:00
Gabriel Luiz Freitas Almeida
2edacce305 Add traceback property to AnyIOTaskResult class 2023-12-18 10:50:01 -03:00
Gabriel Luiz Freitas Almeida
87f8af1db9 Add import statements for asyncio and json 2023-12-18 10:49:52 -03:00
Gabriel Luiz Freitas Almeida
60a55784af Refactor flow loading and processing 2023-12-17 21:27:07 -03:00
Gabriel Luiz Freitas Almeida
2afb0fb119 Add support for custom components in langchain_object 2023-12-17 20:44:35 -03:00
Atharva Jadhav
a16fe99162
Delete src/backend/langflow/components/retrievers/VectaraSelfQueryRetriever.py 2023-12-18 04:52:25 +05:30
Atharva J
390767cbf7 major 2023-12-18 04:47:07 +05:30
Atharva J
dc656ad402 Merge branch 'dev' of https://github.com/JAtharva22/langflowdev into dev 2023-12-18 04:44:02 +05:30
Gabriel Luiz Freitas Almeida
f36b6a5693 Add support for Runnable objects in generate_result function 2023-12-17 17:32:03 -03:00
Gabriel Luiz Freitas Almeida
5c290c0014 Pull start_time out of try block 2023-12-14 17:44:25 -03:00
Gabriel Luiz Freitas Almeida
865ac0306a
Refactor custom component module (#1210) 2023-12-14 13:04:02 -03:00
cristhianzl
45479222d7 fix(frontend): fix save component test by removing unnecessary steps and fixing selectors
feat(frontend): add test for saving components and verifying their presence in the flow
feat(frontend): add test for grouping nodes and verifying the presence of the group node
feat(frontend): add test for saving default component with custom values and verifying the saved component
feat(frontend): add test for saving the same component multiple times and verifying their presence
feat(frontend): add test for saving default component and deleting it from the saved components list
2023-12-14 13:00:48 -03:00
Gabriel Luiz Freitas Almeida
7ec8a6c2a8 Refactor code_parser.py and test_custom_component.py 2023-12-14 10:00:43 -03:00
Gabriel Luiz Freitas Almeida
570822d20b Add imports to utils.py 2023-12-14 09:45:23 -03:00
Gabriel Luiz Freitas Almeida
2d92da6ed4 Add import for warnings module 2023-12-14 09:43:55 -03:00
Gabriel Luiz Freitas Almeida
5de717c770 Fix CustomComponent get_build_method return value 2023-12-14 09:39:19 -03:00
Gabriel Luiz Freitas Almeida
e7e364be38 Add custom component classes and methods 2023-12-14 09:32:45 -03:00
Gabriel Luiz Freitas Almeida
7fdc9bfbd8 Add new code parser and directory reader modules 2023-12-14 09:27:38 -03:00
Gabriel Luiz Freitas Almeida
10c9c95a64 Fix import error in GoogleGenerativeAI.py 2023-12-13 21:19:11 -03:00
Gabriel Luiz Freitas Almeida
0442c7d42a Add "code" field to GoogleGenerativeAIComponent 2023-12-13 21:15:22 -03:00
Gabriel Luiz Freitas Almeida
f5c673d207 Add Google Generative AI component 2023-12-13 21:09:09 -03:00
Cristhian Zanforlin Lousa
1a4e4f502a
refactor(GenericNode): simplify conditional class assignment for the … (#1206)
…div element in the GenericNode component
2023-12-13 20:31:19 -03:00
cristhianzl
60fc7c630e refactor(GenericNode): simplify conditional class assignment for the div element in the GenericNode component 2023-12-13 20:27:07 -03:00
Cristhian Zanforlin Lousa
8343ecab5f
feat(pageLayout): add support for displaying a beta icon in the page … (#1205)
…title

feat(StorePage): enable beta icon in the PageLayout component
style(applies.css): adjust styles for the beta icon in the page title
2023-12-13 20:17:22 -03:00
cristhianzl
03be55a1ba feat(pageLayout): add support for displaying a beta icon in the page title
feat(StorePage): enable beta icon in the PageLayout component
style(applies.css): adjust styles for the beta icon in the page title
2023-12-13 20:14:34 -03:00
Gabriel Luiz Freitas Almeida
94003cf39a 🐛 fix(utils.py): add support for initializing class objects with a template parameter 2023-12-13 20:01:33 -03:00
Gabriel Luiz Freitas Almeida
dd6d510be3 Merge remote-tracking branch 'origin/main' into dev 2023-12-13 19:57:04 -03:00
Gabriel Luiz Freitas Almeida
ca576c1bd9
Add AWS CDK deployment scripts by @kazuki306 (#1193) 2023-12-13 19:15:43 -03:00
Gabriel Luiz Freitas Almeida
cc666e1ce5 Add unique constraints to tables 2023-12-13 19:10:48 -03:00
Gabriel Luiz Freitas Almeida
372f39bcad Fix build failure and optimize imports 2023-12-13 19:10:48 -03:00
Gabriel Luiz Freitas Almeida
9d19082452 Refactor serialize_file_path method in TemplateField class 2023-12-13 19:10:47 -03:00
Gabriel Luiz Freitas Almeida
c5148c594e Add loguru logger and sqlalchemy imports
Handle AutogenerateDiffsDetected exception in migrations

Fix migration error message
2023-12-13 18:57:30 -03:00
Gabriel Luiz Freitas Almeida
fde3c52665 Refactor cache factory imports 2023-12-13 18:57:14 -03:00
Gabriel Luiz Freitas Almeida
1c472c359f Add unique constraints to tables 2023-12-13 18:57:02 -03:00
Gabriel Luiz Freitas Almeida
d243cfd98f Add time_elapsed variable to track the elapsed time during stream_build() 2023-12-13 18:10:48 -03:00
Gabriel Luiz Freitas Almeida
a2336aa7c8 Refactor vertex class selection in Graph class 2023-12-13 10:38:25 -03:00
Gabriel Luiz Freitas Almeida
f109a4097e Refactor code and fix imports 2023-12-12 17:57:56 -03:00
Gabriel Luiz Freitas Almeida
155e441406 Fix various bugs and make improvements 2023-12-12 17:02:37 -03:00
Gabriel Luiz Freitas Almeida
5f237313b9 Remove "code" parameter from VectorStoreVertex and ChainVertex 2023-12-12 16:58:56 -03:00
Gabriel Luiz Freitas Almeida
e36b929aa7 Fix import formatting and add dynamic field flag 2023-12-12 16:52:58 -03:00
Gabriel Luiz Freitas Almeida
18b4e33062 🐛 fix(flows.py): remove unused import statement to improve code cleanliness and maintainability
🐛 fix(flows.py): change Flow.from_orm() to Flow.model_validate() to ensure data integrity and validation
🐛 fix(users.py): remove unused import statements to improve code cleanliness and maintainability
🐛 fix(users.py): change User.from_orm() to User.model_validate() to ensure data integrity and validation
🐛 fix(LLMChain.py): remove unused import statements to improve code cleanliness and maintainability
🐛 fix(LLMChain.py): remove unnecessary line breaks to improve code readability
🐛 fix(base.py): remove unused import statements to improve code cleanliness and maintainability
🐛 fix(base.py): remove unnecessary line breaks to improve code readability
🐛 fix(base.py): fix condition to append vertex_id to top_level_vertices to avoid appending non-string values
🐛 fix(vertex/base.py): add parent_node_id attribute to Vertex class to support hierarchical graph structures
🐛 fix(base.py): remove unused import statements to improve code cleanliness and maintainability

🚀 feat(GroupTest): add a new node for a simple chat with a custom prompt template and conversational memory buffer

ℹ️ This commit adds a new node to the GroupTest project. The node is a genericNode with the following properties:
- Width: 384
- Height: 621
- ID: ChatOpenAI-rUJ1b
- Type: genericNode
- Position: x: 170.87326389541306, y: 465.8628482073749
- Data:
  - Type: ChatOpenAI
  - Node:
    - Template:
      - Callbacks:
        - Required: false
        - Placeholder: ""
        - Show: false
        - Multiline: false
        - Password: false
        - Name: callbacks
        - Advanced: false
        - Dynamic: false
        - Info: ""
        - Type: langchain.callbacks.base.BaseCallbackHandler
        - List: true
      - Cache:
        - Required: false
        - Placeholder: ""
        - Show: false
        - Multiline: false
        - Password: false
        - Name: cache
        - Advanced: false
        - Dynamic: false
        - Info: ""
        - Type: bool
        - List: false
      - Client:
        - Required: false
        - Placeholder: ""
        - Show: false
        - Multiline: false
        - Password: false
        - Name: client
        - Advanced: false
        - Dynamic: false
        - Info: ""
        - Type: Any
        - List: false
      - Max Retries:
        - Required: false
        - Placeholder: ""
        - Show: false
        - Multiline: false
        - Value: 6
        - Password: false
        - Name: max_retries
        - Advanced: false
        - Dynamic: false
        - Info: ""
        - Type: int
        - List: false
      - Max Tokens:
        - Required: false
        - Placeholder: ""
        - Show: true
        - Multiline: false
        - Password: true
        - Name: max_tokens
        - Advanced: false
        - Dynamic: false
        - Info: ""
        - Type: int
        - List: false

🔧 chore: fix formatting issue in code
📝 docs: update documentation link for `OpenAI` Chat large language models API

🔧 chore: update prompt template configuration in LLMChain node
📝 docs: add documentation link for PromptTemplate in the description

📝 chore(grouped_chat.json): add grouped_chat.json test data file

This commit adds the `grouped_chat.json` file to the `tests/data` directory. The file contains a JSON object representing grouped chat data. This file is necessary for testing and will be used in the test suite.

📝 chore(one_group_chat.json): add one_group_chat.json test data file

This commit adds the one_group_chat.json file, which contains a simple chat with a custom prompt template and conversational memory buffer. This file is used for testing purposes.

🔧 chore: update node configuration for ConversationBufferMemory, ChatOpenAI, and LLMChain
📝 docs: update documentation links for ConversationBufferMemory and LLMChain

🔧 fix: update prompt template in LLMChain to include conversation history and text input variables
🔧 fix: update ConversationBufferMemory node to include description and documentation link

🎨 style: format and organize code for better readability and maintainability

🆕 feat(Vector Store): add Vector Store agent and Vector Store Info node

The Vector Store agent allows querying a Vector Store. It can be used to construct an agent from a Vector Store. The Vector Store Info node provides information about a Vector Store.

The Vector Store agent and Vector Store Info node are added to support the functionality of querying a Vector Store.

🔧 chore: update configuration options in the OpenAI API client

The configuration options in the OpenAI API client have been updated. This commit includes changes to the following options:

- `max_tokens`: Removed the `required` flag and set `show` to `true`
- `metadata`: Set `show` to `false`
- `model_kwargs`: Set `show` to `true` and `advanced` to `true`
- `model_name`: Added options `gpt-3.5-turbo-0613`, `gpt-3.5-turbo`, `gpt-3.5-turbo-16k-0613`, `gpt-3.5-turbo-16k`, `gpt-4-0613`, `gpt-4-32k-0613`, `gpt-4`, `gpt-4-32k`
- `n`: Removed the `show` flag
- `openai_api_base`: Added `display_name` as "OpenAI API Base" and updated `info` with additional details
- `openai_api_key`: Removed the `required` flag and set `show` to `true`
- `openai_organization`: Removed the `show` flag
- `openai_proxy`: Removed the `show` flag
- `request_timeout`: Removed the `show` flag
- `streaming`: Removed the `show` flag
- `tags`: Removed the `show` flag
- `temperature`: Removed the `show` flag
- `tiktoken_model_name`: Removed the `show` flag
- `verbose`: Removed the `show` flag

🔧 chore: update configuration for ChatOpenAI and Chroma nodes

The configuration for the ChatOpenAI and Chroma nodes has been updated. This includes changes to the allowed_special, disallowed_special, chunk_size, client, deployment, embedding_ctx_length, and max_retries properties. These changes were made to improve the functionality and performance of the nodes.

🔧 chore(config): update OpenAIEmbeddings-YwSvx configuration options

The OpenAIEmbeddings-YwSvx configuration options have been updated to include new fields and values. This commit updates the configuration file to reflect these changes.

🔧 chore(config): update configuration options for OpenAIEmbeddings and Chroma

🔧 chore(config): update configuration options for OpenAIEmbeddings and Chroma to improve flexibility and customization

🔧 chore: update configuration options for RecursiveCharacterTextSplitter and WebBaseLoader in flow

The configuration options for RecursiveCharacterTextSplitter and WebBaseLoader in the flow have been updated. The changes include:

- Persist Directory - Chroma: The persist directory option for Chroma has been modified.
- Search Kwargs - Chroma: The search kwargs option for Chroma has been modified.
- Chunk Overlap - RecursiveCharacterTextSplitter: The chunk overlap option for RecursiveCharacterTextSplitter has been modified.
- Chunk Size - RecursiveCharacterTextSplitter: The chunk size option for RecursiveCharacterTextSplitter has been modified.
- Separator Type - RecursiveCharacterTextSplitter: The separator type option for RecursiveCharacterTextSplitter has been modified.
- Separator - RecursiveCharacterTextSplitter: The separator option for RecursiveCharacterTextSplitter has been modified.
- Metadata - WebBaseLoader: The metadata option for WebBaseLoader has been modified.
- Web Page - WebBaseLoader: The web page option for WebBaseLoader has been modified.

🔧 chore(OpenAIEmbeddings): update OpenAIEmbeddings configuration options

The OpenAIEmbeddings node configuration options have been updated to include the following changes:
- `allowed_special` and `disallowed_special` now accept a list of values instead of a single value
- `chunk_size` now accepts an integer value
- `deployment` now accepts a string value
- `embedding_ctx_length` now accepts an integer value
- `headers` now supports multiline values
- `max_retries` now accepts an integer value
- `model` now accepts a string value
- `model_kwargs` now accepts code input
- `openai_api_base` now accepts a password input
- `openai_api_key` now accepts a password input
- `openai_api_type` now accepts a password input
- `openai_api_version` now accepts a password input
- `openai_organization` has been removed from the configuration options

🔧 chore: update OpenAIEmbeddings configuration options in the UI

The OpenAIEmbeddings configuration options in the UI have been updated to include the following changes:
- Added the `openai_organization` option to specify the OpenAI organization.
- Added the `openai_proxy` option to configure the OpenAI proxy.
- Added the `request_timeout` option to set the request timeout.
- Added the `show_progress_bar` option to control the visibility of the progress bar.
- Changed the `tiktoken_model_name` option to be a password field.
- Updated the documentation link for OpenAIEmbeddings.

This commit updates the configuration options to improve the usability and functionality of the OpenAIEmbeddings module in the UI.

🔧 chore: clean up unused code and remove unnecessary fields in the configuration file
📝 docs: update documentation link for the Chroma vectorstore module

🔧 chore: update configuration options for RecursiveCharacterTextSplitter in flow

The configuration options for the RecursiveCharacterTextSplitter node in the flow have been updated. The following changes were made:

- `chunk_size` option: The default value has been changed to 1000.
- `separator_type` option: The available options have been updated to include "Text", "cpp", "go", "html", "java", "js", "latex", "markdown", "php", "proto", "python", "rst", "ruby", "rust", "scala", "sol", and "swift".
- `separators` option: The default value has been changed to ".".

These changes were made to improve the usability and flexibility of the RecursiveCharacterTextSplitter node in the flow.

📝 chore(vector_store_grouped.json): add vector_store_grouped.json test data file

🔀 chore(vector_store_grouped.json): add vector_store_grouped.json test data file

🔨 refactor(test_graph.py): reformat import statements and improve code readability
🔨 refactor(test_prompts_template.py): change dynamic attribute to True for input variables, output parser, partial variables, template, and validate template
🔨 refactor(test_template.py): reformat import statements and remove duplicate import of BaseModel
🔨 refactor(test_template.py): update value for options in format_dict test
2023-12-12 16:46:41 -03:00
Gabriel Luiz Freitas Almeida
e3a2abacae Merge remote-tracking branch 'origin/dev' into merge 2023-12-12 15:45:53 -03:00
Gabriel Luiz Freitas Almeida
6084825cbe Refactor code to improve performance and readability 2023-12-12 15:33:35 -03:00
Gabriel Luiz Freitas Almeida
2f8cb0d776 Add new files and update existing files 2023-12-12 15:33:10 -03:00