Commit graph

2,252 commits

Author SHA1 Message Date
Gabriel Luiz Freitas Almeida
b548a642ff 🔥 refactor(schemas.py): remove commented out code for PredictRequest schema
The commented out code for the PredictRequest schema has been removed as it is no longer needed and only adds clutter to the file.
2023-06-22 19:04:48 -03:00
Gabriel Luiz Freitas Almeida
d5d6f7be57 🔨 refactor(schemas.py): rename PredictRequest to InputRequest and remove message field, add TweaksRequest and UpdateTemplateRequest
 feat(schemas.py): add ProcessResponse schema to represent the response of the process endpoint
The PredictRequest schema has been renamed to InputRequest to better reflect its purpose. The message field has been removed as it is not needed. TweaksRequest has been added to represent the request body for the tweaks endpoint. UpdateTemplateRequest has been added to represent the request body for updating a template. ProcessResponse has been added to represent the response of the process endpoint, which returns a dictionary as the result.
2023-06-22 19:04:19 -03:00
Gabriel Luiz Freitas Almeida
bfef9495f1 feat(vector_store.py): add support for initializing Pinecone and ChromaDB objects from existing indexes
The code has been refactored to improve readability by adding type hints and reformatting the code. The initialize_pinecone and initialize_chroma functions have been updated to support initializing objects from existing indexes. If there are no docs in the params, the functions will return an existing index. If there are docs in the params, the functions will create a new index. The initialize_qdrant function has not been changed.
🔨 refactor(vector_store.py): improve code readability by adding type hints and reformatting code
2023-06-22 19:03:53 -03:00
Gabriel Luiz Freitas Almeida
60886a93c4 🔨 refactor(process.py): remove unused imports and variables, simplify get_result_and_thought function
This commit removes unused imports and variables from the process.py file. The get_result_and_thought function has been simplified to take a dictionary of inputs instead of a single message string. The function now returns the output of the langchain_object instead of a tuple of result and thought.
2023-06-22 19:03:35 -03:00
Gabriel Luiz Freitas Almeida
2c44cde2e0 🚀 feat(memories.py): add input_key and output_key fields to MemoryFrontendNode template
The MemoryFrontendNode template now includes two new fields, input_key and output_key, which are string fields that are not required and are shown in the advanced section of the template. These fields can be used to specify the input and output keys for the memory node.
2023-06-22 19:03:05 -03:00
Gabriel Luiz Freitas Almeida
176738987b 🔀 refactor(endpoints.py): rename predict_flow endpoint to process_flow and update its functionality
🔀 refactor(constants.tsx): update BASE_API_URL to reflect the changes in the predict_flow endpoint name
The predict_flow endpoint has been renamed to process_flow to better reflect its functionality. The inputs are now passed as a dictionary instead of a PredictRequest object. The tweaks parameter is now optional and is passed as a dictionary. The response model has been updated to reflect the changes in the response. The BASE_API_URL constant in constants.tsx has been updated to reflect the changes in the endpoint name.
2023-06-22 18:57:17 -03:00
Gabriel Luiz Freitas Almeida
141c55643d 🚀 feat(vectorstores.py): add support for Pinecone vector store type
The VectorStoreFrontendNode class now supports the Pinecone vector store type. Two new fields, pinecone_api_key and pinecone_env, have been added to the extra_fields list. The add_extra_fields method has been updated to add these fields to the template if the type_name is Pinecone. The add_field method has been updated to add all fields in the extra_fields list to the template. The add_field method has also been updated to remove the text_key field if the field name is "text_key". Finally, the fields list has been updated to include the new fields.
2023-06-22 14:56:25 -03:00
Gabriel Luiz Freitas Almeida
228127289b 🚀 feat(config.yaml): add GitLoader and Pinecone to documentloaders and vectorstores respectively
GitLoader is added to documentloaders to allow loading of documents from a Git repository. Pinecone is added to vectorstores to allow for vector similarity search. These additions improve the functionality of the application by allowing for more diverse sources of data and more efficient search capabilities.
2023-06-22 13:51:53 -03:00
Gabriel Luiz Freitas Almeida
1a0d448e82 🚀 feat(validate.py): remove unused imports and endpoint for node validation
🚀 feat(base.py): update import statement for loading module
🚀 feat(vector_store.py): add initialization functions for pinecone, chroma, and qdrant
The unused imports and endpoint for node validation were removed from validate.py. The import statement for the loading module was updated in base.py. Initialization functions for pinecone, chroma, and qdrant were added to vector_store.py to allow for the creation of objects from the respective services.
2023-06-22 13:51:18 -03:00
Gabriel Luiz Freitas Almeida
1e61500f38 🚀 feat(chains.py): add return_source_documents field to template
The `return_source_documents` field is added to the template as a boolean field. It is not a required field and is set to `True` by default. This field is used to determine whether the source documents should be returned or not. It is displayed in the frontend and can be toggled by the user.
2023-06-22 13:48:44 -03:00
Gabriel Luiz Freitas Almeida
9ecba59d81 🔥 chore(types.py): remove unused _built_object_repr method from VectorStoreVertex
The _built_object_repr method was not being used and was therefore removed to improve code readability and maintainability.
2023-06-22 13:48:21 -03:00
Gabriel Luiz Freitas Almeida
796ce298f6 feat(documentloaders.py): add metadata field to document loader template
The function build_template was renamed to build_file_field to improve naming consistency. A metadata field of type dict was added to the document loader template to allow for additional information to be passed along with the document. The format_field method was updated to show the metadata field when it is present.
🔨 refactor(documentloaders.py): rename build_template function to build_file_field for better semantics
2023-06-22 13:47:43 -03:00
Gabriel Luiz Freitas Almeida
b8141dca7d 🚀 feat(loading.py): move loading into initialize module
📝 docs(initialize): add empty __init__.py file to initialize directory
The initialize directory was added to the project, but it was missing an __init__.py file. This file is necessary to make the directory a package and allow importing modules from it. An empty __init__.py file was added to the directory to fix this issue.
2023-06-22 13:45:04 -03:00
Gabriel Luiz Freitas Almeida
2854633814 🔥 refactor(API): remove unused postValidateNode function
The postValidateNode function is not used in the codebase and has been removed to improve code readability and maintainability.
2023-06-22 11:45:55 -03:00
Gabriel Luiz Freitas Almeida
e5c6c92ecc feat(frontend): add Pinecone icon to nodeIcons
A new PineconeIcon component was added to the nodeIcons object in utils.ts. This allows the Pinecone icon to be used in the frontend application. The icon was added to improve the visual representation of the Pinecone node in the application.
2023-06-22 11:45:44 -03:00
Gabriel Luiz Freitas Almeida
a534fa9337 Merge remote-tracking branch 'origin/main' into multipart_endpoint 2023-06-21 18:21:35 -03:00
Gabriel Luiz Freitas Almeida
96bce3da81 🐛 fix(utils.py): remove file extension from saved file name
🐛 fix(process.py): correctly update template_data with tweak_value
The file extension is no longer included in the saved file name to avoid issues with file extensions that may not be supported. In process.py, the tweak_value is now correctly updated in the template_data dictionary. The key is now set to "value" for all tweaks except for "file_path" where the key is set to the name of the tweak.
2023-06-21 17:45:12 -03:00
Gabriel Luiz Freitas Almeida
3781f1ddda 🔨 refactor(loading.py): extract persist parameter from params for Chroma vector store instantiation
 feat(loading.py): add persist parameter to Chroma vector store instantiation to enable persistence of vector store
The persist parameter is now extracted from the params dictionary before instantiating the Chroma vector store. This improves readability and reduces the complexity of the code. The persist parameter is now added to the Chroma vector store instantiation to enable persistence of the vector store. This allows the vector store to be reused across multiple sessions, improving performance and reducing the time required to load the vector store.
2023-06-21 17:27:57 -03:00
Gabriel Luiz Freitas Almeida
b7eab50672 🚀 feat(vectorstores.py): add support for Chroma vector store type
🐛 fix(vectorstores.py): add persist field to Weaviate vector store type
The `VectorStoreFrontendNode` class now supports the Chroma vector store type. A new boolean field `persist` has been added to the Chroma vector store type. The `add_extra_fields` method has been updated to add the `persist` field to the Chroma vector store type. The `format_field` method has been updated to include the `persist` field in the basic fields. Additionally, the `add_extra_fields` method has been updated to add the `weaviate_url` field to the Weaviate vector store type.
2023-06-21 17:27:40 -03:00
Gabriel Luiz Freitas Almeida
100833f40f
🔖 chore(pyproject.toml): bump version to 0.1.7 (#528) 2023-06-21 19:19:20 +00:00
Gabriel Luiz Freitas Almeida
dbbba573e3 style: formatting 2023-06-21 16:18:31 -03:00
Gabriel Luiz Freitas Almeida
860c36146e 🎨 style(documentloaders.py): fix indentation and formatting issues
The changes in this commit are purely cosmetic. The indentation and formatting issues in the code have been fixed to improve readability and maintainability.
2023-06-21 16:18:11 -03:00
Gabriel Luiz Freitas Almeida
3d49b67e3d
Merge branch 'main' into release 2023-06-21 19:17:22 +00:00
Gabriel Luiz Freitas Almeida
c1bb928451 🔖 chore(pyproject.toml): bump version to 0.1.7
The version number has been updated from 0.1.6 to 0.1.7 to reflect the changes made in the package. This is a chore commit as it does not add any new features or fix any bugs, but rather updates the version number.
2023-06-21 16:16:29 -03:00
Gabriel Luiz Freitas Almeida
e0d9b21d28
Update LangChain to the latest version (#527) 2023-06-21 19:13:02 +00:00
Gabriel Luiz Freitas Almeida
10db240a6b 🐛 fix(custom.py): rename QueryCheckerTool to QuerySQLCheckerTool to match the correct class name
The QueryCheckerTool class was renamed to QuerySQLCheckerTool to match the correct class name. This change ensures that the correct class is being used and avoids any potential errors that may arise from using the wrong class name.
2023-06-21 16:08:37 -03:00
Gabriel Luiz Freitas Almeida
19a5eb0467
Merge branch 'main' into release 2023-06-21 19:02:26 +00:00
Gabriel Luiz Freitas Almeida
2650cb013c 🔼 chore(pyproject.toml): bump package version to 0.1.6
The langchain dependency has been updated to version 0.0.208 to ensure compatibility with the latest version of the package. The package version has been bumped to 0.1.6 to reflect the changes made.
🔼 chore(pyproject.toml): update langchain dependency to version 0.0.208
2023-06-21 15:55:13 -03:00
Gabriel Luiz Freitas Almeida
b6c10206e2 📦 chore(pyproject.toml): add appdirs package to dev dependencies
The appdirs package is added to the dev dependencies to support the development of the application.
2023-06-21 15:44:02 -03:00
Gabriel Luiz Freitas Almeida
bdd2076deb 🔒 chore(loading.py): remove code that deletes files after loading in instantiate_documentloader function
The save_uploaded_file function now uses the folder_name parameter instead of file_name to improve semantics. The appdirs library is now used to get the user cache directory and a folder for langflow cache is created. The sha256 hash of the file content is now used as the file name to avoid collisions and improve security. A folder is now created for each flow_id in the save_uploaded_file function. The code that deletes files after loading in the instantiate_documentloader function has been removed as it is unnecessary and can cause issues.
🐛 fix(endpoints.py): change file_name parameter to folder_name in save_uploaded_file function
🔒 chore(utils.py): use appdirs to get user cache directory and create a folder for langflow cache
🔒 chore(utils.py): use sha256 hash of file content as file name to avoid collisions and improve security
🔒 chore(utils.py): create folder for each flow_id in save_uploaded_file function
2023-06-21 15:43:27 -03:00
Gabriel Luiz Freitas Almeida
59deed4009 🔨 refactor(inputFileComponent): remove unused flows and tabIndex variables, use tabId instead
The flows and tabIndex variables were not being used in the component, so they were removed. The tabId variable from the TabsContext is now being used instead to upload the file to the correct tab.
2023-06-21 13:42:52 -03:00
Gabriel Luiz Freitas Almeida
a42b6587c5 🔧 chore(config.yml): update Swagger API overview and paths
The Swagger API overview and paths have been updated to reflect the latest changes in the API. The changes include adding support for a new environment variable, `process.env.PORT`, to allow the application to run on a configurable port. Additionally, the Swagger API documentation has been updated to reflect the latest API version and routes.

🔍 chore(links): update links to use HTTPS instead of HTTP
The links were updated to use HTTPS instead of HTTP to improve security and prevent potential man-in-the-middle attacks.

🚨 fix(Openapi.json): fix invalid JSON syntax by removing trailing comma
The Openapi.json file had an invalid JSON syntax due to a trailing comma in the "file_path" field. This commit removes the trailing comma to fix the syntax error.

🔥 chore(test_graph.py): remove unnecessary comments and assertions
🚀 feat(test_graph.py): add file creation and deletion to test_file_tool_node_build and test_toolkit_node_build
The comments and assertions that were removed were unnecessary and did not add any value to the code. The test_file_tool_node_build and test_toolkit_node_build tests now create a file and delete it after the test is run. This ensures that the tests are self-contained and do not leave any artifacts behind.
2023-06-21 11:17:48 -03:00
Gabriel Luiz Freitas Almeida
66ee979c0b
feat: add support for DirectoryLoader (#520) 2023-06-21 13:57:30 +00:00
Gabriel Luiz Freitas Almeida
a9816b6dd7
Hotfix: keep focus on chat input (#521) 2023-06-21 13:47:41 +00:00
Gabriel Luiz Freitas Almeida
f92155e68d update lock 2023-06-21 10:37:05 -03:00
Gabriel Luiz Freitas Almeida
57f322a0e6 🔥 refactor(endpoints.py): rename client_id to flow_id in create_upload_file endpoint
 feat(endpoints.py): add UploadFileResponse schema to standardize upload file response
The client_id parameter in the create_upload_file endpoint has been renamed to flow_id to improve semantics. The UploadFileResponse schema has been added to standardize the response of the create_upload_file endpoint. The response now includes the flowId and file_path fields.
2023-06-21 10:33:33 -03:00
Gabriel Luiz Freitas Almeida
c26ecd3bda 🔥 refactor(base.py): remove unused import statement
The import statement for cache_utils in base.py was not being used and has been removed.
2023-06-21 10:29:36 -03:00
Gabriel Luiz Freitas Almeida
5ad0bc6b65 🐛 fix(endpoints.py): add try-except block to handle exceptions when saving uploaded files
 feat(utils.py): remove unused functions and add docstring to save_uploaded_file function
The try-except block in the create_upload_file function handles exceptions that may occur when saving uploaded files. The save_uploaded_file function now has a docstring that explains its purpose and returns the path to the saved file. The unused functions save_cache and load_cache have been removed.
2023-06-21 10:27:56 -03:00
Gabriel Luiz Freitas Almeida
a81a99f1c4 🎨 style(inputFileComponent): refactor file upload to use a separate function
The file upload functionality has been refactored to use a separate function called uploadFile, which is imported from the API controller. This improves the separation of concerns and makes the code more modular.
2023-06-21 10:21:20 -03:00
Gabriel Luiz Freitas Almeida
5216b519e0 🚀 feat(API): add uploadFile function to upload files to the server
The uploadFile function allows the user to upload a file to the server. It takes in a file and an ID of the flow to upload the file to. The function creates a FormData object and appends the file to it. It then sends a POST request to the server with the FormData object as the body. The server responds with a Promise containing the response data.
2023-06-21 10:21:05 -03:00
Gabriel Luiz Freitas Almeida
0d7df8a330 🚀 feat(api): add UploadFileTypeAPI type definition
This commit adds a new type definition for the UploadFileTypeAPI, which includes a single property file_path of type string. This type will be used to define the response of an API endpoint that handles file uploads.
2023-06-21 10:20:48 -03:00
Gabriel Luiz Freitas Almeida
1489da241d update lock 2023-06-21 10:09:02 -03:00
Gabriel Luiz Freitas Almeida
0dd16ee794 Merge remote-tracking branch 'origin/dev' into multipart_endpoint 2023-06-21 10:07:14 -03:00
anovazzi1
3fa6f63fc4 update version 2023-06-20 20:54:56 -03:00
anovazzi1
ce66d753e2 feat(chatInput): add useEffect hook to focus on chat input when lockChat is false and inputRef is available
fix(chatInput): remove unnecessary comment in useEffect hook
2023-06-20 20:49:32 -03:00
Valerio Capozio
372463912c feat: add support for DirectoryLoader 2023-06-20 23:51:41 +02:00
Gabriel Luiz Freitas Almeida
2029b08d2e Merge remote-tracking branch 'origin/main' into dev 2023-06-20 16:18:37 -03:00
Rodrigo Nader
ba7157f155
Fix remove api key condition (#518)
Condition was reversed.
2023-06-20 16:17:43 -03:00
anovazzi1
8f86acecb0
zoom out 10x bigger (#517)
increase the zoom out limit of the flow
2023-06-20 16:14:18 -03:00
Gabriel Luiz Freitas Almeida
1c7485bb64 🔖 chore(pyproject.toml): bump version to 0.1.5
The version number has been updated from 0.1.4 to 0.1.5 to reflect the changes made in the package. This is a chore commit as it does not add any new features or fix any bugs, but rather updates the version number.
2023-06-20 16:12:47 -03:00