Commit graph

5,801 commits

Author SHA1 Message Date
Phil Miesle
8e55a0e5f4
feat: new AlterMetadataComponent enhances Data and Message objects with dict or Data object entries (#4634)
* creating AddMetadataComponent

* [autofix.ci] apply automated fixes

* fixing lint

* allow removal of metadata fields

* [autofix.ci] apply automated fixes

* Fix the name of alter metadata

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Eric Hare <ericrhare@gmail.com>
2024-11-25 20:48:45 -08:00
Phil Miesle
e439d71bfa
feat: adding list of Data output to Parse Data (#4598)
* adding list of Data output to Parse Data

* [autofix.ci] apply automated fixes

* enabling connection from more List outputs

* [autofix.ci] apply automated fixes

* refactor to have single return type

* [autofix.ci] apply automated fixes

* addressing linting comments

* [autofix.ci] apply automated fixes

* apparently lint was missed...

* sigh

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Eric Hare <ericrhare@gmail.com>
2024-11-25 20:40:59 -08:00
Phil Miesle
c6f27b5af8
Creating BaseFileComponent, integrating with API Request "to file" feature (#4731)
* adding ability for APIRequest to retry and save to a file

* [autofix.ci] apply automated fixes

* adding ability for APIRequest to retry and save to a file

* [autofix.ci] apply automated fixes

* initial refactor of FileComponent to handle Data input

* shifting potentially common logic into BaseFileComponent

* improving readability and fixing problems

* [autofix.ci] apply automated fixes

* addressing linting

* [autofix.ci] apply automated fixes

* linting part 2

* [autofix.ci] apply automated fixes

* linting part 3

* preserve input fields on data objects

* [autofix.ci] apply automated fixes

* ensuring processed data is linked to correct file data object

* [autofix.ci] apply automated fixes

* addressing linting

* [autofix.ci] apply automated fixes

* fixing edge case

* allowing specific failure of missing file without forcing silent_errors

* Base_file mypy errors

* [autofix.ci] apply automated fixes

* Update base_file.py

* Update base_file.py

* Fix starter templates

* Update test_vector_store_rag.py

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Eric Hare <ericrhare@gmail.com>
2024-11-25 20:36:17 -08:00
Phil Miesle
654b44347b
adding ability for APIRequest to retry and save to a file (#4677)
* re-adding ability for APIRequest to retry and save to a file

* [autofix.ci] apply automated fixes

* enabling selective inclusion of httpx headers, along with response header

* [autofix.ci] apply automated fixes

* Update api_request.py

* [autofix.ci] apply automated fixes

* Update test_data_components.py

* Update test_data_components.py

* [autofix.ci] apply automated fixes

* Update api_request.py

* Update api_request.py

* Update api_request.py

* Update api_request.py

* Update api_request.py

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Eric Hare <ericrhare@gmail.com>
2024-11-25 19:58:48 -08:00
Ítalo Johnny
3c83e153ec
chore: remove unused plugin-related code (#4826)
chore: refactor: remove unused plugin-related code
2024-11-26 00:43:40 +00:00
Christophe Bornet
1962e48266
ref: Remove usage of deprecated get_event_loop (#4697)
Remove usage of deprecated get_event_loop
2024-11-26 00:17:29 +00:00
Christophe Bornet
1ba2e0e71b
ref: Add aiofile to do async file operations (#4705)
Add aiofile to do async file operations
2024-11-25 23:50:25 +00:00
Christophe Bornet
598e6bc5ae
ref: Apply ruff rules preview autofix (#4699)
Apply ruff rules preview autofix
2024-11-25 23:42:38 +00:00
Csongor Barabasi
394cc55ab7
fix: Expose chosen model by NotDiamond router (#4833)
* Show the chosen model on the NotDiamond component

* Formatting and linting
2024-11-25 12:23:42 -08:00
Ítalo Johnny
9b50b81e7d
chore: set log level to debug (#4830) 2024-11-25 11:25:43 -08:00
Gabriel Luiz Freitas Almeida
091944095f
chore: Bump package versions for langflow and langflow-base (#4816)
fix: bump package versions to 1.1.1 and 0.1.1 for langflow and langflow-base
2024-11-25 16:14:39 +00:00
Mendon Kissling
aa73e6f19c
fix: swap descriptions for Load Data Flow and Retriever Flow in template (#4814)
fix: swap descriptions for Load Data Flow and Retriever Flow in JSON configuration
2024-11-25 15:24:59 +00:00
Ítalo Johnny
450b371566
fix: raise ImportError instead of silencing AttributeError (#4812)
* fix: raise ImportError instead of silencing AttributeError

* chore: add Message class to init for import standardization

* feat: add exception message pattern check for import errors

* refactor: simplify code
2024-11-25 14:14:57 +00:00
Gabriel Luiz Freitas Almeida
bd15071b33
refactor: updates import statements to use Pydantic in aiml_embeddings.py (#4801)
Fix import statements for Pydantic in aiml_embeddings.py
2024-11-24 09:25:36 +01:00
Karan Vaidya
3e1b22b23f
feat: improve composio oauth experience (#4613) 2024-11-23 15:23:57 +00:00
Christophe Bornet
ab63ddddbd
ref: Use blockbuster package (#4777)
* Use blockbuster package

* Upgrade blockbuster to v1.1
2024-11-23 15:05:56 +00:00
Gabriel Luiz Freitas Almeida
e61fb96504
refactor: Improve error messaging for missing message fields in memory module (#4779)
* Improve error messaging for missing message fields in memory module

* fix: Simplify return statement in NotDiamondComponent's chat result method

* Update .gitignore to exclude all .db files
2024-11-23 13:04:20 +00:00
Csongor Barabasi
ef2199b317
feat: LLM routing integration via NotDiamond (#4543)
* WIP

* Integrate Notdiamond via API call

* Fix frontend lock

* Update

* Update ND integration to use HandleInput for LLM models

* Move NotDiamond out into bundles and add fallback call

* Update src/backend/base/langflow/components/notdiamond/notdiamond.py

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

* Update src/backend/base/langflow/components/notdiamond/notdiamond.py

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

* Update src/frontend/src/icons/NotDiamond/NotDiamondIcon.jsx

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-11-23 12:20:53 +00:00
Gabriel Luiz Freitas Almeida
4620669129
fix: Fix flow addition to session and handle IntegrityError for orphaned flows (#4799)
* Handle IntegrityError specifically when assigning orphaned flows to superuser

* Add missing session.add(flow) to ensure flow is added to the session before commit
2024-11-22 14:05:28 -08:00
Cristhian Zanforlin Lousa
214d5a9f07
feat: add icons to API components and update Python icon SVG (#4794)
* add icons: wikipedia, serpapi, searchapi, glean, python, bing

* update glean icon

* formatting files

*  (create_data.py): add an icon attribute with the value "ListFilter" to improve visual representation of the component
📝 (python_code_structured_tool.py): update the icon attribute value from "🐍" to "Python" for better clarity and consistency

---------

Co-authored-by: anovazzi1 <otavio2204@gmail.com>
2024-11-22 13:13:13 -08:00
Sebastián Estévez
061971f913
chore: Tighten up dependencies (#4792)
* take 1 WIP

* remove firecrawl dep from langflow package, only usage appears to be in langflow-base

* langchain-google-genai to 2.0.1 which is what we have now in the lock file

* widen ranges based on old lock file

* lock
2024-11-22 11:37:17 -08:00
Edwin Jose
230a01973e
fix: validation for tool name (#4790)
validation for tool name

Tool name validation based on open ai Schema for tool names
2024-11-22 18:56:31 +00:00
Phil Miesle
08849b6bab
feat: adds LangChain Fake Embeddings (#4789)
adding LangChain Fake Embeddings

Co-authored-by: Eric Hare <ericrhare@gmail.com>
2024-11-22 18:05:40 +00:00
Phil Miesle
68a0b7d6c6
fix: handle Message in path input in CSVAgentComponent (#4784)
* fixing problem handling path type

* Add type check for 'path.text' in CSV utility function

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-11-22 17:51:39 +00:00
Eric Hare
4ee53f2ea1
FIX: return all attributes in wikidata (#4786) 2024-11-22 17:35:26 +00:00
Edwin Jose
b3b2b2572a
fix: fixes Ollama Embeddings component (#4787)
Update ollama.py

removed unwanted parameter temperature for embedding
2024-11-22 17:10:09 +00:00
anovazzi1
e208776ea2
feat: Add FolderSync icon to UpdateDataComponent in update_data.py (#4753)
* refactor: Add FolderSync icon to nodeIconsLucide in styleUtils.ts

* feat: Add FolderSync icon to UpdateDataComponent in update_data.py

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-11-22 05:37:50 -08:00
Cristhian Zanforlin Lousa
d31fa35586
feat: add Google icons to search-related components (#4760)
 (google_search_api.py): Add icon property to GoogleSearchAPIComponent for better visualization in the UI
 (google_serper_api.py): Add icon property to GoogleSerperAPIComponent for better visualization in the UI
📝 (styleUtils.ts): Add GoogleSearchAPI and GoogleSerperAPI icons to nodeIconsLucide for consistent styling in the frontend.
2024-11-22 09:34:00 -03:00
Cristhian Zanforlin Lousa
13321a3635
feat: rename MetaphorToolkit file to ExaSearchToolkit and update component icons (#4754) 2024-11-22 03:31:27 +00:00
Samuel Matioli
84fa2fcc2f
fix(astradb_tools): sets some options as Advanced and improves descriptions (#4732)
Setting some options as Advanced
2024-11-22 02:25:18 +00:00
Rogério Chaves
1532da59f5
fix: traces inputs and outputs not being sent to tracing services (#4669)
* Fix node inputs not being captured, add runtime inputs as well to be captured by the tracers properly

* Fix outputs missing on traces due to them being reset before ending the traces because of race conditions

* Fallback to project name if none

* Remove 'dynamic inputs' to stop sending the component code every time

* fix: Add async flow name retrieval in graph building process

* fix: Retrieve flow name from database when building graph from data

* Fix: make session.exec call awaitable in chat API

* Refactor `_get_flow_name` to manage session internally

* Refactor session handling to use `async_session_scope` in chat API

* Refactor test cases to remove unnecessary async usage in mock functions

* [autofix.ci] apply automated fixes

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-11-22 01:41:39 +00:00
Edwin Jose
8fb19add81
fix: Error in SerpAPI search: cannot access local variable 'wrapper' where it is not associated with a value (#4758)
Update serp_api.py

fixes:  Error: Error in SerpAPI search: cannot access local variable 'wrapper' where it is not associated with a value
2024-11-21 16:44:14 -08:00
Gabriel Luiz Freitas Almeida
6fe7a58c8d
fix: Add validation for MessageBase type in message input conversion (#4769)
Add validation for MessageBase type in message input conversion
2024-11-21 20:21:33 +00:00
Ítalo Johnny
e728e40561
fix: ensure unique flow names when assigning to superuser and avoid adding starter projects (#4751)
* fix: ensure unique flow names when assigning to superuser

* refactor: Creates a new function with logic to rename flows

* refactor: simplify function

* Extract STARTER_FOLDER constants to a separate module

* Filter orphaned flows by excluding those in the starter folder

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-11-21 09:35:32 -08:00
Gabriel Luiz Freitas Almeida
be7eac9e00
fix: Gracefully handle missing imports for model components (#4743)
* Handle ImportError for langchain_groq in Groq model initialization

* Refactor model input constants to handle missing imports gracefully

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-11-21 16:41:01 +00:00
Gabriel Luiz Freitas Almeida
9450f8529a
fix: Update dependency versions for pydantic to fix sqlmodel conflict (#4755)
Update dependency versions for pydantic in pyproject.toml
2024-11-21 16:01:14 +00:00
Mendon Kissling
3e57340cc4
Fix: simple agent template notes (#4709)
* delete-youtube-template

* update-simple-agent

* update-description

* docs-package-and-yarn-lock

* update-edges

* descriptions-and-markdown

* readme

* tags

* update

hotfix for the tool_kit mode component update

* Update Simple Agent.json

added project tags

* Update Simple Agent.spec.ts

Playwright test update

* Update Simple Agent.spec.ts

* Update starter-projects.spec.ts

remove  youtube flow  from templates in test

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
Co-authored-by: Edwin Jose <edwin.jose@datastax.com>
2024-11-20 15:24:37 -05:00
Gabriel Luiz Freitas Almeida
a0acf39f8a
feat: Add database cleanup functions for transactions and vertex builds (#4694)
* feat: Add configuration options for maximum transactions and vertex builds retention

* Add functions to clean up old transactions and vertex builds in the database

- Implement `clean_transactions` to delete transactions exceeding the configured limit.
- Implement `clean_vertex_builds` to delete vertex builds exceeding the configured limit.
- Integrate cleanup functions into the service initialization process.

* Add error handling and logging for cleanup tasks in utils.py

- Wrap transaction and vertex build cleanup operations in try-except blocks.
- Log success and error messages for cleanup operations.
- Rollback session on exceptions without re-raising, as these are cleanup tasks.
- Adjust service initialization order to ensure proper setup.

* Reorder setup and cleanup tasks in database initialization process

* fix: Update type hints for settings_service in cleanup functions

* Remove execution options in cleanup functions

* Handle specific exceptions during cleanup tasks in utils.py

* Use `col` for column references in delete statements to improve SQL query clarity.
2024-11-19 15:16:36 -08:00
Ítalo Johnny
b978241d16
fix: assign orphaned flows to superuser if auto-login is enabled (#4715)
* fix: assign orphaned flows to superuser if auto-login is enabled

* fix: orphan flow naming

* fix: ruff errors

* fix: orphan flow naming (again)
2024-11-19 13:55:07 -08:00
Junxi (Eric) Li
f1c00750aa
fix: correct issue with Milvus field name, renamed connection password to Token (#4453)
rename connectino password to Token
2024-11-19 12:10:39 -08:00
Jordan Frazier
e7e364eb0d
chore: add deprecation flag on base upload flow route (#4717)
* add deprecation flag on base upload flow route

* add deprecation flag on base upload flow route

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-11-19 12:05:23 -08:00
Gabriel Luiz Freitas Almeida
fb83af224a
chore: Add pyproject.toml configuration to ruff format command in Makefile (#4714)
* Add pyproject.toml config flag to ruff commands in Makefile

* Update ruff exclude path in pyproject.toml

* Remove unused TYPE_CHECKING import from api_key.py

* Remove redundant config flag from 'ruff check' command in Makefile
2024-11-19 19:06:01 +00:00
Cristhian Zanforlin Lousa
9e8715cf4c
fix: enhance folder download endpoint with zip file support (#4706)
* expanding download folder to zip file

* run formatter

* Update src/backend/base/langflow/api/v1/folders.py

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

* changing model to flowRead

* run formatter

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-11-19 18:41:37 +00:00
Gabriel Luiz Freitas Almeida
25a0d7674a
fix: update import for compatibility, format starter projects, fix coroutine call (#4708)
* Use `typing_extensions.override` for compatibility with older Python versions

* Format starter projects

* Fix async call in get_lf_version_from_pypi by adding 'await'
2024-11-19 18:17:32 +00:00
Christophe Bornet
1b39ce6f6e
ref: Make check_langflow_version async (#4701)
Make check_langflow_version async
2024-11-19 15:33:55 +00:00
Thorsten Ph.
67a9fff581
feat: Extend mongodb component with mTLS (#4591)
* Extend mongodb component with mTLS

* [autofix.ci] apply automated fixes

* fix check style errors

* [autofix.ci] apply automated fixes

* bug fix

* Update src/backend/base/langflow/components/vectorstores/mongodb_atlas.py

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

* adjustment for MyPy

* [autofix.ci] apply automated fixes

---------

Co-authored-by: Thorsten Philipp <thorsten.philipp@msg.group>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-11-19 07:13:40 -08:00
Mendon Kissling
a1fa8ec1b6
fix: update Basic Prompting and Vector Store RAG notes (#4644)
* refactor: update README content and add OpenAI API key note in Basic Prompting project

* cleanup-link

* refactor: improve performance of data processing functions

* remove-astradb-setup-notenode

* text-cleanup

* test-linking

* pin-notes

* pin-load-data

* openai-key-locations

* missed-comma

* resize-basic-prompting-readme

* height-and-description-vector-rag

* selected-false

* height-styling

* height

* refactor: update README content and add OpenAI API key note in Basic Prompting project

* cleanup-link

* refactor: improve performance of data processing functions

* remove-astradb-setup-notenode

* text-cleanup

* test-linking

* pin-notes

* pin-load-data

* openai-key-locations

* missed-comma

* resize-basic-prompting-readme

* height-and-description-vector-rag

* selected-false

* height-styling

* height

* basic-prompt

* style

* vector-rag-done
2024-11-19 14:38:44 +00:00
Gabriel Luiz Freitas Almeida
50defedfe6
fix: add a check in ComponentToolkit to avoid building a tool that builds tools (#4678)
* Enhance tool filtering logic by adding TOOL_TYPES set for output type checking

* Rename TOOL_TYPES to TOOL_TYPES_SET for clarity
2024-11-19 13:54:47 +00:00
Edwin Jose
699ec18205
fix: add Groq Model Constants (#4689)
* upddate in groq models

groq models updated

* [autofix.ci] apply automated fixes

* Update model_input_constants.py

remove groq prefix

* Update groq.py

updated Groq Model list to be also a backup list if the API call fails, also at start.

* Update groq.py

format issue solved

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-11-19 05:28:34 -08:00
Jordan Frazier
50aa61826c
fix: is null sql statement (#4690)
* fix is null sql statement

* use == since linter complains about is_

* [autofix.ci] apply automated fixes

* ignore error

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-11-19 05:27:17 -08:00