Commit graph

664 commits

Author SHA1 Message Date
Gabriel Luiz Freitas Almeida
39cc38e82b
chore: add opensearch-py dependency (#4134)
Add opensearch-py dependency to pyproject.toml
2024-10-14 13:02:56 +00:00
Jordan Frazier
06013ae86a
version: upgrade to 1.0.19 and 0.0.97 (#4104)
* upgrade to 1.0.19 and 0.0.97
2024-10-10 15:15:05 -07:00
Sebastián Estévez
9adf1ef2e5
Feat: Shared Component Cache Service (#4052)
split branch / PR
2024-10-07 20:58:42 -04:00
Ítalo Johnny
5615356a14
chore: update duckduckgo-search to the 6.3.0 (#4056) 2024-10-07 20:22:33 +00:00
Jordan Frazier
b0bda283ff
Revert "release: bump main 1.0.19 and base 0.0.97" (#4044)
Revert "release: bump main 1.0.19 and base 0.0.97 (#4029)"

This reverts commit b4828622bb.
2024-10-07 08:01:43 -07:00
Jordan Frazier
b4828622bb
release: bump main 1.0.19 and base 0.0.97 (#4029)
Bump to version main 1.0.19 and base 0.0.97
2024-10-04 17:24:34 -07:00
Gabriel Luiz Freitas Almeida
54dd81a681
chore: removes Poetry references from pyproject.toml and updates the project metadata (#4019)
* Remove Poetry references from pyproject.toml and update project metadata

* Remove '--no-update' flag from 'uv lock' commands in Makefile

* Add script metadata with Python version and dependencies

* Remove Poetry references and integrate UV setup in CI workflow

* Remove Poetry setup and installation from integration tests workflow

* Remove Poetry references and update workflow to use custom setup action

* Remove references to Poetry from configuration files
2024-10-04 17:24:55 +00:00
Gabriel Luiz Freitas Almeida
4d6fe61e71
chore: Update zep-python dependency to stable version 2.0.0 in pyproject.toml (#4009)
Update zep-python dependency to stable version 2.0.0 in pyproject.toml
2024-10-03 10:25:26 -07:00
João
75ffe0b11b
feat: Add Elasticsearch VectorStore Component with Ingest and Advanced Search Capabilities (#3899)
* feat: adding Elasticsearch  VectorStore component code

* update: adding langchain-elasticsearch dependency

* update: adding langchain-elasticsearch dependency (ruff format fix)

* Add `langchain-elasticsearch` dependency to pyproject.toml

* Refactor type hints to use PEP 585 syntax in Elasticsearch vector store component

* Refactor ElasticsearchVectorStoreComponent for improved readability and error handling

- Consolidated import statements and removed unused imports.
- Reformatted long strings for better readability.
- Enhanced error messages with variable assignment for clarity.
- Removed redundant else clause in search_documents method.

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-10-03 15:41:30 +00:00
Gabriel Luiz Freitas Almeida
6febae599b
tests: update tests to use httpx.AsyncClient (#3984)
* Add async support and dependencies to pyproject.toml files

- Added `asgi-lifespan>=2.1.0` to dependencies.
- Configured `asyncio_mode` and `asyncio_default_fixture_loop_scope` for pytest.
- Updated `tool.uv` section with `asgi-lifespan` in dev-dependencies.

* Convert test fixtures to async and use AsyncClient for HTTP requests

* Handle 'ImportFrom' nodes in AST validation to support module attribute imports

* Convert test cases to use async HTTP client

- Updated test cases in `test_database.py`, `test_endpoints.py`, `test_user.py`, `test_variable.py`, `test_files.py`, `test_chat_endpoint.py`, `test_misc.py`, `test_messages_endpoints.py`, `test_api_key.py`, `test_webhook.py`, and `test_login.py` to use `httpx.AsyncClient` instead of `fastapi.TestClient`.
- Modified test functions to be asynchronous and use `await` for HTTP requests.
- Adjusted fixtures and helper functions to support asynchronous operations.
- Ensured consistency in endpoint paths and request methods across all test cases.

* Refactor string concatenation to f-string in test_chat_endpoint.py

* [autofix.ci] apply automated fixes

* Refactor import validation to use pattern matching for AST nodes

* Set `startup_timeout` and `shutdown_timeout` to `None` in `LifespanManager` for test files.

* Convert test functions to async in `test_messages_endpoints.py`

* Add `api_key_required` marker to assistant component tests

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-10-02 10:21:52 -07:00
Jordan Frazier
e19d90bd6c
ci: fix releases with uv (#3971)
* Update scripts

* update the base dep in uv deps

* update nightly scripts

* Add uv creds for publish

* skip tests for now

* fix version

* only build the wheel

* try again

* add uv to python run

* [autofix.ci] apply automated fixes

* use uv cache

* more version fixe

* fixing versions

* fix base version

* Try no frozen?

* skip everything to try docker build

* tag

* frozen

* separate script for updating uv dep

* [autofix.ci] apply automated fixes

* hardcoded versions

* hardcoded versions

* add version to editable package

* build project before docker file runs

* try again

* fix uv patht o build

* don't know why this would mkae a difference

* debug statements

* debug statements

* debug statements

* change path to whl 🤷

* manually move the wheel...

* make dir

* try no sources

* add back tests

* refactor uv to action

* add uv action

* Update nightly build workflow to include uv lock files in version update commit

* Update lint-py workflow to use specific ref for setup-uv action

* Add checkout step to style-check-py GitHub Actions workflow

* Remove redundant GitHub ref syntax in lint-py.yml workflow

* Update lint-py.yml to use specific ref for setup-uv action

* Update action.yml: standardize quotes and remove redundant checkout step

* Add checkout step to GitHub Actions workflows for specific ref handling

- Introduced `actions/checkout@v4` step to multiple workflows to ensure code is checked out at a specific ref.
- Updated `.github/workflows/docker-build.yml`, `.github/workflows/release_nightly.yml`, `.github/workflows/lint-py.yml`, and `.github/workflows/style-check-py.yml` to include the new checkout step.
- Ensured credentials are persisted during the checkout process.

* Add checkout step to Python test workflow with specific ref

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-10-02 05:37:04 -07:00
João
b9bcb09e63
feat: Add OpenSearch VectorStore Component with Ingest and Search Capabilities (#3799)
* update: adding opensearch-py dependency

* feat: adding OpenSearch icon

* feat: adding OpenSearch VectorStore code

* fix: removing unused methods and adding hybrid search capabilities using search method

* update: poetry lock with recent hash added

* fix: removing unused methods and adding hybrid search capabilities using search method

* fix: default value of search_input to an empty string

* fix: adapting code to match make format script
2024-10-01 21:42:55 +00:00
Patrick Loeber
d19c16462b
fix: enhancements for the AssemblyAI component (#3934)
Enhancements for AssemblyAI component

Co-authored-by: Patrick Loeber <98830383+ploeber@users.noreply.github.com>
2024-10-01 14:28:18 +00:00
Gabriel Luiz Freitas Almeida
bf2aadf6a4
refactor: update dependency versions and streamline backend installation commands (#3939)
* Update Makefile to streamline backend dependency installation commands

* Update dependency versions in pyproject.toml for weaviate-client, httpx, and others

* Update dependency versions in pyproject.toml for better compatibility and stability

* new lock

* refactor: streamline backend dependency installation commands

* update examples formatting
2024-09-26 12:23:26 -07:00
Gabriel Luiz Freitas Almeida
b877bc9e08
fix: Add 'langflow' to workspace configuration (#3935)
Add 'langflow' to workspace configuration in pyproject.toml
2024-09-26 12:07:03 -07:00
Gabriel Luiz Freitas Almeida
31db1267b4
fix: update pyproject.toml to use workspace configuration for langflow-base (#3928)
Update pyproject.toml to use workspace configuration for langflow-base
2024-09-26 05:49:56 -07:00
Jordan Frazier
17cc9bafcd
fix: remove bson import (#3924)
Remove bson import
2024-09-26 11:46:37 +00:00
Sebastián Estévez
fbb097dc4c
chore: uv to replace poetry (#3900)
* uv sync works

* fist stab at Makefile

* uv treatment for langflow-base

* sqlmodel to 0.0.18

* add reinstall_backend to Makefile

* makefile - reinstall_backend fix and unit_test dependency

* fix dev dependencies

* fix dev dependencies

* fix dev dependencies

* lock

* Makefile

* [autofix.ci] apply automated fixes

* Update Makefile

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

* delete update_dependencies

* fix lint

* Remove Poetry lock check from GitHub Actions workflow

* Switch to 'uv' for dependency management and caching in style-check workflow

* Update style-check workflow to use '--only-dev' flag for Ruff check

* Integrate 'uv' package setup and caching in GitHub Actions workflows

* Update version check in GitHub Actions to use 'uv tree' for langflow-base

* Remove redundant poetry environment setup in GitHub Actions workflow

* Add step to minimize uv cache in GitHub Actions workflow

* Update GitHub Actions workflow to use 'uv' for dependency management and caching

* Remove redundant script execution from build_langflow target in Makefile

* [autofix.ci] apply automated fixes

* Switch build system from Poetry to Hatchling and update dependencies

- Replace `poetry-core` with `hatchling` in build-system requirements
- Update `langflow-base` dependency to version `0.0.96`
- Add `tool.hatch.build.targets.wheel` configuration
- Adjust `tool.uv.sources` paths for `langflow-frontend` and `langflow-base`

* update lock

* Switch build system from Poetry to Hatchling in pyproject.toml

* Add langchain-unstructured dependency to pyproject.toml

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-09-25 13:40:30 -07:00
Patrick Loeber
c567323413
feat: add AssemblyAI components (#3829)
* Add AssemblyAI components

* add icons

* [autofix.ci] apply automated fixes

* Add ruff fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-09-25 17:32:03 +00:00
Ítalo Johnny
aaa5cef20a
fix: duckduckgo-search (#3857) 2024-09-19 14:09:47 +00:00
Sebastián Estévez
88443932c1
chore: bump astra-assistants to v2.1.2 (#3841)
bump astra-assistants to v2.1.2
2024-09-18 11:20:04 -04:00
Cristhian Zanforlin Lousa
8c8be151e5
feat: add duckduckgo search component (#3798)
* 🔧 (pyproject.toml): add duckduckgo-search dependency to the project
 (DuckDuckGoSearchRun.py): introduce DuckDuckGoSearchComponent for performing web searches using DuckDuckGo search engine
 (DuckDuckGo.jsx): add SVG icon for DuckDuckGo
 (index.tsx): create DuckDuckGoIcon component for displaying DuckDuckGo icon
🔧 (styleUtils.ts): import DuckDuckGoIcon for nodeIconsLucide in styleUtils

* 📝 (DuckDuckGoSearchRun.py): remove unnecessary whitespace to improve code readability and consistency

*  (DuckDuckGoSearchRun.py): Add retry logic to DuckDuckGo search component for rate-limited requests
📝 (DuckDuckGoSearchRun.py): Update component description to reflect the addition of retry logic
📝 (DuckDuckGoSearchRun.py): Add new inputs for max_retries and initial_delay to configure retry behavior
📝 (DuckDuckGoSearchRun.py): Update search_response method to use search_with_retry method with retry logic
📝 (DuckDuckGoSearchRun.py): Update format_results method to handle formatted results
📝 (DuckDuckGoSearchRun.py): Add search_with_retry method to handle search with retry logic
📝 (DuckDuckGoSearchRun.py): Update search_response method to use search_with_retry method
📝 (DuckDuckGoSearchRun.py): Update search_response method to set status messages
📝 (DuckDuckGoSearchRun.py): Handle exceptions and set appropriate status messages in search_response method
 (duckduckgo.spec.ts): Add integration test for DuckDuckGo search component in frontend

* 📝 (DuckDuckGoSearchRun.py): add newline at the end of the file to follow best practices and avoid potential issues with some tools that expect it

* [autofix.ci] apply automated fixes

* updating duckudckgo

* [autofix.ci] apply automated fixes

*  (DuckDuckGoSearchRun.py): Refactor DuckDuckGoSearchComponent to use pydantic BaseModel for schema definition and improve code structure for better readability and maintainability. Add support for result limiting in search functionality.

* 🔧 (DuckDuckGoSearchRun.py): Remove unnecessary import and update status message for DuckDuckGo Search Tool to improve clarity

* [autofix.ci] apply automated fixes

*  (duckduckgo.spec.ts): update test selectors for duckduckgo search component to match changes in the frontend code and improve test reliability

* 🐛 (linkComponent.spec.ts): fix an issue where the key combination for selecting all text was not working correctly on Mac devices. Updated the key combination to use the correct modifier key based on the user's operating system.

* 📝 (frontend): mark is-unicode-supported package as extraneous in package-lock.json

* rollback lock file

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-09-17 16:39:17 -03:00
Ítalo Johnny
f18c4e9079
chore: bump langflow versions (#3765) 2024-09-11 19:20:13 -03:00
Christophe Bornet
7273a6e78a
feat: Add CassandraGraphVectorStoreComponent and HtmlLinkExtractorComponent (#3757)
* Add CassandraGraphVectorStoreComponent and HtmlLinkExtractorComponent

* Move uuid import to global imports

* fix test with new text spliter

* update poetry lock

* ci: add continue-on-error to py_autofix.yml

---------

Co-authored-by: Ítalo Johnny <italojohnnydosanjos@gmail.com>
Co-authored-by: anovazzi1 <otavio2204@gmail.com>
2024-09-11 14:56:25 -03:00
Ítalo Johnny
bf640be53f
fix: disables langfuse_plugin code (#3745) 2024-09-10 19:01:21 +00:00
Christopher Bradford
ce11df2a94
feat: add support for DataStax HCD vector store (#3728) 2024-09-09 12:03:25 -03:00
Jordan Frazier
7b3e51f769
ci: create a nightly build workflow (#3553)
* test poetry install

* Add nightly builds workflow

* remove old comments and fix poetry

* remove old debug statement

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-09-05 19:13:04 +00:00
Gabriel Luiz Freitas Almeida
aaaf6f3784
refactor: replace get_actions call with get_tools in Composio Component (#3684)
* refactor: update deprecated call to get_actions

* Update composio-langchain dependency to version 0.5.13 in pyproject.toml

* Downgrade `composio-langchain` dependency to version `0.5.9` in `pyproject.toml`

* Add missing import for CustomComponent in test_custom_component.py
2024-09-04 21:16:36 +00:00
Eric Hare
de1fdff742
feat: Switch to API for Unstructured Component (#3671)
* FEAT: Switch to API for Unstructured Component

* chore: new lock

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-09-04 05:51:52 -07:00
Marcelo Nunes Alves
d93c90760a
feat: add component clickhouse for vector database (#3657)
* fix: Problem in the description field when using the MariaDB or MySQL database.

* fix: Problem in the description field when using the MariaDB or MySQL database.

* fix: Add the migration script to update description columns type.

* [autofix.ci] apply automated fixes

* Update src/backend/base/langflow/alembic/versions/1d90f8a0efe1_update_description_columns_type.py

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>

* feat: add component clickhouse for vector database

* feat: add component clickhouse for vector database - conflicts resolved

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* feat: add component clickhouse for vector database - conflicts resolved

* feat: add component clickhouse for vector database - update poetry

* feat: add component clickhouse for vector database - conflicts resolved

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-09-04 05:33:30 -07:00
Nicolò Boschi
1c7ef6ee60
feat: add Parse JSON component (#3167)
* feat: add Parse JSON component

* feat: Update ParseJSONDataComponent to handle JSON decoding errors

* fix tests

* [autofix.ci] apply automated fixes

* add string check in _parse_data

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-09-03 16:36:30 +00:00
Cristhian Zanforlin Lousa
706d559003
fix: update Self Query Retriever Component (#3653)
* 🔧 (pyproject.toml): add lark dependency to support parsing and processing of grammars in the project
♻️ (SelfQueryRetriever.py): refactor input types in metadata fields to improve clarity and maintainability

* 📝 (SelfQueryRetriever.py): Update class name and imports for consistency and clarity
📝 (SelfQueryRetriever.py): Refactor input and output definitions for better readability and maintainability
📝 (SelfQueryRetriever.py): Refactor method signatures and variable names for improved code organization and understanding

* [autofix.ci] apply automated fixes

* ♻️ (SelfQueryRetriever.py): Remove unused import 'VectorStore' to clean up the code and improve maintainability.

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-09-02 20:19:37 +00:00
Nicolò Boschi
96872f3aa5
chore: refactor and add components integration tests (#3607)
* improve inegration tests

* add fixes

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-09-02 15:21:47 +02:00
Gabriel Luiz Freitas Almeida
e790925b75
feat(pyproject.toml): update langchain-google-vertexai, langchain-groq, langchain-pinecone, and langchain-mistralai versions to the latest available (#3604)
* feat(pyproject.toml): update langchain-google-vertexai, langchain-groq, langchain-pinecone, and langchain-mistralai versions to the latest available

update markdown and upstash-vector versions

* [autofix.ci] apply automated fixes

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-31 14:40:29 -07:00
Gabriel Luiz Freitas Almeida
15bb39ac9c
chore: Remove PDF extra from unstructured dependency because of pytorch (#3633)
Remove PDF extra from unstructured dependency in pyproject.toml
2024-08-30 13:26:04 -07:00
Eric Hare
1ed5ce8e26
fix: Dependency update for unstructured component (#3552)
* FIX: Dependency update for unstructured component

* [autofix.ci] apply automated fixes

* Add nltk download script

* chore(pyproject.toml): move nltk_setup script definition to [tool.poetry.scripts] section for better organization and readability

* [autofix.ci] apply automated fixes

* Make nltk resource downloading part of run

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes

* Use logger for nltk messages

* Move the download resources function

* [autofix.ci] apply automated fixes

* Move nltk resource download

* [autofix.ci] apply automated fixes

* Update main.py

* Update poetry lock

* Update main.py

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-08-30 06:48:36 -07:00
Jordan Frazier
1a0bc3b968
fix: update astra assistants version (#3602)
fixes issue with tree-sitter-python on m1 macs
2024-08-28 12:30:23 -07:00
Himanshu Dixit
9e7c2d0100
feat: bump composio version (#3586)
feat: bump composio
2024-08-28 05:00:31 -07:00
anovazzi1
03e95d4522
feat: add notion integration components (#3579) 2024-08-27 22:01:43 -03:00
Gabriel Luiz Freitas Almeida
c92bea64c4
chore: bump langflow versions (#3570) 2024-08-27 05:57:32 -07:00
Ítalo Johnny
f19aceb520
fix: no module named 'psycopg2' (#3526)
* fix: add dependecy to Dockerfile

* fix: revert quick fix

* fix: update poetry.lock
2024-08-23 19:00:50 +00:00
Himanshu Dixit
b623854ac1
feat: bump composio version in pyproject (#3510)
* feat: bump composio version

* [autofix.ci] apply automated fixes

* chore(poetry.lock): update Poetry version from 1.8.2 to 1.8.3
chore(poetry.lock): remove milvus_lite-2.4.9-py3-none-manylinux2014_aarch64.whl package from lock file

* [autofix.ci] apply automated fixes

* fix(poetry.lock): update Poetry version from 1.8.2 to 1.8.3 to reflect the actual version used

---------

Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2024-08-23 11:59:14 +00:00
Gabriel Luiz Freitas Almeida
9d5f97acf2
chore: remove locust dependency (#3513)
Remove it so we don't have flask-cors as a dependency because of a vulnerability
2024-08-22 20:44:05 +00:00
Gabriel Luiz Freitas Almeida
091baf7f33
build: Update litellm version to 1.44.1 and content hash in poetry.lock (#3507) 2024-08-22 19:05:53 +00:00
Gabriel Luiz Freitas Almeida
300e79f70c
build: Update langflow-base and langflow versions to 0.0.94 and 1.0.16 respectively. (#3455) 2024-08-21 18:07:32 -07:00
Gabriel Luiz Freitas Almeida
1e7565ee9f
chore: lock boto3 version and update langchain versions (#3448)
* build: Update boto3 version to 1.34.162.

* ci(langchain-aws): Bump version to ^0.1.16.

* build: Update langchain-anthropic and langchain-openai versions.

* chore: set new lock file
2024-08-20 06:20:28 -07:00
Gabriel Luiz Freitas Almeida
9035f1194f
ci: Update pytest configuration and add pytest-flakefinder. (#3330) 2024-08-14 14:29:03 +00:00
Jordan Frazier
120786fe38
dep: lock psycopg to 3.1.19 (#3292) 2024-08-13 12:29:36 -07:00
William Espegren
7a36cc9ebf
feat: add Spider Web Scraper & Crawler (#2439)
* spider files

* rebuild required

* add spider-client here

* Feat: Spider Web Crawler & Scraper

* Feat: spider integration

* new input not working

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* fix: add outputs and configure build method

* style: run ruff

* Refactor SpiderTool to use 'crawl' instead of 'build' for generating Markdown content

* chore: add type ignore

* chore: new lock

* chore: Update mem0ai dependency to version 0.0.5

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <gabriel@langflow.org>
2024-08-08 05:53:05 -07:00
Gabriel Luiz Freitas Almeida
a2c98b90c1
chore: bump version to 1.0.15 and update langflow-base version to 0.0.93 (#3233)
* bump: update langflow-base version to 0.0.93 in pyproject.toml

* chore: bump version to 1.0.15 in pyproject.toml
2024-08-07 14:39:29 -07:00