langflow/docs/docs/Components/components-processing.md
Mendon Kissling 0d11564dea
docs: v1.1.2 (#5850)
* docs:add-changelog-to-nav

* docs: add OpenRouter component documentation with detailed inputs and outputs

* docs: add Outputs section to components-models documentation for Cohere and Ollama

* docs: update references from configuration-objects to concepts-objects across multiple components and documentation files

* feat: Add DataFrame operations section to components-processing documentation

* title-case-in-nav

* fix-memories-tab-in-chat-memory

* tool-calling-agent-update

* feat: enhance documentation with icon imports and improved instructions for OpenAI component

* material-icon

* fix: update documentation for tool mode input connection in agent component

* add-loop-component

* add-img-for-loop-summary

* feat: add documentation for using logic components in a flow with examples

* fix: enhance documentation for Loop component with detailed data flow explanation

* redirect-for-config-objects-page

* fix: improve error handling in data processing module

* fix: update documentation for Data objects in Loop component and add import statement in memory chatbot tutorial

* quickstart-screenshots

* docs: update starter flow images

* update-agent-screenshots

* move-repl-agent

* docs: enhance global variables documentation and clarify prerequisites for vector store RAG flow

* docs: update Simple Agent to use URL component

* docs: enhance memory chatbot tutorial with example conversation and clarify session ID terminology

* docs: update visibility icon description in concepts-components.md

* Apply suggestions from code review

Co-authored-by: brian-f <brian.fisher@datastax.com>

* correct-playground-sequence-and-typo

---------

Co-authored-by: brian-f <brian.fisher@datastax.com>
2025-01-24 14:24:57 +00:00

5.8 KiB

title slug
Processing /components-processing

Processing components in Langflow

Processing components process and transform data within a flow.

Use a processing component in a flow

The Split Text processing component in this flow splits the incoming data into chunks to be embedded into the vector store component.

The component offers control over chunk size, overlap, and separator, which affect context and granularity in vector store retrieval results.

Combine Text

This component concatenates two text sources into a single text chunk using a specified delimiter.

Inputs

Name Display Name Info
first_text First Text The first text input to concatenate.
second_text Second Text The second text input to concatenate.
delimiter Delimiter A string used to separate the two text inputs. Defaults to a space.

DataFrame operations

This component performs the following operations on Pandas DataFrame:

Operation Description Required Inputs
Add Column Adds a new column with a constant value new_column_name, new_column_value
Drop Column Removes a specified column column_name
Filter Filters rows based on column value column_name, filter_value
Head Returns first n rows num_rows
Rename Column Renames an existing column column_name, new_column_name
Replace Value Replaces values in a column column_name, replace_value, replacement_value
Select Columns Selects specific columns columns_to_select
Sort Sorts DataFrame by column column_name, ascending
Tail Returns last n rows num_rows

Inputs

Name Display Name Info
df DataFrame The input DataFrame to operate on.
operation Operation Select the DataFrame operation to perform. Options: Add Column, Drop Column, Filter, Head, Rename Column, Replace Value, Select Columns, Sort, Tail
column_name Column Name The column name to use for the operation.
filter_value Filter Value The value to filter rows by.
ascending Sort Ascending Whether to sort in ascending order.
new_column_name New Column Name The new column name when renaming or adding a column.
new_column_value New Column Value The value to populate the new column with.
columns_to_select Columns to Select List of column names to select.
num_rows Number of Rows Number of rows to return (for head/tail). Default: 5
replace_value Value to Replace The value to replace in the column.
replacement_value Replacement Value The value to replace with.

Outputs

Name Display Name Info
output DataFrame The resulting DataFrame after the operation.

Filter Data

This component filters a Data object based on a list of keys.

Inputs

Name Display Name Info
data Data Data object to filter.
filter_criteria Filter Criteria List of keys to filter by.

Outputs

Name Display Name Info
filtered_data Filtered Data A new Data object containing only the key-value pairs that match the filter criteria.

Parse JSON

This component converts and extracts JSON fields using JQ queries.

Inputs

Name Display Name Info
input_value Input Data object to filter. Can be a message or data object.
query JQ Query JQ Query to filter the data. The input is always a JSON list.

Outputs

Name Display Name Info
filtered_data Filtered Data Filtered data as a list of data objects.

Merge Data component

This component combines multiple data sources into a single unified Data object.

The component iterates through the input list of data objects, merging them into a single data object. If the input list is empty, it returns an empty data object. If there's only one input data object, it returns that object unchanged. The merging process uses the addition operator to combine data objects.

Inputs

Name Display Name Info
data Data A list of data objects to be merged

Outputs

Name Display Name Info
merged_data Merged Data A single data object containing the combined information from all input data objects

Parse Data

The ParseData component converts data objects into plain text using a specified template. This component transforms structured data into human-readable text formats, allowing for customizable output through the use of templates.

Inputs

Name Display Name Info
data Data The data to convert to text.
template Template The template to use for formatting the data. It can contain the keys {text}, {data} or any other key in the data.
sep Separator The separator to use between multiple data items.

Outputs

Name Display Name Info
text Text The resulting formatted text string as a message object.

Split Text

This component splits text into chunks of a specified length.

Inputs

Name Display Name Info
texts Texts Texts to split.
separators Separators Characters to split on. Defaults to a space.
max_chunk_size Max Chunk Size The maximum length, in characters, of each chunk.
chunk_overlap Chunk Overlap The amount of character overlap between chunks.
recursive Recursive Whether to split recursively.