Stream Parquet File Reader
Learn more about the Stream Parquet File Reader connector and how to use it in the Digibee Integration Platform.
Last updated
Was this helpful?
Learn more about the Stream Parquet File Reader connector and how to use it in the Digibee Integration Platform.
Last updated
Was this helpful?
The Stream Parquet File Reader connector allows you to read Parquet files triggering subpipelines to process each message individually. This connector should be used for large files.
Parquet is a columnar file format designed for efficient data storage and retrieval. For more information, .
Take a look at the configuration parameters of the connector. Parameters supported by are marked with (DB)
.
File Name (DB)
The file name of the Parquet file to be read.
{{ message.fileName }}
String
Parallel Execution
Occurs in parallel with loop execution.
false
Boolean
Fail On Error
If the option is active, the execution of the pipeline with an error will be interrupted. Otherwise, the pipeline execution proceeds, but the result will show a false value for the “success” property.
false
Boolean
Documentation
Section for documenting any necessary information about the connector configuration and business rules.
N/A
String
File Name: file.parquet
Parallel: deactivated
Output:
If the lines have been processed correctly, their respective subpipelines return { "success": true }
for each individual line.