CsvToIon
Convert a CSV file into ION.
yaml
type: "io.kestra.plugin.serdes.csv.CsvToIon"Examples
Convert a CSV file to the Amazon Ion format.
yaml
id: csv_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/products.csv
- id: to_ion
type: io.kestra.plugin.serdes.csv.CsvToIon
from: "{{ outputs.http_download.uri }}"
Properties
from *Requiredstring
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
allowExtraCharsAfterClosingQuote booleanstring
Default
falseAllow extra characters after a closing quote
charset string
Default
UTF-8The name of a supported charset
fieldSeparator string
Default
,The field separator character
header booleanstring
Default
trueSpecifies if the first line should be the header
maxBufferSize integerstring
Default
16777216Maximum CSV parser buffer size (bytes)
maxFieldSize integerstring
Default
16777216Maximum field size (characters)
onBadLines string
Default
ERROR Possible Values
ERRORWARNSKIPHow to handle bad lines (e.g., a line with too many fields).
skipEmptyRows booleanstring
Default
falseSpecifies if empty rows should be skipped
skipRows integerstring
Default
0Number of lines to skip at the start of the file
textDelimiter string
Default
"The text delimiter character
Outputs
uri string
Format
uriURI of a temporary result file
Metrics
records counter
Number of records converted