On-prem files - New lines in CSV file trigger

This trigger picks up new lines added to the end of a selected CSV file. Lines from the file will be processed in batches in each job.

When the recipe is first started, the trigger will pick up all existing lines in the selected CSV file. Subsequently, new lines added to the end of the file will be processed as new jobs. This trigger checks for new lines once every poll interval.

New lines in CSV file trigger

Input fields

Input field	Description
CSV file	First, select a CSV file to process lines from. This CSV file must have a header line. The value of each column in the header will be used to generate the output schema of the trigger.
Column delimiter	Next, select a column delimiter for this selected CSV file. The delimiters available are: comma, semicolon, space, and tab.
Batch size	Determine the number of lines to process in each job. The default value is 100 and maximum is 2000. Select a batch size based on the limit of your destination application.

Output fields

Output field	Description
First line number in batch	Line number of the first line in the batch currently being processed. Header lines are not processed, so the first line has the value 1.
Last line number in batch	Line number of the last line in the batch currently being processed. Header lines are not processed, so the first line has the value 1.
CSV lines	This is a list type datapill that contains the data of all lines in the batch. Columns of the selected CSV file will be available as datapills here.