Pipeline Components

The building blocks of a data pipeline: Sources bring data in, Routers carry it through pipes of Processors that parse and shape it, and Sinks write it out. The live wiring is drawn on the Platform page (v1: Platform → Configuration).

In this section

• Data Sources: the source types and how to add one.
• Processors: writing, testing and debugging an FPL processor.
• Data Routers: creating routers, assigning processors, and rewiring an existing flow.
• Data Sinks: where processed data is written.

Related

• Platform: the screen reference for the pipeline diagram (v1: Configuration).
• Processors: the screen reference for the FPL processor library (v1: Processors).
• FPL reference: the language processors are written in.