Skip to main content

Pipeline Components

The building blocks of a data pipeline: Sources bring data in, Routers carry it through pipes of Processors that parse and shape it, and Sinks write it out. The live wiring is drawn on the Platform → Configuration page.

In this section

  • Data Sources — the eight source types and how to add one.
  • Processors — writing, testing and debugging an FPL processor.
  • Data Routers — creating routers, assigning processors, and rewiring an existing flow.
  • Data Sinks — where processed data is written.
  • Configuration — the screen reference for the pipeline diagram.
  • Processors — the screen reference for the FPL processor library.
  • FPL reference — the language processors are written in.