Skip to content

source database

Defines the driver used to read the source data and the connection string for that driver. Valid driver values are:

  • csv
  • postgresql (native libpq)
  • psql-odbc (PostgreSQL over ODBC)
  • mariadb
  • sqlserver

The csv driver only requires a path to the directory containing the CSV files. The postgresql and mariadb drivers take a key=value space-separated connection string — see cdm database for the full format, which is identical between source and CDM blocks. The psql-odbc and sqlserver drivers use ODBC connection strings in the semicolon-separated format — see Drivers.

Example

source database {
  driver: "csv"
  connection string: "/etc/etl-engine.d/db/"
}

If you use the csv driver, drop the source CSV files into etc/etl-engine.d/db/. Each path may be absolute or relative; relative paths resolve against the location of etl.conf.