Enjoying SQL data pipelines with dbt
Matthias Niehoff - 11 months ago
SQL is an indispensable tool in data analysis - it is comparatively easy to learn and uncomplicated to run on a database. Accordingly, it is very popular with many data analysts. In reality, one often finds the pattern: Python glue code in notebooks that executes SQL statements.dbt (data build tool) is a command line tool for building data pipelines in a structured way with SQL.
It also enables the validation of data. And as a result, there are not only tables in a database, but also documentation and dependency graphs. Regular analyses and evaluations can also be conveniently automated. The whole thing not only helps with the preparation of data.
The subsequent regular analyses and evaluations can also be conveniently automated. Including traceability, which analysis uses which data. And if there are errors in the content of the basic data, the evaluations based on it are not even updated. With dbt, even a developer will have fun with SQL & data transformations!
Jobs with related skills
Software Architect (f/m/d)
Dennemeyer Group
·
1 month ago
München, Germany
+2
Hybrid
Senior Back-end Developer (Java) (m/f/x)
ALDI SÜD
·
today
Mülheim an der Ruhr, Germany
Hybrid
Software Engineer DevOps m/w/d
SPIE GmbH
·
5 days ago
Dortmund, Germany
+1
Hybrid
Fullstack TypeScript Developer (w/d/m)
Haufe Group
·
7 days ago
Freiburg im Breisgau, Germany
Hybrid
Related Videos