To Nha Notes | July 16, 2024, 10:38 a.m.
SQLMesh: Efficient data transformation and modeling framework that is backwards compatible with dbt. Check more in the site https://sqlmesh.com/.
Self documenting queries using native SQL Comments
Ability to plan / apply changes similar to Terraform to understand potential impact of changes.
Column-level lineage!
Unit testing, audits, and compile-time error checking.
SDF: A SQL engine and data transformation tool. It ingests data, metadata, and SQL statements to validate business logic, execute queries, and enforce policies.
SDF claims to be significantly faster than dbt in terms of run and compile time performance.
Related to above, it also comes with compile-time error checking.
Comes with a built-in query engine and data governance features for data quality and PII.
While not yet open-source, SDF is expected to release an open-source version in the near future.
Lea (BigQuery Specific): A minimalist alternative to dbt.
Dataform Core (BigQuery specific):
Similar features to dbt core.