SDF is a next-generation build system for data infrastructure that compiles all data contracts, queries, and policies at once to build code-level, time-level, and access-level dependencies.
Key features and advantages include:
-
Scalability: SDF is the first scalable build system for data infrastructure.
-
Local execution: SDF enables local execution of SQL development with intelligent workflows and data governance packed into 60MB of Rust-based magic.
-
Data governance: SDF enables precise column-level lineage analysis that generates a full-featured data catalog out of the box.
-
Easy to use: SDF is a powerful and easy-to-use data development platform that enables organizations at any scale to fully leverage their data while respecting all relevant policies and protections.
-
Cloud-based: SDF runs its soon-to-be open-source engine in the cloud to take your deployments from a single command to an automatically scheduled workflow with policies enforced in real-time.
Use cases for SDF involve various data-related activities:
-
Build code-level, time-level, and access-level dependencies for data infrastructure.
-
Compile data contracts, queries, and policies at once to streamline SQL development.
-
Generate a full-featured data catalog out of the box with precise column-level lineage analysis.
-
Enable organizations at any scale to fully leverage their data while respecting all relevant policies and protections.
-
Schedule workflows with policies enforced in real-time.
mailto:[email protected],https://twitter.com/SDFLabs