Announcement

🛠️ Introducing the Data Product Builder

Write what you want as a data contract, then ask your coding agent to build it. The Data Product Builder brings contract-driven development to data products: Claude Code, OpenAI Codex, or GitHub Copilot CLI implement the data product in minutes, fully compliant with your conventions, fully integrated with Entropy Data.

The Data Product Builder in action.

How it works

Data engineers today build data products with coding agents. The agent writes the dbt models, the tests, the CI workflow. What it needs are three inputs, and all of them can be managed through Entropy Data:

  • The data contract defines the what: the dataset the data product must deliver, specified as an ODCS contract from the data consumer's point of view.
  • The skill repository defines the how: your organization's conventions, templates, and policies for building data products on your stack.
  • The data marketplace provides the data to build on: the upstream data products, source applications, and external data the new data product consumes. The agent discovers them through the Entropy Data CLI and even requests access on behalf of the new data product.

The coding agent combines all three and implements the data product in minutes: a dataset, a dbt project, a Databricks Asset Bundle, whatever your stack requires, complete with tests, deployment workflow, lineage, and metadata. The result shows up fully wired in Entropy Data: marketplace listing, lineage, contract test results, drift detection, and access management.

The Data Product Builder tab on a data product page: pick the coding agent (Claude Code, OpenAI Codex, GitHub Copilot CLI), copy the install and connect commands, and see the builder's skills.
The Builder tab on the data product page: pick the builder, see the install command, copy the prefilled prompt.

Open-source skill repositories

A skill repository is a Git repository with skills (Markdown instructions the agent loads for a specific task), file templates, and validation hooks. Fork one and encode your own conventions. Entropy Data provides open-source skill repositories per stack:

  • dataproduct-builder-dbt. dbt on any adapter: Snowflake, BigQuery, Databricks, Redshift, Postgres, DuckDB. GitHub Actions for CI.
  • dataproduct-builder-databricks. Databricks Asset Bundles with Lakeflow Spark Declarative Pipelines. Sharing via Unity Catalog.
  • Snowflake Native Apps Framework and AWS Glue. Coming soon.

Community and custom repositories are welcome. Submit a pull request to the dataproduct-builders registry to list yours.

Try it out

Read the Data Product Builder guide for the full walkthrough with the Shelf Warmers example: contract editing, marketplace discovery, access requests, and the finished data product in Entropy Data. Or head straight to the docs.