What has changed — and why it matters now
Our method for Data Lake Architecture
Architecture decisions
Iceberg vs Delta vs Hudi — engine support, time travel, schema evolution, catalogue.
Bronze (raw), Silver (conformed), Gold (semantic / products) with clear contracts.
Unity Catalog, Purview, Glue, Dataplex — lineage, fine-grained access, tags.
Serverless SQL, Spark, streaming engines; right-sizing and autoscaling.
OneLake shortcuts, Delta Sharing, Iceberg REST catalogues across clouds and partners.
Deliverables
Platforms we work across
We design for the outcome first and choose the platform second — across Microsoft, AWS and Google Cloud, and every major AI provider.