Combine Dataform with Typescript for Improved Workflows
Dataform pipeline code that is fully typed with unit tests
Jan 29, 20258 min read247

Search for a command to run...
Articles tagged with #data-engineering
Dataform pipeline code that is fully typed with unit tests

Ensure your BigQuery tables have reliable data with Dataform

Building data pipelines in Dataform

Demystifying how Parquet works internally

Demystifying how Parquet works internally

Using S3 and Athena is great for data storage and retrieval using queries. But when I first started using it, one common problem that came up fairly quickly is: How can I add new partitions automatically? The issue was this: Partitioned data was gett...