What: In-person Data Engineering NL meetup
When: May 3, 17.30 CEST
Where: BigData Republic Office, Coltbaan 4C, Nieuwegein
Now that all covid measures have finally been lifted, we are proud to announce the next in-person Data Engineering NL meetup.
Bas Harenslak (Astronomer) will guide us on how to do proper testing in Airflow, from unit testing to using fake external systems. Bas Dunn (Bol.com) will tell us about how Airflow is used in practice at the analytics environment of Bol.com, the largest Dutch online retail platform. Together, these two presentations will form an insight on both the theory and practice of this widely used workflow tool.
The meetup will be interesting for engineers that may have already worked with Airflow or consider using it, and want to learn about different Airflow testing strategies. You’ll also learn how Bol.com organised its Airflow setup, problems that were faced, and trade-offs that were made.
Join the meetup!
May 3 2022, 17.30 Amsterdam time (CEST)
- 17.30 - 18.00 Walk-in + food
- 18:00 - 18:15 Intro
- 18:15 - 18:45 Testing in Airflow - Bas Harenslak
- 18:45 - 18:55 Q & A
- 18:55 - 19:05 Break
- 19:05 - 19:35 Airflow @ Bol.com - Bas Dunn
- 19:35 - 19:55 Discussion
- 19:55 Drinks & snacks
Meet the speakers
Bas Harenslak - Bas is a Solutions Architect at Astronomer, the driving force behind Apache Airflow, where he helps customers with the Astro platform and getting the most out of their data pipelines using Airflow. He is the author of the book Data Pipelines with Apache Airflow and a committer on the project. In his spare time he enjoys road tripping and snowboarding.
Bas Dunn - Bas is a Data and Engineering enthusiast. In his five years at Bol.com he worked in various data-related roles. As data analyst, data scientist, and software engineer. Lately, he has been active as an analytics engineer, to help his colleague data analysts to improve the quality of their insights by offering them tools like dbt, Gitlab and Airflow.