info@bigdatarepublic.nl
menu
Meetup: Testing in Apache Airflow
Best practices and the use case at Bol.com

Important information:

What: In-person Data Engineering NL meetup
When: May 3, 17.30 CEST
Where: BigData Republic Office, Coltbaan 4C, Nieuwegein

Now that all covid measures have finally been lifted, we are proud to announce the next in-person Data Engineering NL meetup.

Bas Harenslak (Astronomer) will guide us on how to do proper testing in Airflow, from unit testing to using fake external systems. Bas Dunn (Bol.com) will tell us about how Airflow is used in practice at the analytics environment of Bol.com, the largest Dutch online retail platform. Together, these two presentations will form an insight on both the theory and practice of this widely used workflow tool.

The meetup will be interesting for engineers that may have already worked with Airflow or consider using it, and want to learn about different Airflow testing strategies. You’ll also learn how Bol.com organised its Airflow setup, problems that were faced, and trade-offs that were made.

We are excited to welcome you in person to this event! In case you have any questions, please reach out to Daniel (daniel.mast@bigdatarepublic.nl) or Tim (tim.janssen@bigdatarepublic.nl).

Join the meetup!

May 3 2022, 17.30 Amsterdam time (CEST)

Agenda:

  • 17.30 - 18.00 Walk-in + food
  • 18:00 - 18:15 Intro
  • 18:15 - 18:45 Testing in Airflow - Bas Harenslak
  • 18:45 - 18:55 Q & A
  • 18:55 - 19:05 Break
  • 19:05 - 19:35 Airflow @ Bol.com - Bas Dunn
  • 19:35 - 19:55 Discussion
  • 19:55 Drinks & snacks

Meet the speakers

Bas Harenslak - Bas is a Solutions Architect at Astronomer, the driving force behind Apache Airflow, where he helps customers with the Astro platform and getting the most out of their data pipelines using Airflow. He is the author of the book Data Pipelines with Apache Airflow and a committer on the project. In his spare time he enjoys road tripping and snowboarding.

Bas Dunn - Bas is a Data and Engineering enthusiast. In his five years at Bol.com he worked in various data-related roles. As data analyst, data scientist, and software engineer. Lately, he has been active as an analytics engineer, to help his colleague data analysts to improve the quality of their insights by offering them tools like dbt, Gitlab and Airflow.