About Me
Who I Am
Hi! My Name is Dave. I'm an Azure Data Engineer with experience in event-based data synchronizations and building and extending ETL platforms on the Azure cloud. I love designing and realizing solutions to complex problems. Passion for data because of the value it can offer if used in the right way!
Skills & Expertise
Tools & Technologies
Programming Languages
Experience
Data Engineer
De Nederlandsche Bank | Amsterdam | October 2023 - April 2024
Technologies & Tools:
Python DataIku Azure Devops PowerPlatform Dataverse Azure Data lake
The Nederlandsche Bank is the central bank of the Netherlands. It is part of the European System of Central Banks. De Nederlandsche Bank NV (DNB) supervises banks, monitors financial stability in the Netherlands and advises the government.
De Nederlandsche Bank strives for secure payment transactions and strong and reliable financial institutions.
During this assignment I worked together with a project team on converting a business tool for statistical checks into a central product suitable for multiple departments. Here I made designs and implemented the following components:
- Calculation modules
- Development/production environment split
- Monitoring
- Logging
- Management
The computational modules are written in Python and hosted in DataIKU. The product also includes PowerBI dashboards with linked power apps and dataverse tables.
Data Engineer
Mosadex E-Health | Nijmegen | October 2022 - October 2023
Technologies & Tools:
SQL Python Microsoft Azure Azure DevOps Azure Functions Azure Logic Apps Azure Data Factory Azure Monitoring MSSQL Synapse Datawarehouse Azure Pipelines YAML
Mosadex E-Health contributes to optimizing patient care in the Netherlands with its ICT solutions. They have been doing this for more than 12 years. Since 2020 they are part of Mosadex Group. Together with the sister companies, they support pharmacies with innovative pharmacy concepts. If software or ICT is involved, they devise, develop and manage it.
At Mosadex E-Health I had the role of Data Engineer within Team Data and was co-responsible for the One Data Estate (ODE). Team data is responsible for adding data sources to the ODE, where I mainly focus on optimizing the ETL flows in Azure Data Factory and Synapse.
I contributed by expanding functionality, improving current processes and infrastructure and coming up with and testing new ideas.
The team works with scrum and DevOps, for which Azure DevOps is used.
Data Consultant
In2Intel | Amsterdam | November 2020 - August 2022
Technologies & Tools:
C# SQL Python Microsoft Azure Azure DevOps PowerApps/Automate Azure Functions Azure Logic Apps Azure Data Factory Azure Monitoring Azure Eventhubs MSSQL CosmosDB PostGreSQL Azure Pipelines Blockchain
In2Intel is a data consultancy party that focuses on extracting value from data.
As a Data Engineer I am responsible for setting up ETL pipelines, designing data extraction tools and developing APIs. Because of the consultancy I worked on various projects. Extraction middleware written for systems such as Google Analytics, Business Central and JIRA.
In addition, I also designed a data extraction tool for monitoring different customer environments using Azure Monitoring.
Data consultant/Data lead
Aestate | Utrecht | January 2020 - Present
Technologies & Tools:
C# SQL Python Microsoft Azure Azure DevOps PowerApps/Automate Azure Functions Azure Logic Apps Azure Data Factory Azure Monitoring Azure EventGrid Azure Eventhubs MSSQL CosmosDB Solution Design Solution Architecture Infrastructure as Code Azure Pipelines BICEP YAML
Aestate is a housing consultancy firm that focuses on "unraveling" complex housing questions. They are mainly involved with consulting at universities and municipalities, because of the complexity of the portfolios of these organizations.
For Aestate I am working as a general data consultant and data lead for the team of five (including me) data consultants. From these roles I think along about the use of data throughout the company, from internal management reports to customer-oriented data products. I set up the data lake, the reporting environment and the ETL flows in collaboration with Aestate. In case of recurring wishes, we focus on designing modules that can easily be implemented for various assignments.
The activities are retrieving and discussing the wishes of the customer, translating them into a suitable data solution and developing the solution into data products.
Data Engineer
AFC Ajax | Amsterdam | April 2018 - August 2022
Technologies & Tools:
C# SQL Python Microsoft Azure Azure DevOps PowerApps/Automate Azure Functions Azure Logic Apps Azure Data Factory Azure Monitoring Azure EventGrid Azure Eventhubs MSSQL CosmosDB
AFC Ajax is known for its football, but in recent years has also focused on digitizing the club.
We focused with a small team on setting up the data lake and the reporting environment for Ajax's office functions. Through pipelines based on export files, APIs and queueing systems, data flows in from various sources to use within the organization. Because of the size of the team, I did both development and implementation in Azure.
During the digitization of Ajax, the need arose to synchronize data between the central CRM system (Dynamics 365) and the systems around matches and merchandise. Here we have worked with event-based modules to be able to send data near-real-time.
Education
BSc Business IT & Management
Amsterdam University of Applied Sciences | Amsterdam | 2014 - 2019
Studied Business IT & Management because of my love of well fitting IT solutions. Did my specializations in Big Data/Data science, where i found my love for data engineering.