Covid Confessions

We were doing so well in June. Then the Dutch government decided it would be a great gift to all people to open up basically everything on June 26th, including nightclubs. Imagine all those young bodies dancing, sweating, drinking, hugging, kissing inside rooms where the air is recycled through many noses, mouths and lungs like it’s 2019. Sure, people needed to show their coronapass before allowed in, but that could be obtained with a quick test, giving you green light to party for 40 hours in a row. And scanning all those QR-codes became a real hassle when you see the row of people waiting to enter grow and grow.

On that day, June 26th, we had a daily count of about 550 new infections. In some countries, that would still be reason enough not to go out and about. Unsurprisingly, on July 1st that number went up and as I’m writing this, July 10th, we counted 10.345 newly infected people in one day. That brings us back to lock-down Christmas 2020. With one week of partying we nullified 6 months of patiently waiting. Well done government. They still can’t seem to grasp exponential growth despite their weekly meetings with the experts.

I feel so angry.

I’m currently studying really hard for a data engineering exam and it’s tough. I really appreciate all the knowledge I’m gaining on how to handle data in data warehouses and data lakes, but it is not inspiring to learn data plumbing. The past month I haven’t been sleeping well, and that led me to spiral down the greyness inside. There was a bright point in the future I clung on to these past few weeks. The idea of travel. Two weeks with just the three of us in a city that I love. Two weeks of reintroducing Daughter to the wonders of going places.

A few months ago the Man took a gamble and reserved a house in Copenhagen for two weeks through Airbnb. I knew it was a gamble, but in June the idea of travel became a realistic scenario. We both receive our second shot the week before we leave, we are welcome in Denmark. As our second shot is only a week before we leave we still need to take a test before entering Denmark, but if that’s the only thing I have to do to be able to enter the Louisiana Museum, check out the shops on Vesterbrogade or get a coffee at The Coffee Collective, no problem. But then June 26th came.

With one week of exam preparation to go (doing the exam coming Friday), the bright point in the future shines very brittle. I guess the Germans put up a fence for their partying neighbours next week (we drive through Germany to get to Denmark) and the Danes put us on the red list, requiring us to quarantine on arrival. Rightfully so.

I have been one of those careful inhabitants of this country who have been taking all the precautions and spent nearly 1,5 years in and around their home. I’ve dealt with it all. Even with a four year old (now five) darting around the house for weeks on end while juggling work, home schooling for her and home schooling for me at the same time. The gift from my government after six months of surviving the greyest of days? I bet another six weeks of staying at home during Daughter’s Summer holidays. At least we both are exempt from home schooling.

As I said. I feel so angry.

Door |2021-07-10T18:35:01+02:0010 juli 2021|flow|1 Reactie

The roles in data

For those who are not familiar with the variations of roles in the field of data, this is what I’ve learned so far about those roles. You have data analysts, data architects, data engineers and data scientists.

A data analyst works on, no surprise, analysing data. Often these are people preparing reports (for instance on sales performance) for management. When working in Microsoft Azure, you would spend a lot of time using Power BI to create reports, using polished data sets to perform transformations and calculations. Your goal is to create visualizations that anyone else in your organisation can easily understand.

To create those polished data sets for analysts to work with, you need a data infrastructure. That’s where the data architect comes in. An architect thinks through what the data needs are on one end, knows the perks of the raw data coming in at the other end and then designs the infrastructure in between.

The data engineer then uses the input from the data architect to build the infrastructure.

Sometimes you want to dig deeper into your data and discover more complex patterns. That’s where the data scientist comes in. These math wizards apply statistical, machine learning and AI models to data and are able to tweak these models using there mathematical knowledge.

I was rather surprised to learn how working in data, a relatively new field to work in, already split up in so many roles. And then I’m not even talking about all the specialisations you could choose within these roles for hard core programmers. For instance my trainer worked for many years solely on optimising SQL statements for a living.

My education prepares me for two roles mainly: the analyst and the engineer. I’m most definitely happy with all the skills I learned about using Power BI. That will help me a lot when I start digging for stories using data sets. The data engineering part is absolutely not my cup of tea. It’s really theoretical and an in-depth crash course on database management and Azure cloud infrastructure. You can compare it to fitting electrical pipes in your home. It needs to be done, otherwise you can’t live in your home, but it’s not as exciting as decorating your home. At least I get more excited about decoration and design than fitting pipes. That said, I’m still very happy to get a solid understanding of the inner workings of databases and the cloud tools one needs to create usable data from raw data. It helps me to be able to instruct others to click the right buttons, write the proper SQL statements and build the pipelines for me, so that I can dig for the data story gold 😉

Door |2021-06-23T17:10:12+02:0023 juni 2021|datascience, flow|0 Reacties

Data nerd

I am slowly morphing into a true data nerd. This week I started learning the data engineering part of data. Learning about lambda and delta lake architecture, ETL, OLTP, OLAP, Apache Spark, notebooks, parquet files, SCD Types 1 2 3 and 6, pipelines, serverless and dedicated SQL pools, PolyBase and there’s more to come.

My head is exploding.

Door |2021-06-07T19:55:52+02:007 juni 2021|datascience, flow|0 Reacties
Ga naar de bovenkant