In keeping up with my goal to do more learning this year, I’m allotting some time outside the daily grind for learning. My overarching goal is to explore popular data engineering tools such as dbt...

This is an extension of my 2025 Learning Log. I’ve reviewed ERDs (Entity Relationship Diagrams) and Mermaid - a tool to create diagrams using code. ERD Then and now, I find the Lucid chart expla...

I’ve recently created a learning log for this year (2025). The first topic that I wanted to go over is dbt (data-build-tool). Here are some of my notes. I’m putting more materials or notes here abo...

Here are some notes1 on DW Best Practices. Good points to keep in mind but admittedly warrants more concrete examples and unpacking (more in the future, so this could be an evolving note). Table D...

I’ve recently learned about Cumulative tables, a table design to do historical tracking. The timeframe (however it is defined), are inserted sequentially at every time partition, which eliminates t...

With the recent blue screen of death incident, I kind of thought about how much I missed working in Linux. I’ve also been mentally resisting to learn more CMD commands for a while now. That said, ...

Here’s a demo on how pydantic can be used to validate, correct, and quarantine data. Access the code and demo file here. Given a csv file users.csv containing the following records id,name,email ...

Suppose a dataset looks something like this, with no overlapping keys: "rows": [ { "a": "1234ABC", "b": 5.768, "c": 1, "d": [ { "e":...

Here’s a Power Query snippet to create a Calendar in Power BI In the Power Query Editor: Create a Calendar table with one column [StartDate] containing the starting date of the calendar e.g. 2...

Here’s my take on visualizing the “Financial Consumer Complaints” dataset from Maven Analytics. It’s a simple, straight-forward dashboard that shows the number of complaints by year, products, and...