I'm José Cabeda, a data engineer focused on improving data systems and educating on how to use them. I also do a lot of planning and read as much as I can.
Start of Advent of Code | Readings
04 December 2023 | 2 minutes to read | newsletterWeb Dev Progress: 0% I still want to pick on this project whenever I have some free time. I’ve been listening to wheel of time only when…
Ducks and evidences | Readings
30 November 2023 | 1 minutes to read | newsletterSo, the meetup is scheduled for next month, on January 10. I’m doing a lot more work on the presentation and I’ve switched from superset to…
Tests checklist
21 November 2023 | 1 minutes to read | development agile checklistshttps://unsplash.com/photos/person-writing-bucket-list-on-book-RLw-UC03Gwc This document will be a live document where I reflect and update…
Checklists
21 November 2023 | 2 minutes to read | development agile checklistsThis document will be a live document where I reflect and update my most current view So, I’ve been one to be methodic in my practice and I…
Data Impostor blog idea | Readings
19 November 2023 | 2 minutes to read | newsletterI’ve gotten an idea that I find kind of cool to write more on this blog. From time to time I feel a lot of Impostor syndrome so I think I’ll…
Streams, streams and streams | Readings
14 November 2023 | 2 minutes to read | newsletterTaking a bit more attention to Kinesis I think it becomes very interesting to understand some of the insides of the stream world. Things…
Logseq, Impostor Syndrome | Readings
05 November 2023 | 3 minutes to read | newsletterI’ve been able to move my personal thoughts and notes to Logseq instead of just using random notes + vs code. I can easily revert to the old…
Readings basically
28 October 2023 | 1 minutes to read | newsletterWeb Dev Progress: 10% This weeks has been all about ADR’s Funnily enough I saw this article appear on my feed 😅. Data Stream Progress: 2…
Lambdas and runs | Readings
23 October 2023 | 2 minutes to read | newsletter aws lambdaWeb Dev Progress: 10% The delivery of a big initiative has brought a sense of productiveness. I’ll be grabbing the momentum with the hopes…
Meetup potential for data stream | Readings
07 October 2023 | 2 minutes to read | newsletterWeb Dev Progress: 5% Tipping a bit again into typescript I’m foreseeing a lot of code for the next 2 weeks. And specially with testing I’ve…
Data stream has started and small steps taken | Readings
01 October 2023 | 2 minutes to read |Web Dev Progress: 5% I’ve coded little TS this week aside from the Data Stream project. It has been a lot of terraform and deployments…
First week of the semester | Readings
16 September 2023 | 2 minutes to read |https://unsplash.com/photos/0ex_Wub2ZXM For this week I can start to do an update status by each subject. Web Dev Progress: 0% I’ve gotten a…
Omnivore & Semester | Readings
09 September 2023 | 1 minutes to read |After listening to Python Bytes episode 349, I decided to give a try to omnivore. I really like the notion integration but sadly I think I…
Public transportation project | Readings
28 August 2023 | 1 minutes to read |I would like to keep my interest in actually finishing the Spark book. However, I also got an idea to set up a bot to gather real-time data…
Cooking | Readings
21 August 2023 | 1 minutes to read |I’ve taken this first week slowly. I’ve done a lot of cooking which has been fun. And I’ve been pretty happy as I’ve kept my life somewhat…
Return from vacations | Readings
16 August 2023 | 1 minutes to read |I’ve spent more than one week without writing an update. Since then I’ve had the biggest vacations I had since I started working (almost…
Flutter? | Readings
08 July 2023 | 1 minutes to read |The week has gone by and in terms of updates I haven’t gotten much. I still feel that I should be taking much more notes, on meetings during…
AWS certification | Readings
03 July 2023 | 1 minutes to read |For this 2 weeks I was planning on picking the Flink book but got approval to do the AWS exam so I’ll be doing the Udemy course in…
Readings and quick side project | Readings
13 June 2023 | 1 minutes to read |I’ve gotten a lot of reading done, almost finished with the backlog of articles and “Stream Processing with Apache Flink” is next on the…
POS, readings and rambles | Readings
13 June 2023 | 1 minutes to read |I’ve gotten to do some small improvements to the mobile website. I’ve in the pipeline the addition of an admin page to administer the event…
Reflections | Readings
04 June 2023 | 1 minutes to read |Funny the number of articles I’ve still got to read 😅 I’ve also focused on reading only when I’m able to take notes on https://strange…
Reflections | Readings
31 May 2023 | 2 minutes to read |A month has passed since my last week’s review. A bit has happened since and I’ve gotten around to playing D&D with friends. It seems like…
Phoenix Project Book Review
24 May 2023 | 1 minutes to read |s The book is an excellent read where I’ve had the opportunity to read about Parts Unlimited going through many pains to improve the IT…
Single-man data platform | Readings
30 April 2023 | 1 minutes to read |The definition of what is important to build a data platform is a tricky one. At this point, I think there are some aspects related to how…
Week review | Readings
26 April 2023 | 1 minutes to read |I’ve gotten one of the books I planned to read done and got started on “The Anatomy of the Swipe”. I’m also planning on how to set aside…
Writing and oh Readings
20 April 2023 | 1 minutes to read |I’ve been pulling some ideas on what I should do next to improve myself. Doing talks, reading, and, writing about the data ecosystem are…
Lots of ideas, little time | Readings
12 April 2023 | 1 minutes to read |I’ve been having a lot of long-term ideas which I’ve yet to grasp if they are important enough to change my short term plans. For now, I’m…
Moved from Pocket to Notion
31 March 2023 | 2 minutes to read |I’ve decided to move my read-it-later list to Notion. Up until now, I’ve been a happy user of Pocket but I’m starting to feel a need for…
Small thoughts | Readings
27 March 2023 | 1 minutes to read |This week I’ve taken to do a lot of reading but less on the technical side. It’s time to do a bit more implementing. I’m also keen that for…
Back to data | Readings
22 March 2023 | 1 minutes to read |I’ve start the week on a new team and with that I got big plans on how to immerse myself and the company on a data-driven mindset. I’ve got…
New moves! | Readings
15 March 2023 | 1 minutes to read |This week I’ve been a bit late on the reading update as I’ve gotten to move from pocket to notion, so a bit of reading to try and clean my…
Productivity on reading habits | Readings
06 March 2023 | 1 minutes to read |For the past weeks, I’ve done a small change to how I keep reading up to date. I use RSS + Feeder reader (great app btw). However, something…
Rambling on data | Readings
24 February 2023 | 1 minutes to read |I’ve tried to focus again on the data side. This means a bit more Python and looking, again, for how to integrate a data platform cheaply…
TIl 2023-02-13
13 February 2023 | 1 minutes to read |George Orwell’s six rules of writing: Never use a metaphor, simile, or other figure of speech which you are used to seeing in print. Never…
Focus, python, and DuckDB | Readings
12 February 2023 | 1 minutes to read |The funny thing about this week was that focusing indeed helped. I was trying to learn Rust to implement the genome project (which I might…
Typescript, debugging and focus | Readings
05 February 2023 | 1 minutes to read |This week I’ve had to focus more on my debugging skills with Node + typescript. Currently doing lots of backend development and it’s…
TIl 2023-02-09
05 February 2023 | 1 minutes to read |You can setup your git email per repo with
Visit to Lisbon | Readings
30 January 2023 | 1 minutes to read |Done a lot of reading, and went to the Lisbon office to work for a couple of days but in terms of advancing on Rust I did exactly 0. So my…
TIL | 2023-01-27
27 January 2023 | 1 minutes to read |Today I learned ADR’s are a great way to make decisions clear and to get async feedback Zoom optimized audio to high solves a lot of issues…
TIL | 2023-01-26
26 January 2023 | 1 minutes to read |Today I learned Node 14 can work with npm 9 since 14.17 Jest mocks can be fun 😅 Basics of using lerna for monorepos Rust just release…
TIL | 2023-01-25
25 January 2023 | 1 minutes to read |Today I learned Metabase can have a little issue on 0.45.1 converting a number from dynamodb (bigint when it should be a decimal) SQS FIFO…
Rust, Deno, and Genome | Readings
22 January 2023 | 1 minutes to read |Funny how I thought I read so much but in terms of the material I’ve set for the readings I only got 4 articles. My reading list has grown…
Rusty progress | Readings
15 January 2023 | 1 minutes to read |I’ve done a bit of progress on the Rust book this week. From the 20 chapters I’ve got 12 down (so 60% done 🧐📈). Focusing more on one…
Rust and side projects | Readings
08 January 2023 | 1 minutes to read |The weekend has been pretty slow. I’ve been reading the rust book (only got 3 chapters down) and programmed a bit but I haven’t started to…
Talk, Christmas and next year | Readings
02 January 2023 | 3 minutes to read |For the last couple of weeks, I’ve slowed down a bit and been reading a bit more high fantasy and enjoying the festivities. I’ve given the…
Talk, Advent of code & Rust | Readings
11 December 2022 | 1 minutes to read |I’ve been a bit busy each day doing the challenges of Advent of code. Again, didn’t yet convince myself into doing them on Rust 😅. The…
Talk, blogging & rust | Readings
06 December 2022 | 1 minutes to read |With the first week of December going I’ve started working on some of the stuff I set out to do. I’ve read the first couple of Rust chapters…
Uses
05 December 2022 | 1 minutes to read |List of all my technologies, hardware, etc Hardware Laptop (work): Macbook Pro 2021 M1 💻 Personal computer: Graphics: Nvidia GTX 97…
Talk, blogging & rust | Readings
27 November 2022 | 1 minutes to read |December is turning out to be a challenging one 😬. I’ve published the first article in some time (status updates don’t count). My goal is…
DuckDB VS Porto buses - A small case for a new OLAP engine
24 November 2022 | 5 minutes to read |A new database, DuckDB, has seen a rise in popularity, in recent years. Other alternatives like Redshift are too expensive for many…
Status update | Readings
20 November 2022 | 1 minutes to read |With the rise of Mastodon, I’ve gotten myself into publishing some small thoughts. Not sure how useful this might be as I tend to prefer RSS…
Slow weeks happen now and then | Readings
13 November 2022 | 1 minutes to read |I’ve read quite a bit preparing the presentation. Although I’m still writing, rewriting, and doing the demo, I’ll start to look for meetups…
Layoffs and focusing efforts on talk | Readings
07 November 2022 | 1 minutes to read |This week has been weird. A lot of layoffs in the tech sector… Funnily, the theme for the talk I was preparing might be becoming more and…
Status update
30 October 2022 | 1 minutes to read |I’ve done a lot of reading but I’ll again be focusing on the talk I plan to prepare. I want to test some of the ideas I have but if I’m…
Status update
23 October 2022 | 1 minutes to read |Gotten some progress on the statistics course and finnally caught with the to-read pile of articles. As I’ve been on vacations I didn’t do…
Status update
16 October 2022 | 1 minutes to read |As I said I’ve slowly been working on the statistics course. It’s great to get to the basics again and I’m greatly enjoying how empowering…
Status update
09 October 2022 | 1 minutes to read |I’ve taken a bit off for the past month. Nonetheless I’ve read the Streaming systems book (great one to complement Designing Data Intensive…
Status update
06 September 2022 | 1 minutes to read |I’ve taken some time to study and add notes to my second brain. It has been an interesting way of studying which has left me with a thought…
Status update
26 August 2022 | 1 minutes to read |Not much has happened this this week, I’ve gotten myself into using docsaurus to publish my second brain. You can change it here. I’ve found…
Status update
11 August 2022 | 1 minutes to read |I’ve quickly gotten a prototype to generate my reading updates. The python script (repo) uses the Pocket API (had to move away from…
Reading Update
10 August 2022 | 2 minutes to read |Since March there was a lot happening. I’ve moved from Talkdesk to a startup (Fidel API) to help bootstrap a data team and got to read a lot…
Workflow
31 March 2022 | 2 minutes to read |This is a never finished, self-guide on how I organize my work and thoughts to be as productive as possible. The goal is to be able to do as…
Reading Update
20 March 2022 | 1 minutes to read |I’ve gotten some interesting reading this week and, although I think I read quite a bit, I also think that my to read pile keeps increasing…
Reading Update
13 March 2022 | 1 minutes to read |This has been a productive week, I’ve read a lot of articles and hope to start reading the book Database Internals Data Engineering What’s…
Reading Update
06 March 2022 | 1 minutes to read |Data Engineering An Introduction to Modern Data Lake Storage Layers - A good comparison, using apache spark on how to create and run some …
Reading Update
27 February 2022 | 1 minutes to read |This week I have read much more articles non-related to data engineering as I’ve been too busy to even start reading heavily on apache flink…
Reading Update
20 February 2022 | 1 minutes to read |Data Engineering The new modern data stack Airbyte Airflow DBT - For the development of an ELT pipeline, the addition of airbyte to dbt and…
Reading Update
13 February 2022 | 1 minutes to read | Data Engineering What I learned from the open source data stack conference 2021 - A good…
Reading Update
07 February 2022 | 1 minutes to read |Hey! I’ve been a bit out but, nonetheless, I’ve been keeping up with news, while studying a bit on scala. Data Engineering Airflow, Prefect…
Pomodoro
27 January 2022 | 1 minutes to read |I was looking into some old code I had written for Freecodecamp and found this little thing that from time to time I’ve come to use. Thought…
Reading Update | Hopes for 2022
21 December 2021 | 1 minutes to read |2021 was an year where I got to fulfill some of my goals. I got a greater track of writing articles (most of them reading updates) and I got…
Reading Update | dbt speaker!
11 December 2021 | 1 minutes to read |Well, on thursday I went through my first international talk at Coalesce where I’ve talked about dbt in a data mesh world (basically it’s…
Reading Update
01 December 2021 | 1 minutes to read |Organization The Basecamp Guide to Internal Communication - for those working remotely these tips are very good for improving the quality of…
Reading Update
23 October 2021 | 2 minutes to read |I’ve taken some time from writing my reading updates and I’d say some of the articles have gone into something I like to call knowledge…
Data Lineage with DBT for external tables
26 August 2021 | 2 minutes to read |DBT is a great project but I’ve found myself in a kind of a situation. When we have a project that isn’t entirely in DBT how can we generate…
Reading Update
10 July 2021 | 1 minutes to read |This week I’ve been pushing my scripty guy and tried to automate the lookout for vaccines in my country. Add some partial success and let’s…
Reading Update
25 June 2021 | 1 minutes to read |I’ve gotten to watch a documentary related to night watch which I found quite nice which explain the image above 😅. Related to reading I’ve…
Reading Update
05 June 2021 | 1 minutes to read |I’m going on vacations but before doing so decided to clean my to-read list. Kinda, I’m leaving most of what I found interesting below but…
Dreaming of better data processing
26 May 2021 | 1 minutes to read |I’ve tried to summarize most of the ideas I have on better data processes. Of course many of them are simplified and up to debate but I…
Reading Update
26 May 2021 | 1 minutes to read |I’m actually trying to write a bit more but in the meantime here goes another batch of reading 😅 Data Analysis https://tech.trivago.com…
Reading Update
09 May 2021 | 1 minutes to read |I’ve been trying to read some books so I’ve taken a bit of a break reading article. But in the meantime I’ve found a good share related to…
Reading Update
03 April 2021 | 1 minutes to read |This was a relative calm week. I’ve read a lot and coded less than I wanted. I’ll try to focus more on development and less in reading for…
Reading Update
28 March 2021 | 1 minutes to read |This week I’ve been preping for three things. Read a book on Scala, writing about SQL VS code pipelines, and on how to create a new DBT…
Reading Update
20 March 2021 | 2 minutes to read |Hi! I’ve gotten into reading most articles I had for the past weeks. I’m seeing more and more regarding streaming pipelines although I think…
Reading Update
14 March 2021 | 1 minutes to read |This week I’ve gotten to read a lot on architecture. I’m still trying to reduce the articles on my pile and hopefully start an article of my…
Reading Update
07 March 2021 | 1 minutes to read |Data visualization The creator of D3 writes a good summary of his last 10 years in 10 Years of Open-Source Visualization. Data Warehouse…
Reading Update
18 February 2021 | 1 minutes to read |Hi there! I’ve gathered some articles and in the meanwhile I’ve been reading a bit about scala and also saving some papers for a “ligh read…
Reading Update
23 January 2021 | 1 minutes to read |For the past weeks, I’ve found some interesting stories related to database migrations like Your legacy database is outgrowing itself and An…
Global view in a regional world
18 January 2021 | 2 minutes to read |As a data engineer, my main goal is to create a single and complete source of truth. This has brought me into the cloud and the ELT…
This week interesting links
10 January 2021 | 1 minutes to read |This week I’ve mainly focused on either data quality through examples like Great Expectation or on data modeling with the help of Airflow…
2020 review and beyond
03 January 2021 | 2 minutes to read |Just like most people I know (and at least half the world) the pandemic took hold of a big chunk of my life. Fortunately, I was able to cope…
2019 Review and Beyond
02 January 2020 | 2 minutes to read |2019 was a good and challenging year. Looking back at the article I wrote, it seems I’ve done more than I hoped (I’m a bit pessimistic at…
A perspective on Tech In Porto
20 June 2019 | 5 minutes to read |A conference in Porto is a good conference :-p Intro Hi! I’ve attended Tech In Porto and I thought I’d write a brief summary of my…
Building Quizzer
26 May 2019 | 3 minutes to read |A JSON-based quiz shuffler. Why build this? In a conversation with my brother he told of an event he was organizing which required that they…
Objectives for 2019
07 January 2019 | 1 minutes to read |Hi there! I’m writing this article as a way of putting out there what I pretend to do this year. This is more for me than for whoever is…
Free Code Camp Calculator
18 June 2018 | 1 minutes to read |To improve some of my knowledge of Frontend I took the FreeCodeCamp (FCC) course. It’s a fantastic way to starting making some projects if…
SSIS Naming Conventions
06 June 2018 | 1 minutes to read |Hi folks! In the past month I’ve started doing a project in Business Intelligence. The work of defining the metrics and dimensions had…
Medium Articles
04 June 2018 | 1 minutes to read |Previous posts I’ve written on medium: Organize. A proposal to control our life [A new Developer path] (https://mystudentvoices.com/a-new…
The Origin
04 June 2018 | 1 minutes to read |I’ve tried and tried… I’ve lost count of the times I’ve tried to start my own blog. Last year I wrote some articles on Medium but I’ve…