POS, readings and rambles | Readings
13 June 2023
1 minutes to read
I’ve gotten to do some small improvements to the mobile website. I’ve in the pipeline the addition of an admin page to administer the event and from which I’m hoping I can add more features if needed. I’ll try to keep it small and modular but should be interesting as at this point I’m using planetScale for the system I’m going to implement the auth using Supabase and need to connect to the original database in MSSQL. 😅 Let’s see how Prisma can handle more than one DB.
I’ve also been keeping myself up to date with the reading and the plan is now to stop and focus on reading the flink book. I’m hoping to be able to contain myself and remain focused.
Something else that I’ve been thinking about is if all this reading and learning could be made useful in some way as a service. Could I provide some kind of data platform with the best ideas I get and want to test and make a template for others to use? And maybe use it to teach, implement the newest ideas, and maybe, just maybe help others implement it? This is a SaaS that I’m thinking 🤔. Or maybe I should consider the idea of giving my time to help with an open-source project.
Readings of the week
- Pandas 2.0 and its Ecosystem (Arrow, Polars, DuckDB) | Airbyte
- The State of Data Testing
- AWS Introduces Athena Provisioned Capacity
- Dive deep into AWS Glue 4.0 for Apache Spark | AWS Big Data Blog
- Radical Transparency: How a Strong Startup Culture can Deliver Success
- Thinking Deductively to Understand Complex Software Systems
- The SQL Unit Testing Landscape: 2023 | by Chad Isenberg | May, 2023 | Towards Data Science
- The Data Deception: Why Most Startups Are Doing Data-Driven Decision Making Wrong
- Metis: Building Airbnb’s Next Generation Data Management Platform | by Xiaobin Zheng | The Airbnb Tech Blog | Jun, 2023 | Medium
- Use dbt and Duckdb instead of Spark in data pipelines | by Niels Claeys | datamindedbe | Medium
- Efficiently crawl your data lake and improve data access with an AWS Glue crawler using partition indexes | AWS Big Data Blog
I'm José Cabeda, a data engineer focused on improving data systems and educating on how to use them. I also do a lot of planning and read as much as I can.