Architecture Weekly Issue #140. Articles, books, and playlists on architecture and related topics. Split by sections, highlighted with complexity: 🤟 means hardcore, 👷♂️ is technically applicable right away, 🍼 - is an introduction to the topic or an overview. Now in telegram and Substack as well.
Highlights
New Technology Radar by ThoughtWorks 👷♂️
Second edition of Tech Radar 2024 is live! No wonder it is focused on the usage of LLMs. Retrieval Augamented Generation(RAG) got Adopted status, as well as TestContainers. Pair programming should not be replaced with AI assistants though. Follow for more!
API Gateways: Why, What and How 👷♂️
Once you introduce any kind of APIs , be it external or internal, there should be throttling, load balancing, access control and many more. I just finished a long read on API Gateways and how to use them. Grab a cup of coffee and dive in!
#api #cloud
How BlueSky made their architecture decisions 👷♂️
Bluesky is a social network with hundreds of millions of users across the globe. In this description they show the evolution of their architecture to support that number. Interesting decisions on using SQLite db per user and other insights in the long read!
#casestudy
AI in Software Architecture Workshop
Talking about Architecture Decisions: I create a 2-hour workshop to show how to use AI properly in making architecture decisions. If you're interested to get it for your company, read more and leave a request here:
Follow-Up
DORA 2024 report 🍼
DevOps Research and Assessment Report 2024 is live! From the report highlights: AI assistants can make the code quality slightly better, but decrease the software delivery output, platform engineering is a good thing widely adopted in larger corporations and the key to delivery is developer experience. Find more details inside with the link to the report itself
#devops
Stop using Lambdas to trigger AWS Glue workflows based on S3 events 👷♂️
If you're using Lambdas to trigger the AWS Glue workflow, then you can consider a more serverless way to do that with the help of EventBridge service. This article covers the reviewed architecture and walk you through the setup.
#serverless #dataengineering
Service Level Terminology 🍼
While we are talking SLAs and SLOs, we need to think about the Service Context itself. Who is providing the service? Who is the consumer? What constitutes a healthy state of the service? Alex Ewerlöf wrote a great post on the all the terms you need to know to successfully run a useful service.
Alex Ewerlöf
#devops
Parquet File Structure
Another data engineering article, this time about how Parquet file stores it's values. It covers the data rows, column structure and pages. I would appreciate some visualization though.
#dataengineering
Build a Secure Data Masking Pipeline with DuckDB and TiDB 👷♂️
I saw some impressing tweets about DuckDB recently like processing 33 GBs to calculate average prices in under a second, and then got this article. Truly impressive what a powerful database engine can do even in such a tedious task to mask the sensitive user information in a data pipeline.
#dataengineering