Architecture Weekly Issue #179 . Articles, books, and playlists on architecture and related topics. Split by sections, highlighted with complexity: 🀟 means hardcore, πŸ‘·β€β™‚οΈ is technically applicable right away,  πŸΌ - is an introduction to the topic or an overview. Now in telegram and Substack as well.

Highlights

Dynamo, DynamoDB, and Aurora DSQL πŸ‘·β€β™‚οΈ

Those 3 databases represent 3 generations of distributed highly scalable databases at AWS. It's so interesting how they handle durability, availability and consistency requirements. Grab a great as always post by none other than Marc Brooker.

Dynamo, DynamoDB, and Aurora DSQL - Marc’s Blog

#db #aws

The anatomy of LSM Tree 🀟

The Database Internals book taught me how B-Trees and B+Trees work. This post maintains the same high level of the quality explaining how LSM tree version data, provide durability guarantees alongside with flash quick write performance.

Anirudh Rowjee - The Replicated Log 0002

#db

Top 5 diagrams for documenting software architecture 🍼

I refreshed my old article about documenting software architecture with 5 types of diagrams from C4 context ones to the use case diagrams. Find out why you need them, how to draw them and hear some feedbacks about using those diagrams. Tools recommendations included.

Top 5 diagrams for documenting software architecture
A revamp of an old article on the most useful diagrams to document software architecture and tools to create them.

#documentation

Follow-Up

OpenFreeMap survived 100,000 requests per second πŸ‘·β€β™‚οΈ

I truly wish everyone to experience 100,000 QPS and only see a tiny problem of some static data does not always load. Interesting case study from the OpenStreetMap, how they got that crazy load and how Cloudflare helped to remediate the issue.

OpenFreeMap survived 100,000 requests per second
Sorry Wplace.live

#casestudy #performance

Removing friction from Amazon SageMaker AI development 🍼

Interesting note on the challenges that SageMaker team faces trying to provide secure environment for machine learning with the access to giant compute resources - scale, security, observability - everything is here.

Removing friction from Amazon SageMaker AI development
Building with Amazon SageMaker AI should be about innovation, not wrestling with development environments or building bespoke observability systems. Here’s how we’re removing roadblocks so builders can focus on what matters most.

#o11y

Scaling Postgres to the next level at OpenAI πŸ‘·β€β™‚οΈ

A video for a change: OpenAI share how they deal with write amplification, single point of failure and inefficient queries while using a single master setup for ChatGPT. Useful stuff with no talking about AI!

#db

Parquet Content-Defined Chunking πŸ‘·β€β™‚οΈ

And the last one for today: HuggingFace tells us the story of optimizing their 4 PB storage occupied by Parquet files through smart content-defined chunking as even small changes will trigger significant changes in byte representations.

Parquet Content-Defined Chunking
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

#dataengineering

Observability for Claude Code

Having AI writing code for you may sound like a productivity boost until you face a limit mid-sprint or get an unexpectedly long bill at the end of the month. The remediation? Proper observability indeed. Grab a piece explaining how to set it up for Claude Code.

Claude Code + OpenTelemetry + Grafana: A guide to tracking usage and limits
Learn to monitor Claude Code costs, tokens, and latency in 5 minutes using its native OpenTelemetry support with Grafana Cloud.

#observability

Big thanks to Nikita, Constantin, Anatoly, Oleksandr, Dima, Pavel B, Pavel, Robert, Roman, Iyri, Andrey, Lidia, Vladimir, August, Roman, Egor, Roman, Evgeniy, Nadia, Daria, Dzmitry, Mikhail, Nikita, Dmytro, Denis and Mikhail for supporting the newsletter on Patreon!