Search Results

38 results

Scaling with PostgreSQL without boiling the ocean

09 Feb 2025

https://www.shayon.dev/post/2025/40/scaling-with-postgresql-without-boiling-the-ocean/

Practical scaling strategies for application developers who don't have a dedicated database team

Database mocks are just not worth it

30 Dec 2024

https://www.shayon.dev/post/2024/365/database-mocks-are-just-not-worth-it/

Testing against a real database uncovers hidden pitfalls that can appear as the application matures

Every fast write moves work somewhere else

08 Aug 2026

https://www.shayon.dev/post/2026/220/every-fast-write-moves-work-somewhere-else/

A database write can stop after memory, a local SSD, an object PUT, or a replicated WAL. Each choice changes latency, durability, and who owns the work left for later.

Building a tiny FUSE filesystem

10 Jun 2026

https://www.shayon.dev/post/2026/161/building-a-tiny-fuse-filesystem/

Building a small filesystem in Rust with metadata in JSON and file contents in plain local files, using FUSE to explore inodes, caching, and what it means for a write to become durable.

I am not leaving GitHub any time soon

28 Apr 2026

https://www.shayon.dev/post/2026/118/i-am-not-leaving-github-any-time-soon/

GitHub's reliability has been genuinely bad. I am a loyal GitHub user. I am also, right now, an unhappy one.

Linux Page Faults, mmap, and userfaultfd

06 Mar 2026

https://www.shayon.dev/post/2026/65/linux-page-faults-mmap-and-userfaultfd/

How Linux demand-pages memory, what mmap does to physical pages, why replacing a mapping breaks direct memory access and shared memory, and how userfaultfd lets you lazily populate memory without destroying the mapping.

Let's discuss sandbox isolation

21 Feb 2026

https://www.shayon.dev/post/2026/52/lets-discuss-sandbox-isolation/

A dive into the spectrum of sandboxing and isolation, from Linux namespaces and gVisor to hardware-enforced microVMs and WebAssembly, and why picking the right boundary matters for multi-tenant workloads.

Understanding how GIL Affects Checkpoint Performance in PyTorch Training

07 Feb 2026

https://www.shayon.dev/post/2026/38/understanding-how-gil-affects-checkpoint-performance-in-pytorch-training/

A look at what Python's GIL is, why it makes thread-based async checkpoint saves counterproductive during PyTorch training, and how process-based async with pinned memory is better

Software engineering when machine writes the code

19 Jan 2026

https://www.shayon.dev/post/2026/19/software-engineering-when-the-machine-writes-code/

The machines have become powerful enough to write code for us. What does this mean for those of us who love understanding how things work? And how do we keep learning when AI does the heavy lifting?

A hypothetical search engine on S3 with Tantivy and warm cache on NVMe

10 Nov 2025

https://www.shayon.dev/post/2025/314/a-hypothetical-search-engine-on-s3-with-tantivy-and-warm-cache-on-nvme/

A simple architecture for BM25 search over object storage using immutable Tantivy shards, stateless indexers and query nodes, and local NVMe caching for sub-second queries.

Filters
Category
Domain
In web feed
Language