The Quiet Death of the Daily Backup: On Letting Go of a Sacred Ritual
In the quiet hours, when the users have logged off and the systems are at their most idle, a familiar ritual unfolds. It is a ceremony as old as networked computing itself: the nightly backup. We’ve been taught to revere this process, to treat its successful completion as a final, blessed sacrament of the day. The logs must show the transfer of bits from the living, breathing database to the cold, safe tomb of the archive. We are told this is the cornerstone of reliability. But I want to challenge this dogma. What if the unthinking, automated daily full backup is not a cornerstone but an expensive, performative crutch for our own anxieties?
The argument against it is not one of principle but of precision. A full backup of everything, every single day, is an act of profound waste. It consumes network bandwidth, storage IOPS, and, most critically, storage space itself, with a voraciousness we’ve come to accept as normal. We are hoarding versions of our data that are, for all practical purposes, identical to the ones we hoarded yesterday and the day before. We are preserving stagnation.
The common retort is one of simplicity: "It’s easier to just back it all up." But this is the logic of the hoarder, not the archivist. True reliability is not bred from thoughtless repetition but from intelligent design. It comes from understanding your data’s heartbeat—its rate of change, its points of fragility, its true value. A transactional database with a high write volume might require continuous log shipping. A vast, static filesystem of reference media might only need a checksum validation against its last known good state, taken perhaps quarterly.
This isn’t an argument against backups; it is an argument for a more thoughtful, less superstitious relationship with them. The goal is not to perform the ritual. The goal is verifiable recoverability. By fetishizing the daily run, we often neglect the harder, more important work: testing the restoration process. A backup that has never been restored from is a prayer, not a plan. It is faith-based ops. We pour resources into creating these perfect, sequential copies of the past, yet we balk at the cost of periodically fire-drilling their resurrection.
Let the daily full backup die. In its place, build a strategy that reflects the actual dynamics of your systems. Implement robust, incremental captures that respect the flow of data. Spend the reclaimed cycles not on moving unchanged bits from one place to another, but on the brutal, honest work of a restoration test. The true measure of our stewardship is not found in a log file that says ‘backup completed successfully.’ It is found in the terrifying, beautiful silence of a restored system, brought back from the grave we so meticulously dug for it, now proven to be a door and not a dead end.
Notes & further reading
A few pages I came back to while writing this:
- Oklahoma City, OK
- The Unblinking Eye of the Desert: On the Telegraph Repeater Men and Their Logs
- Tulsa, OK
- The Keeper of the Last Known Good
- Eugene, OR
- The Whisper in the Stone: On the Burden of the Write-Once Read-Never Log
- Portland, OR
- Salem, OR
- Philadelphia, PA
- Pittsburgh, PA
- Charleston, SC
- Columbia, SC
- Sioux Falls, SD