Ep. 237: Beyond the 404: Building a Permanent Web with IPFS

Episode summary: Have you ever clicked a bookmarked link only to find a "404 Not Found" error? This phenomenon, known as link rot, is more than just an annoyance—it's a threat to our collective digital history. In this episode, Herman and Corn explore the InterPlanetary File System (IPFS), a revolutionary peer-to-peer protocol designed to make the web permanent. They break down the shift from location-based addressing to content-based addressing, explain the power of cryptographic hashes, and discuss the technical hurdles of decentralized storage. From space-travel latency to censorship resistance, discover why IPFS might be the backbone of a multi-planetary civilization and the cure for the internet's ephemeral nature.

Show Notes

The internet is often described as a vast, eternal library, but as hosts Herman and Corn discuss in their latest episode, it is actually closer to a library where the books are constantly vanishing off the shelves. This phenomenon, known as "link rot," is the focus of a deep dive into the InterPlanetary File System (IPFS) and the quest for digital permanence.

### The Fragility of the Modern Web The conversation begins with a sobering statistic: approximately twenty to thirty percent of links in academic and legal citations stop working within just a few years. Corn points out that when a third of the evidence for a history book or a legal brief evaporates, the entire foundation of the work is compromised. This fragility stems from how the current web is built—on a system called "location addressing."

Herman explains that when we use a standard URL, we are telling a browser to go to a specific IP address (a location) and look for a specific file name. If that server goes down, if the owner moves the file, or if the domain registration expires, the link breaks. The information might still exist somewhere else on the internet, but because the link points to a *place* rather than the *content*, the user is met with the dreaded 404 error.

### Content Addressing: A Fundamental Shift To solve this, Herman introduces the core concept of IPFS: content addressing. Instead of asking "Where is this file?", IPFS asks "What is this file?"

When a file is uploaded to IPFS, it is run through a cryptographic hash algorithm to produce a unique fingerprint called a Content Identifier (CID). This CID is unique to that specific arrangement of data; if even a single comma is changed in a document, the CID changes entirely. As Herman describes it, location addressing is like trying to find a person by visiting their last known house, whereas content addressing is like shouting a person's name into a crowd—anyone who knows them can point you in the right direction.

Because IPFS is a peer-to-peer network, if multiple people have the same file, the network can retrieve it from whoever is closest or fastest. This decentralization ensures that as long as at least one person on the network is "pinning" (hosting) the file, the information remains accessible to the world, regardless of what happens to the original author's website.

### The Challenge of Persistence and "Pinning" However, permanence is not automatic. Corn raises the important question of what happens if everyone stops hosting a file. Herman explains that IPFS nodes typically cache files they have recently accessed, but they will eventually clear that cache to make room for new data. To make a file truly permanent, a user must "pin" it, explicitly telling their node never to delete it.

This leads to a discussion on the current barriers to entry. While IPFS offers a "cure" for the ephemeral nature of the web, it is not yet particularly user-friendly. Herman notes that while browsers like Brave once experimented with native IPFS support, they eventually moved away from it due to low adoption. Currently, most users rely on "gateways"—bridges between the traditional web and IPFS—which reintroduces some of the centralization risks the system was designed to avoid.

### Why "InterPlanetary"? One of the most fascinating segments of the episode explores the ambitious name of the protocol. Herman clarifies that "InterPlanetary" isn't just a marketing gimmick; it is a technical solution to the speed of light.

On Earth, the "chatty" nature of HTTP—where browsers and servers send multiple messages back and forth to establish a connection—works because latency is low. But on a multi-planetary scale, the round-trip time for a signal between Earth and Mars can be up to twenty-four minutes. Using traditional HTTP on Mars to access a file on Earth would be impossibly slow.

IPFS solves this by allowing users on Mars to retrieve content from other users on Mars. If one person on the red planet has already downloaded a specific CID, everyone else on the planet can grab it from them locally. By addressing content by what it is rather than where it is, the network naturally optimizes for the nearest copy, making it a literal requirement for a future multi-planetary civilization.

### Censorship Resistance and the Tragedy of the Commons The hosts also tackle the ethical and economic implications of a decentralized web. Because IPFS is nearly impossible to shut down—Herman compares it to trying to remove a drop of ink from the ocean—it offers incredible protection against government censorship. However, this same quality makes content moderation difficult. In a decentralized world, moderation becomes a local choice for node operators rather than a global mandate.

Finally, the discussion turns to the "tragedy of the digital commons." If everyone consumes data but nobody wants to pay the cost of hosting and bandwidth, the network fails. Herman explains how Filecoin, a cryptocurrency built on top of IPFS, attempts to solve this by creating a marketplace for storage. By incentivizing users to host data, Filecoin adds an economic layer of permanence to the technical layer provided by IPFS.

### Conclusion: The Path to a Verifiable History As the episode concludes, Herman and Corn reflect on the evolution of the internet. Much like the early days of email, which required significant technical knowledge, digital permanence is currently in a "high barrier" phase. However, as services like Perma.cc emerge to help academics and lawyers snapshot their work, the move toward a more resilient web is well underway.

For Herman and Corn, IPFS represents more than just a technical protocol; it represents a way to create a verifiable, indestructible history of human knowledge. In an era of deepfakes and vanishing data, the ability to point to a unique, cryptographic fingerprint of the truth may be the most important innovation of all.

Listen online: https://myweirdprompts.com/episode/ipfs-digital-permanence-web