Complete virtual unwrapping and reading of a rolled Herculaneum papyrus

TL;DR: A carbonized scroll from Herculaneum — a lump of charcoal that nobody has been able to open in 2,000 years — has been digitally unrolled in its entirety and read by papyrologists, column by column, without anyone touching a sheet of papyrus. The same pipeline recovered the title of a second sealed scroll (Philodemus, On Gods, Book 8 — a book nobody knew existed), and in a third scroll the new scan protocol makes the ink directly visible in the raw CT volume, providing a physical ground-truth check on the ML ink detector. This is the Vesuvius Challenge graduating from "we found some letters" to "we read the whole book," and the interesting engineering questions are all about what remains bespoke versus automated.

The problem: reading charcoal writing on charcoal paper inside a charcoal brick

The Villa of the Papyri at Herculaneum holds the only large library to survive from classical antiquity. Vesuvius carbonized the scrolls in 79 AD, which paradoxically preserved them — but as brittle, fused rolls where opening means destroying. The paper's Methods section gives a grim case study: PHerc. 1667, the star of this work, was attacked physically three separate times (19th century, 1969, 1980s). Those attempts shrank it from 4.9 cm to 2 cm in diameter and from 14 g to ~6 g, yielded essentially nothing readable, and got it classified as unreadable.

X-ray microtomography plus "virtual unwrapping" is the obvious non-invasive route, and it has worked before on other materials (the En-Gedi scroll, locked letters). Herculaneum is the hard mode, for two compounding reasons:

1. No contrast. The ink is mostly carbon; the papyrus is carbon; carbonized papyrus absorbs hard X-rays about the same everywhere. There is no reliable single ink signature — depending on the recipe and preservation, writing manifests as faint metallic contrast, micron-scale surface relief, or subtle texture.
2. No geometry. The roll's hundreds of windings are crushed together, delaminated, torn, and fused. Before you can look for ink, you must trace a single continuous ~15 µm-thick sheet through tens of terabytes of voxels, without hopping between adjacent windings.

The Vesuvius Challenge (2023–) cracked local versions of both problems, producing multi-column readings from patches of PHerc. Paris 4 and later a title from PHerc. 172. What was missing was end-to-end completeness: every preserved square centimeter of one sealed scroll, unrolled, rendered, and put in front of papyrologists under explicit review criteria. That is what this paper claims, and it defines its terms carefully — a welcome habit in a field prone to breathless headlines.

The pipeline, and where the cleverness lives

Imaging: a sweet spot between phase contrast and "decoherence." Since absorption contrast is nearly nil, everything rides on propagation-based phase contrast — letting the X-ray wavefront self-interfere over a propagation distance so that refractive-index boundaries (sheet edges, ink deposits) produce fringes. But carbonized papyrus fights back: graphite scatters efficiently, and the papyrus's cellular microstructure acts like a field of tiny refractive lenses that scramble the beam. The authors call this decoherence — it blurs projections and destroys exactly the fine detail you wanted. More propagation distance or lower energy gives more phase contrast but more decoherence blur. The Extended Data documents systematic sweeps over energy (62–140 keV), propagation distance (0.07–10 m), and pixel size (0.55–9.4 µm), landing on 2.4 µm voxels, 78 keV, 22 cm propagation as the largest-scale regime that keeps layers separable without visible decoherence. Scans are helical, laterally tiled (up to four offset positions), with angular overlap-correlation to correct tens-of-microns sample drift, then Paganin phase retrieval (\delta/\beta = 1000) plus unsharp masking. Each scroll volume averages ~20 TB.

Geometry: neural cues, explicit mesh, human approval. A 3D residual U-Net (nnU-Net-style, trained with a "Medial Surface Recall" loss adapted from Skeleton Recall for thin structures) segments the recto surface. Critically, that segmentation is not the answer — dense predictions merge sheets and leave holes in compressed regions. Instead, the predictions are distilled into local orientation evidence, and an explicit quadrilateral mesh is grown patch-by-patch from seeds, optimized to balance spacing, smoothness, and agreement with the evidence. Humans then correct it in an interactive editor (push/pull vertices, inspect mesh–slice intersections) and stamp approved regions. Flattening uses SLIM with a symmetric Dirichlet energy for near-isometric parameterization. Rendering samples 65 slices along the surface normal (±32 voxels, ≈154 µm total) so ink signal slightly off-surface is captured.

Ink: a visibility amplifier, deliberately hobbled against hallucination. Supervision starts from detached fragments where writing is exposed: infrared photos are registered to CT-derived surface renderings, giving pixel-accurate ink labels with no depth information. The detector is a U-Net with a 3D ResNet encoder and 2D decoder — depth features are max-pooled away, matching the 2D nature of the labels. Then a bootstrapping loop transfers to sealed scrolls: fine-tune, run inference scroll-wide, crop newly revealed regions, pseudo-label from the model's own outputs, repeat (~5 iterations, with a held-out column showing saturation).

The anti-hallucination argument deserves attention because it is the crux of whether any of the transcription can be trusted. The model never sees character identities, transcriptions, or any lexical target — only "ink here / not here" masks. And its receptive field is a 256-pixel window (~614 µm), smaller than any letter. Each forward pass sees only a stroke fragment and local papyrus texture; there is no context from which to invent a plausible letterform, let alone a plausible word. No OCR or language model touches inference or pseudo-labels.

Three results, three kinds of evidence

PHerc. 1667 — the complete unwrap. 31 wraps, 1231 cm² of traced papyrus, ~860 cm² of preserved writing surface, 22 columns. Every column was reviewed by eight papyrologists under three acceptance criteria: the mesh must sit geometrically tight on the layer in the CT volume, letterforms must be stable across renderings and inference passes, and readings must reach independent endorsement or consensus. The full Greek transcription with standard papyrological uncertainty conventions is in the paper. Only 33 cm² (the shredded first three columns) was left untranscribed. The content: the closing columns of a philosophical treatise on ethics, with a mention of the Stoic Aristocreon (nephew of Chrysippus) that dates the scroll to the 2nd century BC — making it one of the older items in the library, and a Stoic text in a predominantly Epicurean collection.

PHerc. Paris 4 — the validation loop closes. This is arguably the most scientifically important result for anyone worried about ML artifacts. Under the optimized scan, ink deposits in this scroll are directly visible in the tomographic volume as bright surface-associated flakes 10–20 µm thick. They can be segmented in 3D (via a DINOv2-style 3D ViT embedding: an expert clicks a few inked voxels, cosine similarity to the mean embedding gives dense ink-likeness, intersected with an independent detector, then student-distilled) and projected onto the flattened surface — where they reproduce the 2023 Vesuvius Challenge Grand Prize reading. The surface-conditioned ink models were, at least here, amplifying real physical deposits, not learned texture coincidences. This converts a plausibility argument into a physical one.

PHerc. 139 — library metadata. From a title-bearing region: Φ̣ι[λοδ]ή̣μου περὶ θεῶν Η̅ — "Philodemus, On Gods, Book 8." Until now only Book 1 was known to exist. A single title line tells you the work ran to at least eight books, gives author, date bracket, and — this is the scalable insight — shows that even scrolls whose prose isn't fully readable yet can be catalogued. Recovered phrases ("without providence," "everything free from troubles") already sketch the treatise's theological program.

How much should you believe, and what doesn't scale yet

The claims are carefully bounded and the review process is unusually rigorous for a paper with "machine learning" in it. Still, calibrate:

"Complete" is complete relative to what survives. PHerc. 1667 is a midollo — the inner core left after opening attempts destroyed the outer layers: 8 cm tall (of a typical 19–24 cm roll) and 2 cm in diameter (of 4–6 cm). Reading a full-size, fully intact scroll end to end remains undemonstrated, and the paper's own Extended Data shows decoherence gets worse with larger, denser samples. The title of 1667 itself was likely in the lost upper portion.

The human cost is enormous. ~25 hours of manual mesh annotation per wrap × 31 wraps ≈ 775 expert-hours of geometry work for one small scroll, before eight papyrologists start reading. The surface segmentation network's validation Dice on the surface class is 0.308 (Supplementary Table 1) — the network is a cue generator, not a solution, and the authors are honest that compressed regions with sheet mergers still break automated tracing. The Discussion names the two bottlenecks plainly: geometry in compressed regions, and ink contrast that varies with recipe and degradation. For the "hundreds of unopened rolls," the per-scroll manual burden is the difference between a decade-long program and a century-long one.

Ink visibility is scroll-dependent. Paris 4's directly visible ink validates the method for that scroll's ink and preservation state. Other scrolls sit in what the authors call a "mixed-signal regime" where the detector integrates topography, density, and texture cues that can't yet be disentangled — so the Paris 4 validation doesn't automatically transfer.

What can't be checked externally: there is no independent ground truth for PHerc. 1667's text (that's the point of the exercise). Confidence rests on the stability criteria, the hallucination-resistant architecture, and the Paris 4 physical cross-check. That's a reasonable evidential chain, but it's a chain, not a direct measurement.

Why this matters beyond papyrology

If the workflow generalizes, an entire ancient library — the only one we have — becomes readable. Most surviving classical literature passed through a medieval copying bottleneck; Herculaneum is a direct, unfiltered sample of what a 1st-century philosophical library actually contained. One paper just added an unknown Stoic treatise and six unknown books of Philodemus to the ledger.

For an ML audience, two things stand out as transferable patterns. First, the auditable-pipeline design: keeping an explicit geometric representation so every model output is traceable to raw data, with error types (geometry vs. interpretation) separable — a template for any scientific ML system where hallucination is catastrophic. Second, the anti-hallucination-by-construction move: constraining the model's receptive field below the semantic unit of interest, so the human, not the network, does the reading. It's a clean answer to "how do you trust a neural net to reveal text nobody has ever seen?"

Where to spend your time in the paper: Extended Data Fig. 2 and the tomographic-scanning Methods, which contain the genuinely novel physics (the decoherence/phase-contrast tradeoff and the parameter sweeps that found the operating point); then the "Ink detection: from fragments to sealed scrolls" Methods for the pseudo-labeling loop and its held-out-column ablation. The transcription itself, if your Greek is up to it, is a bonus: eleven columns of a Stoic arguing that once trained by inquiry, "we will no longer be inferior to them in any respect" — recovered from a lump of charcoal by a synchrotron and a U-Net.