A working archive room · stage one: catalogue
Research workflow · 01

Making Archives Searchable

Organize first. Automate carefully. Preserve the route from a useful search result back to the record that produced it.

A documentary research room is not merely a folder containing digitized files. It is a structured account of materials: who created them, where they are held, what the descriptions mean, what can be used, and how the production has handled them. Artificial intelligence can speed up parts of this work, but it cannot supply missing archival context by sounding confident. The aim is not to make every item appear equally searchable. It is to help researchers find relevant material without obscuring the differences among records.

Start with inventory and scope

Before using automated tools, make an inventory of the material already in hand. Record the repository or lender, collection name, reference or accession identifier, file name, physical or digital format, date range, creator when known, rights information, and the person responsible for the copy. Distinguish original source items from later scans, working transcripts, catalogue exports and production derivatives. A photograph of a letter, a repository scan and an OCR text file may all relate to one item, but each has a different role and quality.

Decide what the project needs to retrieve. A team looking for the public response to a strike may need newspaper articles, union minutes, correspondence, photographs and oral histories. A search interface should not flatten those records into a single undifferentiated pile. Keep the repository’s language and identifiers alongside project-added tags, and mark the difference between a supplied description and an editorial keyword.

Prepare material without losing its identity

AI tools can assist with handwriting recognition, speech transcription, image classification, entity extraction and duplicate detection. These outputs are working aids. Preserve the untouched source file and store each derived version separately. Give the derivative a stable name that references the source identifier, record the tool and date of processing, and note whether a human corrected the result. Avoid overwriting a transcript with a revised version: version history helps a later researcher understand why wording changed.

Optical character recognition may mistake a damaged letter for a different word, merge columns, or miss marginal notes. Speech recognition may normalize dialect, omit a speaker’s hesitation, or attribute a phrase to the wrong person. A vision model may label a uniform, place or activity with unwarranted certainty. Keep a review status such as “unreviewed,” “spot-checked” or “checked against source,” and make the status searchable. If a source is illegible or ambiguous, describe that limit plainly rather than asking a model to fill the gap.

Build retrieval around useful context

Search improves when each record has consistent, modest metadata. A practical project schema might include collection, source identifier, creator, date or date range, place, people named, document type, subject terms, language, rights status, confidence notes and links to related items. Do not demand false precision: unknown dates should remain unknown, not be guessed from a model’s pattern recognition. Use controlled terms where a repository or discipline already provides them, and maintain a local glossary for project-specific wording.

Semantic search can help when a researcher remembers an idea but not the exact phrase used in a document. Treat its results as leads, not citations. Show the matched text, its location in the source and the search method. Test retrieval with known examples and with spelling variations, names, period terminology and negative cases. If the interface returns a useful result, ask whether it also surfaces contradictory evidence or simply repeats the material most similar to the query.

Keep human review proportionate

Review can be prioritized by risk. A low-stakes tag used to sort a large collection may need sampling and correction. A name attached to an allegation, a quotation used in narration or a date that anchors a sequence requires direct checking. Record who reviewed the item and what was checked. Make it possible to return from a result to the original scan, recording or repository description without relying on a generated summary.

Access control matters too. Sensitive interviews, personal data, donor restrictions and culturally restricted material should not be uploaded to a third-party service without an authorized assessment. Teams should know where data is processed, how long it is retained, whether it can train another system, and who can access it. When those terms are unclear, use a local workflow or avoid processing the material.

Make the catalogue useful after production

Good organization is a form of stewardship. Keep a data dictionary, naming convention, source register, transformation log and handover note. Explain which descriptions came from the repository, which tags the team added, how generated outputs were checked, and which records could not be reviewed. The finished documentary may condense years of research into a short sequence; a carefully kept catalogue lets another researcher see what supported that sequence and where its boundaries lie.

For terminology and practice, compare project choices with Describing Archives: A Content Standard from the Society of American Archivists, ISAD(G) from the International Council on Archives, and finding aids published by institutions such as the Library of Congress and The National Archives. These frameworks do not remove project judgment. They make the assumptions behind description easier to inspect.

Working checklist

  • Keep original files and derived machine outputs separate.
  • Preserve stable identifiers and repository descriptions.
  • Label automated work and human review status.
  • Test search against known records and relevant counterexamples.
  • Protect restricted material and document the processing route.

Next: Following a Claim to Its Source · Assembling the Visual Argument.