Deutsche Gesellschaft für Asienforschung · Roundtable: DH & KI in den Regionalwissenschaften

Dormant Digital Collections, AI Triage

Lessons from the Islam West Africa Collection and beyond

QR code linking to these slides online Scan for these slidesslides.frederickmadore.com

Who I am

A historian, working with AI

  • Data Curator, Cluster of Excellence "Africa Multiple", University of Bayreuth
  • Historian of Islam in Francophone West Africa since the 1960s — youth, women, politics, education
  • Developer of the Islam West Africa Collection (IWAC) since 2021
  • Coordinator, Digital Humanities and AI in African Studies
  • Edited volume forthcoming, Bielefeld University Press (2027)

The allure of the archive

From the reading room to the "scanning party"

The reading room
Book cover: The Allure of the Archives by Arlette Farge — a magnifying glass over an old handwritten manuscript

Farge (1989): the slow, tactile encounter — "touching the real".

The scanning party
An unsorted backroom: stacks of old newspapers and bound volumes piled on tables, chairs and a sofa, with a scanner in the foreground — awaiting digitisation

An unsorted backroom, photographed in three days.

The shift Thousands of JPEGs and hours of recordings, half-named, untouched for years — affect moves from slow intimacy to frantic accumulation.

From backlog to triage

One historian, no team

  • Fieldwork across West Africa, plus libraries in Berlin, Paris, Washington
  • Public side: the open-access IWAC — islam.zmo.de
  • Cataloguing it all by hand is impossible
The question I put to AI Not "read this for me" — but where is close reading worth my time?
A digital hoarder, in numbers
30,000+items collected (Zotero)
~15,000still unprocessed
14,500+open access (IWAC)
1historian, no team

Six uses of AI in the research workflow

1Text extractionOCR and HTR with multimodal models
2Audio & video transcriptionincluding under-resourced languages
3Entity & topic extractionwho, where, what, about what
4"No-code" visualisationthrough AI-assisted coding
5First-pass analysis at scalesentiment, classification, triage
6NotebookLMchat with your own sources

Multimodal LLMs read the page like a person

A multi-column Ivorian newspaper article, 'Les imams se battent', overlaid with red numbered markers showing the reading order that traditional OCR scrambles — labelled 'Layout recognition failure'

Layout recognition failure: traditional OCR scrambles a multi-column page.

  • Traditional OCR breaks on multi-column papers, tables, handwriting, quick phone scans
  • Even a 5–10% error rate matters: one typo in a name hides a document
  • "Ouédraogo" → "Oueclaoqo": the source is there, but no one will find it
  • Multimodal AI handles it in one pass: printed & handwritten, French & Arabic, messy layout

Reading printed Ewé

A 1976 page of the Togolese newspaper Togo Presse, printed in the Ewé language with full diacritics

Togo Presse, 31 July 1976.

Extracted text · Ewé
Loading the extraction…

Printed Ewé, diacritics and all — scroll for the full extraction.

Reading cursive French

A handwritten 1991 letter in French from Muslim associations in Burkina Faso addressed to the Minister of Information and Culture

Handwritten letter, Burkina Faso, 1991.

Transcribed text · French

3 H 1 a

Des musulmans du Burkina Faso,

  • Communauté Musulmane
  • Mouvement Sunite
  • Association de la Tidjania.

au Camarade Ministre de l'Information et de la Culture, Ouagadougou

Nous venons, par cette mise en garde, vous entretenir d'un sujet qui nous tourmente depuis des années. La goutte d'eau fait déborder le vase dit-on et c'est la raison pour laquelle nous pensons qu'il est temps de vous sensibiliser, de vous mettre en garde.

Mardi 16 avril 1991. Fête de fin du jeûne musulman. Journée chômée et payée en raison d'une loi de l'État.

Mardi 25 décembre 1990 Fête de la nativité, fête chrétienne Journée chômée et payée en raison d'une loi de l'État.

Il y a là une coïncidence heureuse mais facheuse à l'analyse.

Mardi 25 Decembre 1990. Jour de la semaine coïncidant avec une fête ; cette fête est chrétienne, le ministère décide : les mass media, patrimoine de tous les Burkinabè, sont à la disposition des chrétiens. La télévision qui d'ordinaire n'émet que les seuls samedis et dimanches dans la journée s'organise et dès 12h30, elle émet et diffuse le message chretien jusqu'à la nuit.

Mardi 16 avril 1991 Egalement jour de la semaine coïncidant avec une fête. Cette fête est musulmane. Le ministère occulte : la direction de l'information fait comme bon lui semble. La Télé

Highlighted: the writer's own spelling slips, kept verbatim — the model didn't silently correct them.

Audio and video transcription

  • The same multimodal logic extends to audio and video
  • Transcripts return with timestamps and speaker labels
  • IWAC corpus: ~155 hours of Nigerian preachers, mostly Hausa & Arabic
  • Early tests in Hausa, Arabic, Kurmanji Kurdish — promising as a first draft
A video still from the IWAC audiovisual corpus: a preacher delivering a sermon titled Demokuradiyyah A timestamped, speaker-labelled transcript of a Hausa and Arabic sermon, generated with Google gemini-3-pro
A sermon and its machine transcript — timestamps, speaker labels.

A caution

Cleaner than the source

  • AI-OCR and audio-to-text open previously unusable material
  • The model silently modernises spellings, standardises toponyms, smooths regional variants
  • It can also hallucinate: invent text that was never there
  • The failure mode is harder to spot: a fluent paragraph with invented detail
The discipline Keep the original image alongside the text. Verify against the scan before you quote.

Entities and topics: who, where, what, about what

A network graph from the IWAC dashboard linking a central figure to the people, organisations and places that co-occur with him across the corpus

Entities linked across the corpus.

  • Manual keyword tagging: unworkable across thousands of documents
  • Standard DH tools trained on Western text — they miss local names
  • OCR noise compounds the problem
  • LLMs extract not just entities but topics, given the right prompt

From text repository to knowledge base

An explorable layer over the documents — built without hand-written code.

A world map from the IWAC dashboard with article counts plotted by location, concentrated in West Africa
Mapped · articles by place
A network graph linking people, organisations and places that co-occur across the IWAC corpus
Linked · who appears with whom
A heat-map matrix showing how themes such as radicalisation, extremism, terrorism and jihadism co-occur across articles
Co-occurrence · themes that travel together
A word cloud of the most frequent terms across the corpus, led by musulmans, président and pays
Topics · the corpus at a glance

Sentiment analysis, without writing code

The IWAC Sentiment Analysis dashboard comparing three AI models across 12,287 articles, with discrepancy counts and breakdowns by polarity and subjectivity

Three models compared, article by article. fmadore.github.io/IWAC-sentiment-analysis ↗

  • 12,000+ articles, three LLMs, three axes: polarity towards Islam, subjectivity, centrality of religion
  • ~€35 and 24 hours of batch processing — months of manual coding avoided
  • Triage, not full reading; model disagreement is itself a signal
A pattern I'd have missed Positive portrayals of Muslim communities inside Sahelian terrorism coverage.

NotebookLM: the lowest-friction entry point

The NotebookLM interface loaded with IWAC newspaper articles: uploaded sources on the left, an answer with inline citations in the centre

NotebookLM over the IWAC newspaper corpus.

  • Only knows what you upload; cites the exact passage for every answer
  • Your sources are not used to train models
  • Free tier: 50 sources per notebook (PDF, web, YouTube, audio)
  • Multilingual: ask in your language, it searches sources in any of 80+
QR code to a shared NotebookLM notebook of the IWAC newspaper corpus Live demo · scan to query the corpus

The stakes

Western tools, non-Western sources

The costs
  • Training data overwhelmingly Western — concepts read through European lenses
  • Labour: Kenyan annotators paid ~$5/day; similar conditions elsewhere
  • Infrastructure: strongest models in US firms; only China credible as an alternative
  • Opaque and non-reproducible: the same input can yield different answers
What it makes possible

Research at scales, and with documents, not previously feasible — degraded scans, under-resourced languages, corpora too large to read.

Held in tension Neither uncritical adoption nor refusal. Use the tools, and disclose what they cost.

In closing

The scans on our hard drives are the raw material

  • The technology is no longer the obstacle — small teams, no deep coding required
  • Models you can download and run on a university server — evolving fast
  • AI organises; we interpret. Always.
  • Experiment with sources you know well, so you can catch the errors
QR code linking to these slides online Scan for these slidesslides.frederickmadore.com