BeyondSingularity

← Data Privacy, Ethics and Society outline

Module 08 / 14  ·  Phase 3 — Surveillance, power, and asymmetry

8. The end of withholding: when the machine surfaces what no one could see

This week in the arc

Coming from

Weeks 6–7 showed surveillance assembling what was scattered — the state and the employer finding what already existed in a record.

Going to

Week 9 turns to automated judgment: once the machine can know you, what happens when it decides about you.

Core

Every privacy regime we have studied assumes one thing: that you know what you are revealing. Consent assumes it. “Reasonable expectation” assumes it. Guarding a secret assumes you can name the secret. This week we examine the capability that breaks that assumption — a model surfacing a fact that already existed, was true, and lived latent inside data you did not know carried it.

The claim to test all week: this is not surveillance made faster. It is the collapse of the line between what you disclose and what you withhold — and with it, privacy as something you can practice. Hold that claim skeptically. Your job is to decide whether it is real or merely frightening.

Cases — tagged by category, name the kind before you react

The retina that reveals your sex extraction of the latent

A deep-learning model reads age, sex, blood pressure, and smoking history off a retinal photograph — attributes no ophthalmologist can see. The fact was in the image; every human was blind to it.

The photograph that gave up a location extraction of the latent

A fugitive located from a featureless corner of a partner’s post — no geotag, no landmark. The coordinate existed nowhere until the model produced it from pixels no eye could read.

Predictive targeting from fused sources aggregation — contrast case

A system paints targets by fusing social posts, pings, and records. Included as the foil: everything it uses already existed. Old harm, vast scale — not the new category. Be ready to defend the distinction.

Reading

Required Staab et al., on inferring personal attributes from text with no explicit identifiers. ETH Zurich, 2023
Required Poplin et al., predicting cardiovascular factors from retinal images. Nature Biomedical Engineering, 2018
Recommended Systematic review, voice biomarkers for early neurological detection. 2025

Discussion

  • What could a 2026 model infer about a person that a determined 1970s bureaucracy genuinely could not — and what is merely cheaper now?
  • If you cannot know what you are transmitting, can you meaningfully consent to anything? What survives of consent?
  • Where exactly does the targeting case differ from the retina case — and why does that difference matter more than the body count?