Should I use voice prosody or the Immersion SDK to measure emotional response in my app?
A model listens to pitch, pace, and tone and infers an emotional state. Voiceprint + emotion recognition. The Immersion SDK measures the body's response to what the brain is doing, on the device, with no biometric identifier, no health data leaving the device, and no emotion-recognition system.
| Voice prosody | Immersion SDK | |
|---|---|---|
| What it measures | Acoustic features of speech, mapped to arousal/valence or emotion labels. | Neurochemical signatures in cardiac rhythm, decoded into Value and Psychological Safety (0–100). |
| What it collects | Audio of the user's voice; often a voiceprint. | Nothing from the user. Your app passes sensor samples in; the Immersion SDK scores them in memory and discards them. It requires no HealthKit or Health Connect permission of its own. One activation call carrying your app credentials. No PII. |
| Passive | No | Yes |
| Timing | Only while the user is speaking; nothing between utterances. | Instant. |
| Biometric identifier | Yes | No |
| Health data leaves device | No | No |
| Emotion-recognition system | Yes | No |
| Predicts behavior | Weak. Confounded by language, accent, environment, and whether the person is performing. The same critique that undermines faces applies to voices: expression isn’t emotion. | Strong. Value predicts memory and behavior with 85–98% accuracy in published work. |
Voiceprint + emotion recognition
A voiceprint is a biometric identifier under BIPA, and 2026 has brought a wave of voiceprint class actions against AI products. Inferring emotion from voice is an emotion-recognition system under the EU AI Act with the same ban, disclosure duty, and high-risk classification as facial coding. Recording users also triggers wiretap and consent rules that vary by state.
In practice: Microphone permission plus biometric consent plus a disclosure that you’re analyzing how they sound. Coverage is limited to the moments they talk.
A prediction engine, not an emotion-recognition system.
No biometric identifier, so BIPA and its cousins don’t apply. No health data stored or transmitted, so nothing crosses a border that Apple, Google, or GDPR Article 9 would care about. No named emotions inferred, so it’s not an emotion-recognition system under the EU AI Act. It calculates from whatever sensor your app already reads and computes two behavioral predictors inside your app: a prediction engine that draws no inference from a face, a voiceprint, or a brain scan.
In practice: The Immersion SDK asks your users for nothing. It requires no HealthKit or Health Connect permission and no entitlement of its own: your app hands it samples from whatever source it already has (a BLE fitness sensor, a watch, a file) and it hands back Value and Safety. A BLE fitness strap feeding fitness data into your app needs no health permission at all. If your app reads heart rate through HealthKit or Health Connect, that permission is your app's requirement, not the Immersion SDK's. No biometric consent, no emotion-recognition disclosure, no health data leaving the device.
Where voice prosody persists, and why that doesn’t help
You’ll still find it in call-center QA and voice agents, because the audio already exists. It measures how someone sounds, which is a performance, not what they value, which is a response. People modulate their voice the moment they know it’s being scored, and Article 50(3) now requires you to tell them.
- Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019). Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological Science in the Public Interest, 20(1), 1–68. doi.org/10.1177/1529100619832930
Regulatory summaries are for orientation, not legal advice. Confirm classification for your own app with counsel.
Related
All guides- Why would heart rate tell you anything about the brain?The oxytocin → vagus nerve → cardiac rhythm mechanism, with citations.
- Heart rate vs HRV vs ImmersionWhat each metric can and can’t tell you, with five worked moments.
- How do I measure emotion in my app?Five ways to do it. Four make you liable for something. One doesn’t.
- Immersion vs facial codingBiometric identifier plus emotion recognition.
- Immersion vs HRVHealth data plus emotion recognition, without the science.
- Immersion vs surveysLawful, simple, and late.