The Marginalian
The Marginalian

FaceSense: Mind-reading from MIT

We have a longstanding fascination with the human face and the wealth of data that it holds. Now, the Affective Computing Group at the MIT Media Lab (another Brain Pickings darling) has developed FaceSense — a software application that detects head and face gestures in real time, analyzes them and deduces information about the person’s emotional disposition and mental state.

The principle, of course, is nothing new — back in the late 70’s, legendary psychologist Paul Ekman pioneered FACS, the Facial Actions Coding System, which is used to this day by anyone from academic researchers to the CIA to draw information about cognitive-affective states based on the micromuscle contractions of the human face. Though the MIT project doesn’t explicitly disclose it, we bet the data encoding is based, at least to some degree, on FACS.

But what makes FaceSense different and important is that it enables the extraction of such cognitive-affective information from pre-recorded video. And in the midst of all the neuromarketing hype — which is, for the most part, just that: hype — it offers an interesting model for collecting consumer psychology insight remotely, a scalable and useful tool for the age of telecommuting and sentiment analysis. What’s more, it helps bypass the quintessential unreliability of self-report in product testing.

Its applications can, of course, extend far beyond the marketing industry. An accurate disposition detection model for video can be used in anything from analyzing politicians’ televised appearances to testing news anchors for bias. And, judging by the abundance of all things video at CES this year, FaceSense has firmly planted its feet in a rich and ever-expanding space.


Published January 12, 2010

https://www.themarginalian.org/2010/01/12/facesense/

BP

www.themarginalian.org

BP

PRINT ARTICLE

Filed Under

View Full Site

The Marginalian participates in the Bookshop.org and Amazon.com affiliate programs, designed to provide a means for sites to earn commissions by linking to books. In more human terms, this means that whenever you buy a book from a link here, I receive a small percentage of its price, which goes straight back into my own colossal biblioexpenses. Privacy policy. (TLDR: You're safe — there are no nefarious "third parties" lurking on my watch or shedding crumbs of the "cookies" the rest of the internet uses.)