Invention Grant
- Patent Title: Self-adaptive matrix completion for heart rate estimation from face videos under realistic conditions
-
Application No.: US15631346Application Date: 2017-06-23
-
Publication No.: US10335045B2Publication Date: 2019-07-02
- Inventor: Niculae Sebe , Xavier Alameda-Pineda , Sergey Tulyakov , Elisa Ricci , Lijun Yin , Jeffrey F. Cohn
- Applicant: Universita' degli Studi di Trento (University of Trento) , Fondazione Bruno Kessler (Bruno Kessler Foundation) , The Research Foundation for The State University of New York , University of Pittsburgh—Of The Commonwealth of Higher Education
- Applicant Address: IT Trento IT Trento US NY Binghamton US PA Pittsburgh
- Assignee: Universita degli Studi Di Trento,Fondazione Bruno Kessler,The Research Foundation for the State University of New York,University of Pittsburgh of the Commonwealth of Higher Education
- Current Assignee: Universita degli Studi Di Trento,Fondazione Bruno Kessler,The Research Foundation for the State University of New York,University of Pittsburgh of the Commonwealth of Higher Education
- Current Assignee Address: IT Trento IT Trento US NY Binghamton US PA Pittsburgh
- Agency: Tully Rinckey PLLC
- Agent Steven M. Hoffberg
- Main IPC: G06K9/00
- IPC: G06K9/00 ; A61B5/024 ; G06T7/00 ; G06T7/11 ; G06T7/90 ; G06T3/00 ; A61B5/00 ; G06K9/46 ; A61B5/021 ; A61B5/11 ; A61B5/16

Abstract:
Recent studies in computer vision have shown that, while practically invisible to a human observer, skin color changes due to blood flow can be captured on face videos and, surprisingly, be used to estimate the heart rate (HR). While considerable progress has been made in the last few years, still many issues remain open. In particular, state-of-the-art approaches are not robust enough to operate in natural conditions (e.g. in case of spontaneous movements, facial expressions, or illumination changes). Opposite to previous approaches that estimate the HR by processing all the skin pixels inside a fixed region of interest, we introduce a strategy to dynamically select face regions useful for robust HR estimation. The present approach, inspired by recent advances on matrix completion theory, allows us to predict the HR while simultaneously discover the best regions of the face to be used for estimation. Thorough experimental evaluation conducted on public benchmarks suggests that the proposed approach significantly outperforms state-of-the-art HR estimation methods in naturalistic conditions.
Public/Granted literature
- US20170367590A1 SELF-ADAPTIVE MATRIX COMPLETION FOR HEART RATE ESTIMATION FROM FACE VIDEOS UNDER REALISTIC CONDITIONS Public/Granted day:2017-12-28
Information query