We are strongly motivated by the applications of our algorithmic innovations in the emerging area of interactive experiential systems: as diverse as real-time feedback for stroke and Parkinson’s rehab, to media-systems for general well-being, to next generation of interactive performative techniques. We collaborate widely with researchers in bio-mechanics, exercise science, physical therapy, and media-arts. In many of these application, our core approach is to model underlying dynamical processes relevant to the human activity of interest, and extract interpretable data streams which can be used to drive real-time feedback via sonification, haptification, and other diverse forms of sensorial feedback. Some of our sample work in this area is given below.
Hongjun Choi , Qiao Wang, Meynard Toledo, Pavan Turaga, Matthew Buman, Anuj Srivastava, “Temporal Alignment Improves Feature Quality: an Experiment on Activity Recognition with Accelerometer Data”, 4th International Workshop on Differential Geometry in Computer Vision and Machine Learning (DiffCVML) in conjunction with IEEE CVPR 2018.
Vinay Venkataraman, Pavan Turaga, Michael Baran, Nicole Lehrer, Tingfang Du, Long Cheng, Thanassis Rikakis, and Steven L. Wolf, “Component-Level Tuning of Kinematic Features from Composite Therapist Impressions of Movement Quality”, at IEEE Journal on Biomedical and Health Informatics (J-BHI) 2016. [pdf]
Michael Baran, Nicole Lehrer, Margaret Duff, Vinay Venkataraman, Pavan Turaga, Todd Ingalls, Zev Rymer, Steven L. Wolf, and Thanassis Rikakis, “Interdisciplinary Concepts for Design and Implementation of Mixed Reality Interactive Neurorehabilitation Systems for Stroke”, at the American Physical Therapy Association’s Physical Therapy Journal (APTA-PTJ) 2015. [pdf]
V. Venkataraman, P. Turaga, N. Lehrer, M. Baran, T. Rikakis, S. L. Wolf, “Decision Support for Stroke Rehabilitation Therapy via Describable Attribute-based Decision Trees”, in International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), August 2014. [pdf]
Q. Wang, P. Turaga, G. Coleman, T. Ingalls, “SomaTech: An Exploratory Interface for Altering Movement Habits”, in ACM CHI Conference on Human Factors in Computing Systems Extended Abstracts, April 2014. [pdf]
A. Som, R. Anirudh, Q. Wang, P. Turaga, “Riemannian Geometric Approaches for Measuring Movement Quality”, 2nd International workshop on Differential Geometry in Computer Vision and Machine Learning (DiffCVML), held in conjunction with CVPR 2016.
Varsha Iyengar, Grisha Coleman, David Tinapple, and Pavan Turaga. 2016. Motion, Captured: an Open Repository for Comparative Movement Studies. In Proceedings of the 3rd International Symposium on Movement and Computing (MOCO ’16).
Michael Krzyzaniak, Rushil Anirudh, Vinay Venkataraman, Pavan Turaga and Xin Wei Sha, “Towards Realtime Measurement of Connectedness in Human Movement”, in 2nd International Workshop on Movement and Computing (MOCO), August 2015.