Raina Langevin
Skip Abstract Section
Abstract
There are about 900,000 people with Parkinson's disease (PD) in the United States. Even though there are benefits of early treatment, unfortunately, over 40% of individuals with PD over 65 years old do not see a neurologist. It is often very difficult for these individuals to get to a physician's office for diagnosis and subsequent monitoring. To address this problem, we present PARK, Parkinson's Analysis with Remote Kinetic-tasks. PARK instructs and guides users through six motor tasks and one audio task selected from the standardized MDS-UPDRS rating scale and records their performance via webcam. An initial experiment was conducted with 127 participants with PD and 127 age-matched controls, in which a total of 1,778 video recordings were collected. 90.6% of the PD participants agreed that PARK was easy to use, and 93.7% mentioned that they would use the system in the future. We explored objective differences between those with and without PD. A novel motion feature based on the Fast Fourier Transform (FFT) of optical flow in a region of interest was designed to quantify these differences in the collected video recordings. Additionally, we found that facial action unit AU4 (brow lowerer) was expressed significantly more often, while AU12 (lip corner puller) was expressed less often in various tasks for participants with PD.
- Amir Abdolahi, Michael T Bull, Kristin C Darwin, Venayak Venkataraman, Matthew J Grana, E Ray Dorsey, and Kevin M Biglan. A feasibility study of conducting the montreal cognitive assessment remotely in individuals with movement disorders. Health Informatics Journal, 22(2):304--311, 2016. PMID: 25391849.Google Scholar
Cross Ref
- Mohammad Rafayet Ali, Kimberly Van Orden, Kimberly Parkhurst, Shuyang Liu, Viet-Duy Nguyen, Paul Duberstein, and M Ehsan Hoque. Aging and engaging: A social conversational skills training program for older adults. In 23rd International Conference on Intelligent User Interfaces, pages 55--66. ACM, 2018. Google ScholarDigital Library
- Monica Anderson and Andrew Perrin. Technology use among seniors, May 2017. URL http://www.pewinternet.org/2017/05/17/technology-use-among-seniors/.Google Scholar
- Andrew Arch, Shadi Abou-Zahra, and W3C Web Accessibility Initiative (WAI). Developing websites for older people: How web content accessibility guidelines (wcag) 2.0 applies, January 2018. URL https://www.w3.org/WAI/older-users/developing/.Google Scholar
- S. Arora, V. Venkataraman, A. Zhan, S. Donohue, K.M. Biglan, E.R. Dorsey, and M.A. Little. Detecting and monitoring the symptoms of parkinson's disease using smartphones: A pilot study. Parkinsonism & Related Disorders, 21(6):650--653, 2015. ISSN 1353-8020. URL http://www.sciencedirect.com/science/article/pii/S1353802015000814.Google ScholarCross Ref
- S. Arora, V. Venkataraman, A. Zhan, S. Donohue, K.M. Biglan, E.R. Dorsey, and M.A. Little. Detecting and monitoring the symptoms of parkinson's disease using smartphones: A pilot study. Parkinsonism and Related Disorders, 21(6):650--653, June 2015.Google ScholarCross Ref
- Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency. Openface: an open source facial behavior analysis toolkit. In IEEE Winter Conf. Applicat. of Comput. Vision, 2016. URL http://ieeexplore.ieee.org/document/7477553/.Google ScholarCross Ref
- Andrea Bandini, Silvia Orlandi, Hugo Jair Escalante, Fabio Giovannelli, Massimo Cincotta, Carlos A Reyes-Garcia, Paola Vanni, Gaetano Zaccara, and Claudia Manfredi. Analysis of facial expressions in parkinson's disease through video-based automatic methods. Journal of neuroscience methods, 281:7--20, 2017.Google Scholar
- CA Beck, DB Beran, KM Biglan, and et al. National randomized controlled trial of virtual house calls for parkinson disease. Neurology, 89(11):1152--1161, September 2017.Google ScholarCross Ref
- Shirley Ann Becker. A study of web usability for older adults seeking online health resources. ACM Trans. Comput.-Hum. Interact., 11(4): 387--406, December 2004. ISSN 1073-0516. URL http://doi.acm.org/10.1145/1035575.1035578. Google ScholarDigital Library
- A. Berenguer, J. Goncalves, S. Hosio, D. Ferreira, T. Anagnostopoulos, and V. Kostakos. Are smartphones ubiquitous?: An in-depth survey of smartphone adoption by seniors. IEEE Consumer Electronics Magazine, 6(1):104--110, Jan 2017. ISSN 2162-2248.Google ScholarCross Ref
- EL Berry, RI Nicolson, JK Foster, Marlene Behrmann, and HJ Sagar. Slowing of reaction time in parkinsons disease: theinvolvement of the frontal lobes. Neuropsychologia, 37(7):787--795, 1999.Google ScholarCross Ref
- Matteo Bologna, Giovanni Fabbrini, Luca Marsili, Giovanni Defazio, Philip D Thompson, and Alfredo Berardelli. Facial bradykinesia. J Neurol Neurosurg Psychiatry, 84(6):681--685, 2013.Google ScholarCross Ref
- Matteo Bologna, Isabella Berardelli, Giulia Paparella, Luca Marsili, Lucia Ricciardi, Giovanni Fabbrini, and Alfredo Berardelli. Altered kinematics of facial emotion expression and emotion recognition deficits are unrelated in parkinson's disease. Frontiers in neurology, 7: 230, 2016. ISSN 1664-2295. URL http://europepmc.org/articles/PMC5155007.Google Scholar
- Brian M. Bot, Christine Suver, Elias Chaibub Neto, Michael Kellen, Arno Klein, Christopher Bare, Megan Doerr, Abhishek Pratap, John Wilbanks, E. Ray Dorsey, Stephen H. Friend, and Andrew D. Trister. The mpower study, parkinson disease mobile data collected using researchkit. Scientific Data, 3(160011), March 2016.Google Scholar
- Abdul Haleem Butt, Erika Rovini, Dario Esposito, Giuseppe Rossi, Carlo Maremmani, and Filippo Cavallo. Biomechanical parameter assessment for classification of parkinsonâĂŹs disease on clinical scale. International Journal of Distributed Sensor Networks, 13(5): 1550147717707417, 2017.Google ScholarCross Ref
- CDC. National center for health statistics: Parkinson's disease mortality by state, 2016. URL https://www.cdc.gov/nchs/pressroom/sosmap/parkinsons_disease_mortality/parkinsons_disease.htm.Google Scholar
- Pew Research Center. Internet/broadband fact sheet, February 2018. URL http://www.pewinternet.org/fact-sheet/internet-broadband/. Google ScholarDigital Library
- AR Cools, J Horstink van den Bercken, MW Horstink, KP Van Spaendonck, and HJ Berger. Cognitive and motor shifting aptitude disorder in parkinson's disease. Journal of Neurology, Neurosurgery & Psychiatry, 47(5):443--453, 1984.Google ScholarCross Ref
- E. Dorsey, V. Venkataraman, M.J. Grana, and et al. Randomized controlled clinical trial of "virtual house calls" for parkinson disease. JAMA Neurology, 70(5):565--570, 2013.Google ScholarCross Ref
- E. Ray Dorsey and Eric J. Topol. State of telehealth. New England Journal of Medicine, 375(2):154--161, 2016. PMID: 27410924.Google ScholarCross Ref
- E. Ray Dorsey, Alistair M. Glidden, Melissa R. Holloway, Gretchen Lano Birbeck, and Lee Schwamm. Teleneurology and mobile technologies: the future of neurological care. Nature Reviews Neurology, 14:285--297, 2018.Google ScholarCross Ref
- E.R. Dorsey, S. Papapetropoulos, M. Xiong, and K. Kieburtz. The first frontier: Digital biomarkers for neurodegenerative disorders. Digital Biomarkers, 1(1):6--13, 2017.Google Scholar
- Paul Ekman and Wallace V Friesen. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. semiotica, 1(1):49--98, 1969.Google Scholar
- Paul Ekman and Wallace V Friesen. Manual for the facial action coding system. Consulting Psychologists Press, 1978.Google Scholar
- EV Evarts, H Teräväinen, and DB Calne. Reaction time in parkinson's disease. Brain: a journal of neurology, 104(Pt 1):167--186, 1981.Google Scholar
- Joan M. Fallon, James J. Fallon, Matthew Heil, and Stephen J. Weiss. Systems and methods employing remote data gathering and monitoring for diagnosing, staging, and treatment of parkinsons disease, movement and neurological disorders, and chronic pain. United States Patent Application, July 2010.Google Scholar
- Gunnar Farnebäck. Two-frame motion estimation based on polynomial expansion. In Proceedings of the 13th Scandinavian Conference on Image Analysis, SCIA'03, pages 363--370, Berlin, Heidelberg, 2003. Springer-Verlag. ISBN 3-540-40601-8. URL http://dl.acm.org/citation.cfm?id=1763974.1764031. Google ScholarDigital Library
- Movement Disorder Society Task Force. The unified parkinson's disease rating scale (updrs): Status and recommendations. Movement Disorders, 18(7):738--750, July 2003.Google ScholarCross Ref
- Parkinson's Foundation. Levodopa, 2018. URL http://parkinson.org/Understanding-Parkinsons/Treatment/Prescription-Medications/Levodopa.Google Scholar
- Parkinson's Foundation. What is parkinson's?, 2018. URL http://parkinson.org/understanding-parkinsons/what-is-parkinsons.Google Scholar
- Parkinson's Foundation. Statistics, 2018. URL http://parkinson.org/Understanding-Parkinsons/Causes-and-Statistics/Statistics.Google Scholar
- Christopher G. Goetz, Barbara C. Tilley, Stephanie R. Shaftman, Glenn T. Stebbins, Stanley Fahn, Pablo Martinez-Martin, Werner Poewe, Cristina Sampaio, Matthew B. Stern, Richard Dodel, Bruno Dubois, Robert Holloway, Joseph Jankovic, Jaime Kulisevsky, Anthony E. Lang, Andrew Lees, Sue Leurgans, Peter A. LeWitt, David Nyenhuis, C. Warren Olanow, Olivier Rascol, Anette Schrag, Jeanne A. Teresi, Jacobus J. van Hilten, and Nancy LaPelle. Movement disorder society-sponsored revision of the unified parkinson's disease rating scale (mds-updrs): Scale presentation and clinimetric testing results. Movement Disorders, 23(15):2129--2170, 2008.Google ScholarCross Ref
- Margaret M Hoehn, Melvin D Yahr, et al. Parkinsonism: onset, progression, and mortality. Neurology, 50(2):318--318, 1998.Google ScholarCross Ref
- Daniel H Jacobs, Jeffrey Shuren, Dawn Bowers, and Kenneth M Heilman. Emotional facial imagery, perception, and expression in parkinson's disease. Neurology, 45(9):1696--1702, 1995.Google ScholarCross Ref
- Muaz Khan. Recordrtc: Webrtc javascript library for audio+video+screen recording, June 2017. URL https://github.com/muaz-khan/RecordRTC.Google Scholar
- Jeff T Larsen, Catherine J Norris, and John T Cacioppo. Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology, 40(5):776--785, 2003.Google ScholarCross Ref
- Max A. Little, Patrick E. McSharry, Eric J. Hunter, Jennifer Spielman, and Lorraine O. Ramig. Suitability of dysphonia measurements for telemonitoring of parkinson's disease. IEEE Trans. Biomed. Eng., 56(4):1015--1022, April 2009. URL http://ieeexplore.ieee.org/document/4636708/.Google ScholarCross Ref
- Max A Little, Patrick E McSharry, Eric J Hunter, Jennifer Spielman, Lorraine O Ramig, et al. Suitability of dysphonia measurements for telemonitoring of parkinson's disease. IEEE transactions on biomedical engineering, 56(4):1015--1022, 2009.Google Scholar
- Irene Litvan, Jennifer G Goldman, Alexander I Tröster, Ben A Schmand, Daniel Weintraub, Ronald C Petersen, Brit Mollenhauer, Charles H Adler, Karen Marder, Caroline H Williams-Gray, et al. Diagnostic criteria for mild cognitive impairment in parkinson's disease: Movement disorder society task force guidelines. Movement disorders, 27(3):349--356, 2012.Google ScholarCross Ref
- GRAEME Macphee. Diagnosis and differential diagnosis of parkinson's disease. Parkinson's disease in the older patient, pages 41--75, 2008.Google Scholar
- C. Marras, J. C. Beck, J. H. Bower, E. Roberts, B. Ritz, G. W. Ross, R. D. Abbott, R. Savica, S. K. Van Den Eeden, A. W. Willis, and CM Tanner on behalf of the Parkinson's Foundation P4 Group. Prevalence of parkinson's disease across north america. npj Parkinson's Disease, 4(21):1--7, 2018.Google Scholar
- Pablo Martínez-Martín, Carmen Rodríguez-Blázquez, Mario Alvarez, Tomoko Arakaki, Víctor Campos Arillo, Pedro Pedro Chaná, William Fernández, Nélida Garretto, Juan Carlos Martínez-Castrillo, Mayela Rodríguez-Violante, Marcos Serrano-Dueñas, Diego Ballesteros, Jose Manuel Rojo-Abuin, Kallol Ray Chaudhuri, and Marcelo Merello. Parkinson's disease severity levels and mds-unified parkinson's disease rating scale. Parkinsonism and Related Disorders, 21(1):50--54, 2015.Google ScholarCross Ref
- Weerasak Muangpaisan, Hiroyuki Hori, and Carol Brayne. Systematic review of the prevalence and incidence of parkinsonâĂŹs disease in asia. Journal of Epidemiology, 19(6):281--293, 2009.Google ScholarCross Ref
- NIA and NLM. Making your web site senior-friendly: A checklist, 2002. URL https://www.nlm.nih.gov/pubs/checklist.pdf.Google Scholar
- Thanneer M. Perumal, Meghasyam Tummalacherla, Phil Snyder, Elias Chaibub Neto, E. Ray Dorsey, Lara Mangravite, and Larsson Omberg. Remote assessment, in real-world setting, of tremor severity in parkinson's disease patients using smartphone inertial sensors. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, UbiComp '18, pages 215--218, New York, NY, USA, 2018. ACM. ISBN 978-1-4503-5966-5. URL http://doi.acm.org/10.1145/3267305.3267612. Google ScholarDigital Library
- L. Ricciardi, M. Bologna, F. Morgante, D. Ricciardi, B. Morabito, D. Volpe, D. Martino, A. Tessitore, M. Pomponi, A.R. Bentivoglio, R. Bernabei, and A. Fasano. Reduced facial expressiveness in parkinson's disease: A pure motor disorder? J. Neurol. Sci., 358(1-2): 125--130, 2015.Google ScholarCross Ref
- Abdulwahab Sahyoun, Karim Chehab, Osama Al-Madani, Fadi Aloul, and Assim Sagahyroon. Parknosis: Diagnosing parkinson's disease using mobile phones. In IEEE 18th Int. Conf. e-Health Networking, Applicat. and Services, pages 387--392, 2016. URL http://ieeexplore.ieee.org/document/7749491/.Google ScholarCross Ref
- Arash Salarian, Heike Russmann, Christian Wider, Pierre R. Burkhard, Franios J. G. Vingerhoets, and Kamiar Aminian. Quantification of tremor and bradykinesia in parkinson's disease using a novel ambulatory monitoring system. IEEE Trans. Biomed. Eng., 54(2):313--322, February 2007. URL http://ieeexplore.ieee.org/document/4067166/.Google ScholarCross Ref
- Gwenda Simons, Heiner Ellgring, and Marcia Smith Pasqualini. Disturbance of spontaneous and posed facial expressions in parkinson's disease. Cognition and Emotion, 17(5):759--778, 2003.Google ScholarCross Ref
- Marcia C. Smith, Melissa K. Smith, and Heiner Ellgring. Spontaneous and posed facial expression in parkinson's disease. Journal of the International Neuropsychological Society, 2(5):383--391, 1996.Google ScholarCross Ref
- Elias M Stein and Guido Weiss. Introduction to Fourier analysis on Euclidean spaces (PMS-32), volume 32. Princeton university press, 2016.Google Scholar
- Linda Tickle-Degnen and Kathleen Doyle Lyons. Practitioners' impressions of patients with parkinson's disease: the social ecology of the expressive mask. Social Science & Medicine, 58(3):603--614, 2004.Google ScholarCross Ref
- Alexandros T. Tzallas, Markos G. Tsipouras, Georgios Rigas, Dimitrios G. Tsalikakis, Evaggelos C. Karvounis, Maria Chondrogiorgi, Fotis Psomadellis, Jorge Cancela, Matteo Pastorino, María Teresa Arredondo Waldmeyer, Spiros Konitsiotis, and Dimitrios I. Fotiadis. Perform: A system for monitoring, assessment and management of patients with parkinson's disease. Sensors (Basel), 14(11):21329--21357, November 2014.Google ScholarCross Ref
- Zdenka Uhríková and Václav Hlaváč. Periodic motion detection on patient with motion disorders. In Computer-Based Medical Systems, 2008. CBMS'08. 21st IEEE International Symposium on, pages 90--92. IEEE, 2008. Google ScholarDigital Library
- Zdenka Uhríková, Otakar Šprdlík, Václav Hlaváč, and Evžen Růžička. Action tremor analysis from ordinary video sequence. In Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE, pages 6123--6126. IEEE, 2009.Google ScholarCross Ref
- San Francisco University of California. Parkinson's disease clinic and research center: Parkinson's disease medications, 2014. URL http://pdcenter.neurology.ucsf.edu/patients-guide/parkinson%E2%80%99s-disease-medications.Google Scholar
- Sarah Vercruysse, Joke Spildooren, Elke Heremans, Jochen Vandenbossche, Oron Levin, Nicole Wenderoth, Stephan P Swinnen, Luc Janssens, Wim Vandenberghe, and Alice Nieuwboer. Freezing in parkinson's disease: a spatiotemporal motor disorder beyond gait. Movement Disorders, 27(2):254--263, 2012.Google ScholarCross Ref
- Nomi Vinokurov, David Arkadir, Eduard Linetsky, Hagai Bergman, and Daphna Weinshall. Quantifying hypomimia in parkinson patients using a depth camera. In Silvia Serino, Aleksandar Matic, Dimitris Giakoumis, Guillaume Lopez, and Pietro Cipresso, editors, Pervasive Computing Paradigms for Mental Health, pages 63--71, Cham, 2016. Springer International Publishing. ISBN 978-3-319-32270-4.Google ScholarCross Ref
- A.W. Willis, M. Schootman, B.A. Evanoff, J.S. Perlmutter, and B.A. Racette. Neurologist care in parkinson disease. Neurology, 77(9): 851--857, 2011. ISSN 0028-3878. URL http://n.neurology.org/content/77/9/851.Google ScholarCross Ref
- Peng Wu, Isabel Valle González, Dongmei Jiang, and Hichem Sahli. Objectifying facial expressivity assessment of parkinson's patients. 2015.Google Scholar
- A. Zhan, S. Mohan, C. Tarolli, and et al. Using smartphones and machine learning to quantify parkinson disease severity: The mobile parkinson disease score. JAMA Neurology, 2018.Google Scholar
- Andong Zhan, Max A. Little, Denzil A. Harris, Solomon O. Abiola, E. Ray Dorsey, Suchi Saria, and Andreas Terzis. High frequency remote monitoring of parkinson's disease via smartphone: Platform overview and medication response detection. CoRR, abs/1601.00960, 2016.Google Scholar
Index Terms
- The PARK Framework for Automated Analysis of Parkinson's Disease Characteristics
Recommendations
Mobile-based Monitoring of Parkinson's Disease
MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous MultimediaParkinson's disease (PD) is the second most common neurodegenerative disorder, impacting an estimated seven to ten million people worldwide. It is commonly accepted that improving medication adherence alleviates symptoms and maintains motor ...
Visualization and Analysis of Parkinson’s Disease Status and Therapy Patterns
Discovery ScienceAbstractParkinson’s disease is a neurodegenerative disease affecting people worldwide. Since the reasons for Parkinson’s disease are still unknown and currently there is no cure for the disease, the management of the disease is directed towards handling ...
Analysis of medications change in Parkinson's disease progression data
Parkinson's disease is a neurodegenerative disorder that affects people worldwide. Careful management of patient's condition is crucial to ensure the patient's independence and quality of life. This is achieved by personalized treatment based on ...
Comments