Digital phenotyping

Last updated

Digital phenotyping is a multidisciplinary field of science, [1] [2] [3] first defined in a May 2016 paper in JMIR Mental Health authored by John Torous, Mathew V Kiang, Jeanette Lorme, and Jukka-Pekka Onnela as the "moment-by-moment quantification of the individual-level human phenotype in situ using data from personal digital devices." [2] The data can be divided into two subgroups, called active data and passive data, where the former refers to data that requires active input from the users to be generated, whereas passive data, such as sensor data and phone usage patterns, are collected without requiring any active participation from the user.

Contents

Smartphones are well suited for digital phenotyping given their widespread adoption and ownership, the extent to which users engage with the devices, and richness of data that may be collected from them. Smartphone data can be used to study behavioral patterns, social interactions, physical mobility, gross motor activity, and speech production, among others. Smartphone ownership has been in steady rise globally over the past few years. For example, in the U.S., smartphone ownership among adults increased from 35% in 2011 to 64% in 2015, [4] and in 2017 an estimated 95% of Americans own a cellphone of some kind and 77% own a smartphone. [5]

The use of passive data collection from smartphone devices can provide granular information relevant to psychiatric, aging, frailty, [6] and other illness phenotypes. [7] Types of relevant passive data include GPS data to monitor spatial location, accelerometer data to record movement and gross motor activity, and call and messaging logs to document social engagement with others. [8] Passively collected data may also support clinical differentiation between diagnostic groups [9] and monitoring mental health symptoms. [10] [11]

The related term 'digital phenotype' was introduced in Nature Biotechnology by Sachin H. Jain and John Brownstein in 2015. [12]

Research platforms and commercialization

One of the first implementations of digital phenotyping on smart phones was the Funf Open Sensing Framework, developed at the MIT Media Lab and launched on October 5, 2011. [13] Members of the Funf team interested in profiling and predicting human behavior formed a commercial venture called Behavio in 2012. [14] In April 2013, it was announced that the Behavio team had joined Google. [15] The Funf platform has inspired other mobile phone sensor logging platforms for psychology and behavior applications, such as the Purple Robot platform, developed by the CBITS (Center for Behavioral Intervention Technologies) at Northwestern University in 2012, [16] which has since expanded and remains an active GITHUB project.

Among the academic research community, there are now many digital phenotyping platforms. Popular open-source digital phenotyping platforms include Beiwe which was developed in the Onnela lab at Harvard School of Public Health in 2013. [17] Others include AWARE, EARS, [18] mindLAMP, [19] RADAR-CNS among others and there is currently no metric to determine which is most popular.

In terms of commercialization, in 2017, former head of the National Institutes of Mental Health, Tom Insel, joined Rick Klausner and Paul Dagum to form the founding team of MindStrong Health, which uses digital phenotyping methods combined with machine learning to develop new paradigms for mental health assessment and development of new digital biomarkers for mental health. [20] As of 2021 the company's website does not mention digital phenotyping.

Criticisms

The widespread adoption of digital phenotyping across diverse research domains necessitates robust methodological guidelines. Passive data collection, a cornerstone of this approach, poses a significant challenges at every stage of the research process [21] [22] [23] . From the outset, researchers grapple with clearly defining the constructs under investigation, a task complicated by the obscure nature of digital phenomena [24] [25] [26] . Subsequent decisions about data capture devices, applications, and cleaning protocols further amplify the complexity [21] . The analysis phase introduces another layer of challenges, particularly when employing computationally demanding techniques such as machine learning [22] . Optimizing model performance through careful data partitioning and hyperparameter tuning is essential but requires essential knowledge [27] . Recently published templates aim to address these challenges by providing standardized approaches to digital phenotyping research, potentially facilitating greater consistency and comparability across studies [28] .

See also

Related Research Articles

eHealth describes healthcare services which are supported by digital processes, communication or technology such as electronic prescribing, Telehealth, or Electronic Health Records (EHRs). The use of electronic processes in healthcare dated back to at least the 1990s. Usage of the term varies as it covers not just "Internet medicine" as it was conceived during that time, but also "virtually everything related to computers and medicine". A study in 2005 found 51 unique definitions. Some argue that it is interchangeable with health informatics with a broad definition covering electronic/digital processes in health while others use it in the narrower sense of healthcare practice using the Internet. It can also include health applications and links on mobile phones, referred to as mHealth or m-Health. Key components of eHealth include electronic health records (EHRs), telemedicine, health information exchange, mobile health applications, wearable devices, and online health information. These technologies enable healthcare providers, patients, and other stakeholders to access, manage, and exchange health information more effectively, leading to improved communication, decision-making, and overall healthcare outcomes.

mHealth Medicine and public health supported by mobile devices

mHealth is an abbreviation for mobile health, a term used for the practice of medicine and public health supported by mobile devices. The term is most commonly used in reference to using mobile communication devices, such as mobile phones, tablet computers and personal digital assistants (PDAs), and wearable devices such as smart watches, for health services, information, and data collection. The mHealth field has emerged as a sub-segment of eHealth, the use of information and communication technology (ICT), such as computers, mobile phones, communications satellite, patient monitors, etc., for health services and information. mHealth applications include the use of mobile devices in collecting community and clinical health data, delivery/sharing of healthcare information for practitioners, researchers and patients, real-time monitoring of patient vital signs, the direct provision of care as well as training and collaboration of health workers.

The use of electronic and communication technologies as a therapeutic aid to healthcare practices is commonly referred to as telemedicine or eHealth. The use of such technologies as a supplement to mainstream therapies for mental disorders is an emerging mental health treatment field which, it is argued, could improve the accessibility, effectiveness and affordability of mental health care. Mental health technologies used by professionals as an adjunct to mainstream clinical practices include email, SMS, virtual reality, computer programs, blogs, social networks, the telephone, video conferencing, computer games, instant messaging and podcasts.

Experts from many different fields have conducted research and held debates about how using social media affects mental health. Research suggests that mental health issues arising from social media use affect women more than men and vary according to the particular social media platform used, although it does affect every age and gender demographic in different ways. Psychological or behavioural dependence on social media platforms can result in significant negative functions in individuals' daily lives. Studies show there are several negative effects that social media can have on individuals' mental health and overall well-being. While researchers have attempted to examine why and how social media is problematic, they still struggle to develop evidence-based recommendations on how they would go about offering potential solutions to this issue. Because social media is constantly evolving, researchers also struggle with whether the disorder of problematic social media use would be considered a separate clinical entity or a manifestation of underlying psychiatric disorders. These disorders can be diagnosed when an individual engages in online content/conversations rather than pursuing other interests.

Infoveillance is a type of syndromic surveillance that specifically utilizes information found online. The term, along with the term infodemiology, was coined by Gunther Eysenbach to describe research that uses online information to gather information about human behavior.

Digital health is a discipline that includes digital care programs, technologies with health, healthcare, living, and society to enhance the efficiency of healthcare delivery and to make medicine more personalized and precise. It uses information and communication technologies to facilitate understanding of health problems and challenges faced by people receiving medical treatment and social prescribing in more personalised and precise ways. The definitions of digital health and its remits overlap in many ways with those of health and medical informatics.

<span class="mw-page-title-main">Problematic smartphone use</span> Psychological dependence on smartphones

Problematic smartphone use is psychological or behavioral dependence on cell phones. It is closely related to other forms of digital media overuse such as social media addiction or internet addiction disorder.

<span class="mw-page-title-main">Activity tracker</span> Device or application for monitoring fitness

An activity tracker is an electronic device, or an app on a device, that measures and collects data about an individual's movements and physical responses, towards the goal of monitoring and improving their health, fitness or psychological wellness over time.

Infodemiology was defined by Gunther Eysenbach in the early 2000s as information epidemiology. It is an area of science research focused on scanning the internet for user-contributed health-related content, with the ultimate goal of improving public health. Later, it is also defined as the science of mitigating public health problems resulting from an infodemic.

A fitness app is an application that can be downloaded on any mobile device and used anywhere to get fit. Fitness apps are designed to help with exercise, other types of physical training, nutrition and diet, and other ways to get fit.

Digital therapeutics, a subset of digital health, are evidence-based therapeutic interventions driven by high quality software programs to prevent, manage, or treat a medical disorder or disease. Digital therapeutic companies should publish trial results inclusive of clinically meaningful outcomes in peer-reviewed journals. The treatment relies on behavioral and lifestyle changes usually spurred by a collection of digital impetuses. Because of the digital nature of the methodology, data can be collected and analyzed as both a progress report and a preventative measure. Treatments are being developed for the prevention and management of a wide variety of diseases and conditions, including type 1 & type II diabetes, congestive heart failure, obesity, Alzheimer's disease, dementia, asthma, substance abuse, ADHD, hypertension, anxiety, depression, and several others. Digital therapeutics often employ strategies rooted in cognitive behavioral therapy.

<span class="mw-page-title-main">Joel Salinas</span>

Joel Salinas is an American-born Nicaraguan neurologist, writer, researcher, and an assistant professor of neurology at Harvard Medical School. He practices general neurology, with subspecialty in behavioral neurology and neuropsychiatry, at the Massachusetts General Hospital in Boston, Massachusetts. He is also a clinician-scientist at the Harvard T.H. Chan School of Public Health and the Framingham Study at the Boston University School of Medicine.

Mobile phone–based sensing software is a class of software for mobile phones that uses the phone's sensors to acquire data about the user. Some applications of this software include mental health and overall wellness monitoring. This class of software is important because it has the potential of providing a practical and low-cost approach to deliver psychological interventions for the prevention of mental health disorders, as well as bringing such interventions to populations that have no access to traditional health care. A number of terms are used for this approach, including "personal sensing", "digital phenotyping", and "context sensing". The term "personal sensing" is used in this article, as it conveys in simple language the aim of sensing personal behaviors, states, and conditions.

<span class="mw-page-title-main">Jukka-Pekka Onnela</span>

Jukka-Pekka Onnela is a Professor of Biostatistics at the Harvard T.H. Chan School of Public Health and Co-Director of the Health Data Science Program. Onnela is known for his pioneering research using cell phone data in network science. He was awarded the NIH Director's New Innovator Award in 2013 for his work in digital phenotyping.

Mental health informatics is a branch of health or clinical informatics focused on the use of information technology (IT) and information to improve mental health. Like health informatics, mental health informatics is a multidisciplinary field that promotes care delivery, research and education as well as the technology and methodologies required to implement it.

The relationships between digital media use and mental health have been investigated by various researchers—predominantly psychologists, sociologists, anthropologists, and medical experts—especially since the mid-1990s, after the growth of the World Wide Web and rise of text messaging. A significant body of research has explored "overuse" phenomena, commonly known as "digital addictions", or "digital dependencies". These phenomena manifest differently in many societies and cultures. Some experts have investigated the benefits of moderate digital media use in various domains, including in mental health, and the treatment of mental health problems with novel technological solutions.

<span class="mw-page-title-main">Internet-based treatments for trauma survivors</span>

Internet-based treatments for trauma survivors is a growing class of online treatments that allow for an individual who has experienced trauma to seek and receive treatment without needing to attend psychotherapy in person. The progressive movement to online resources and the need for more accessible mental health services has given rise to the creation of online-based interventions aimed to help those who have experienced traumatic events. Cognitive behavioral therapy (CBT) has shown to be particularly effective in the treatment of trauma-related disorders and adapting CBT to an online format has been shown to be as effective as in-person CBT in the treatment of trauma. Due to its positive outcomes, CBT-based internet treatment options for trauma survivors has been an expanding field in both research and clinical settings.

<span class="mw-page-title-main">Sleep tracking</span> Process of quantitatively measuring a persons sleep

Sleep tracking is the process of monitoring a person's sleep, most commonly through measuring inactivity and movement. A device that tracks a person's sleep is called a sleep tracker. Sleep tracking may be beneficial in diagnosing sleep disorders. As sleep abnormalities are also symptoms of mental illness or relapsing psychotic disorders, it may also be beneficial in diagnosing mental disorders and psychotic disorders as well.

Anna Van Meter is an American clinical psychologist. She is on the faculty of New York University Grossman School of Medicine in the Department of Child and Adolescent Psychiatry. She leads the Investigating Mood Pathology: Assessment, Course, Treatment (IMPACT) Lab. Van Meter and her team conduct research on mood disorders and associated clinical phenomena, including suicide. They focus on innovative, technology-based approaches to improve the rapid identification of symptoms in youth and to facilitate access to evidence-based care.

References

  1. Onnela, Jukka-Pekka; Rauch, Scott L. (June 2016). "Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health". Neuropsychopharmacology. 41 (7): 1691–1696. doi:10.1038/npp.2016.7. ISSN   0893-133X. PMC   4869063 . PMID   26818126.
  2. 1 2 Torous, John; Kiang, Mathew V; Lorme, Jeanette; Onnela, Jukka-Pekka (2016-05-05). "New Tools for New Research in Psychiatry: A Scalable and Customizable Platform to Empower Data Driven Smartphone Research". JMIR Mental Health. 3 (2): e16. doi: 10.2196/mental.5165 . ISSN   2368-7959. PMC   4873624 . PMID   27150677.
  3. Brown, Karen (2016-07-19). "Your phone knows how you feel". Harvard Public Health Magazine. Retrieved 2019-11-13.
  4. Smith, Aaron (2015-04-01). "U.S. Smartphone Use in 2015". Pew Research Center: Internet, Science & Tech. Retrieved 2017-06-27.
  5. "Mobile Fact Sheet". Pew Research Center: Internet, Science & Tech. 2017-01-12. Retrieved 2017-06-27.
  6. Pyrkov, Timothy V.; Getmantsev, Evgeny; Zhurov, Boris; Avchaciov, Konstantin; Pyatnitskiy, Mikhail; Menshikov, Leonid; Khodova, Kristina; Gudkov, Andrei V.; Fedichev, Peter O. (2018-10-26). "Quantitative characterization of biological age and frailty based on locomotor activity records". Aging . 10 (10): 2973–2990. doi:10.18632/aging.101603. ISSN   1945-4589. PMC   6224248 . PMID   30362959.
  7. Gillett, George (2020). "A day in the life of a psychiatrist in 2050: where will the algorithm take us?". BJPsych Bulletin. 44 (3): 121–123. doi: 10.1192/bjb.2020.22 . PMC   8170007 . PMID   33861188.
  8. Torous, John; Staples, Patrick; Onnela, Jukka-Pekka (2015-08-01). "Realizing the Potential of Mobile Mental Health: New Methods for New Data in Psychiatry". Current Psychiatry Reports. 17 (8): 61. doi:10.1007/s11920-015-0602-0. ISSN   1523-3812. PMC   4608747 . PMID   26073363.
  9. Gillett, George; McGowan, Niall; Palmius, Niclas; Bilderbeck, Amy; Goodwin, Guy; Saunders, Kate (2021). "Digital Communication Biomarkers of Mood and Diagnosis in Borderline Personality Disorder, Bipolar Disorder, and Healthy Control Populations". Frontiers in Psychiatry. 12 (610457): 610457. doi: 10.3389/fpsyt.2021.610457 . ISSN   1664-0640. PMC   8060643 . PMID   33897487.
  10. Braund, Taylor A.; Zin, May The; Boonstra, Tjeerd W.; Wong, Quincy J. J.; Larsen, Mark E.; Christensen, Helen; Tillman, Gabriel; O’Dea, Bridianne (2022-05-04). "Smartphone Sensor Data for Identifying and Monitoring Symptoms of Mood Disorders: A Longitudinal Observational Study". JMIR Mental Health. 9 (5): e35549. doi: 10.2196/35549 . PMC   9118091 . PMID   35507385. S2CID   247962553.
  11. Braund, Taylor A.; O’Dea, Bridianne; Bal, Debopriyo; Maston, Kate; Larsen, Mark E.; Werner-Seidler, Aliza; Tillman, Gabriel; Christensen, Helen (2023-05-15). "Associations Between Smartphone Keystroke Metadata and Mental Health Symptoms in Adolescents: Findings From the Future Proofing Study". JMIR Mental Health. 10: e44986. doi: 10.2196/44986 . PMC   10227695 . PMID   37184904.
  12. Jain, Sachin H; Powers, Brian W; Hawkins, Jared B; Brownstein, John S (2015). "The digital phenotype". Nature Biotechnology. 33 (5): 462–463. doi:10.1038/nbt.3223. ISSN   1087-0156. PMID   25965751. S2CID   2318642.
  13. "Funf Blog". funf-blog.blogspot.com. Retrieved 2021-01-22.
  14. "Knight Foundation Bets Mobile Sensor Startup, Behav.io, Is The Future of Journalism". TechCrunch. 18 June 2012. Retrieved 2021-01-22.
  15. D'Orazio, Dante (2013-04-12). "Google gains team behind Behavio, a startup that uses smartphone data to make predictions". The Verge. Retrieved 2021-01-22.
  16. "Your smartphone knows when you're depressed". The Daily Dot. 2015-07-16. Retrieved 2021-01-22.
  17. "Digital Phenotyping and Beiwe Research Platform". Onnela Lab. 21 July 2017. Retrieved 2021-01-22.
  18. Lind, Monika N.; Byrne, Michelle L.; Wicks, Geordie; Smidt, Alec M.; Allen, Nicholas B. (July 2018). "The Effortless Assessment of Risk States (EARS) Tool: An Interpersonal Approach to Mobile Sensing". JMIR Mental Health. 5 (3): e10334. doi: 10.2196/10334 . PMC   6134227 . PMID   30154072.
  19. Torous, John; Wisniewski, Hannah; Bird, Bruce; Carpenter, Elizabeth; David, Gary; Elejalde, Eduardo; Fulford, Dan; Guimond, Synthia; Hays, Ryan; Henson, Philip; Hoffman, Liza (2019-06-01). "Creating a Digital Health Smartphone App and Digital Phenotyping Platform for Mental Health and Diverse Healthcare Needs: an Interdisciplinary and Collaborative Approach". Journal of Technology in Behavioral Science. 4 (2): 73–85. doi: 10.1007/s41347-019-00095-w . ISSN   2366-5963. S2CID   150589575.
  20. "Former Director of the National Institute of Mental Health, Dr. Thomas Insel, Joins Mindstrong Health as President and Co-Founder". Mindstrong Health. 2017-05-11. Retrieved 2021-01-22.
  21. 1 2 Davidson, Brittany I. (2022-01-01). "The crossroads of digital phenotyping". General Hospital Psychiatry. 74: 126–132. doi:10.1016/j.genhosppsych.2020.11.009. ISSN   0163-8343. PMID   33653612.
  22. 1 2 Hicks, Jennifer L.; Althoff, Tim; Sosic, Rok; Kuhar, Peter; Bostjancic, Bojan; King, Abby C.; Leskovec, Jure; Delp, Scott L. (2019-06-03). "Best practices for analyzing large-scale health data from wearables and smartphone apps". npj Digital Medicine. 2 (1): 45. doi:10.1038/s41746-019-0121-1. ISSN   2398-6352. PMC   6550237 . PMID   31304391.
  23. Velozo, Joana De Calheiros; Habets, Jeroen; George, Sandip V.; Niemeijer, Koen; Minaeva, Olga; Hagemann, Noëmi; Herff, Christian; Kuppens, Peter; Rintala, Aki; Vaessen, Thomas; Riese, Harriëtte; Delespaul, Philippe (January 2024). "Designing daily-life research combining experience sampling method with parallel data". Psychological Medicine. 54 (1): 98–107. doi:10.1017/S0033291722002367. ISSN   0033-2917. PMID   36039768.
  24. Huckvale, Kit; Venkatesh, Svetha; Christensen, Helen (2019-09-06). "Toward clinical digital phenotyping: a timely opportunity to consider purpose, quality, and safety". npj Digital Medicine. 2 (1): 88. doi:10.1038/s41746-019-0166-1. ISSN   2398-6352. PMC   6731256 . PMID   31508498.
  25. Mohr, David C.; Zhang, Mi; Schueller, Stephen M. (2017-05-08). "Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning". Annual Review of Clinical Psychology. 13 (1): 23–47. doi:10.1146/annurev-clinpsy-032816-044949. ISSN   1548-5943. PMC   6902121 . PMID   28375728.
  26. Langener, Anna M.; Stulp, Gert; Kas, Martien J.; Bringmann, Laura F. (2023-03-17). "Capturing the Dynamics of the Social Environment Through Experience Sampling Methods, Passive Sensing, and Egocentric Networks: Scoping Review". JMIR Mental Health. 10 (1): e42646. doi: 10.2196/42646 . PMC   10132048 . PMID   36930210.
  27. Yang, Li; Shami, Abdallah (2020-11-20). "On hyperparameter optimization of machine learning algorithms: Theory and practice". Neurocomputing. 415: 295–316. arXiv: 2007.15745 . doi:10.1016/j.neucom.2020.07.061. ISSN   0925-2312.
  28. Langener, Anna M.; Siepe, Björn S.; Elsherif, Mahmoud; Niemeijer, Koen; Andresen, Pia K.; Akre, Samir; Bringmann, Laura F.; Cohen, Zachary D.; Choukas, Nathaniel R.; Drexl, Konstantin; Fassi, Luisa; Green, James; Hoffmann, Tabea; Jagesar, Raj R.; Kas, Martien J. H. (2024-08-07). "A template and tutorial for preregistering studies using passive smartphone measures". Behavior Research Methods. doi:10.3758/s13428-024-02474-5. ISSN   1554-3528. PMID   39112740.

Further reading