• Open Access
    Original Article

    Proof of concept: digital clock drawing behaviors prior to transcatheter aortic valve replacement may predict length of hospital stay and cost of care

    Margaret Ellenora Wiggins 1,9
    Catherine Dion 1,9
    Erin Formanski 1,9
    Anis Davoudi 2
    Shawna Amini 3,9
    Kenneth M. Heilman 4
    Dana Penney 5
    Dana Randall 6
    Cynthia W. Garvan 3,9
    George J. Arnaoutakis 7
    Patrick Tighe 3,9
    David J. Libon 8
    Catherine C. Price 1,3,9*

    Explor Med. 2021;2:110–121 DOI: https://doi.org/10.37349/emed.2021.00036

    Received: July 31, 2020 Accepted: November 17, 2020 Published: March 05, 2021

    Academic Editor: Lindsay A. Farrer, Boston University School of Medicine, USA

    This article belongs to the special issue Digital Biomarkers: The New Frontier for Medicine and Research

    Abstract

    Aims:

    Reduced pre-operative cognitive functioning in older adults is a risk factor for postoperative complications, but it is unknown if preoperative digitally-acquired clock drawing test (CDT) cognitive screening variables, which allow for more nuanced examination of patient performance, may predict lengthier hospital stay and greater cost of hospital care. This issue is particularly relevant for older adults undergoing transcatheter aortic valve replacement (TAVR), as this surgical procedure is chosen for intermediate-risk older adults needing aortic replacement. This proof of concept research explored if specific latency and graphomotor variables indicative of planning from digitally-acquired command and copy clock drawing would predict post-TAVR duration and cost of hospitalization, over and above age, education, American Society of Anesthesiologists (ASA) physical status classification score, and frailty.

    Methods:

    Form January 2018 to December 2019, 162 out of 190 individuals electing TAVR completed digital clock drawing as part of a hospital wide cognitive screening program. Separate hierarchical regressions were computed for the command and copy conditions of the CDT and assessed how a-priori selected clock drawing metrics (total time to completion, ideal digit placement difference, and hour hand distance from center; included within the same block) incrementally predicted outcome, as measured by R2 change significance values.

    Results:

    Above and beyond age, education, ASA physical status classification score, and frailty, only digitally-acquired CDT copy performance explained significant variance for length of hospital stay (9.5%) and cost of care (8.9%).

    Conclusions:

    Digital variables from clock copy condition provided predictive value over common demographic and comorbidity variables. We hypothesize this is due to the sensitivity of the copy condition to executive dysfunction, as has been shown in previous studies for subtypes of cognitive impairment. Individuals undergoing TAVR procedures are often frail and executively compromised due to their cerebrovascular disease. We encourage additional research on the value of digitally-acquired clock drawing within different surgery types. Type of cognitive impairment and the value of digitally-acquired CDT command and copy parameters in other surgeries remain unknown.

    Keywords

    Clock drawing test, perioperative neuropsychology, transcatheter aortic valve replacement, hospital outcomes

    Introduction

    Although preoperative cognitive impairments are well known predictors of negative cognitive postoperative outcomes [16], it remains unknown if preoperative cognitive screening metrics provide valuable predictive information relevant to hospitals providing the care for older adults electing surgical procedures. One relevant surgical procedure is transcatheter aortic valve replacement (TAVR), the procedure of choice relative to surgical aortic valve replacement in intermediate-risk older adult patients [7]. Although TAVR is associated with reduced mortality relative to standard surgical aortic valve replacement, the procedure can still be accompanied by negative complications impacting hospital cost and stay, e.g., Tilley and colleagues [8] reported that 23% of patients aged 60 years or older who underwent TAVR experience delirium, a preventative cause of cognitive impairment and dementia.

    Towards improving hospital care modeling for TAVR, researchers have largely examined the predictive value of traditional metrics such as age and comorbidity on TAVR outcome costs [9], and more recently frailty as a predictor of hospital stay [1012]. Integrating preoperative cognitive biomarkers into the model is the next logical research approach, particularly given: (1) the abundance of research documenting the significance of preoperative cognition on postoperative outcome [6]; (2) that 54% of all surgical procedures are performed on older adults [13]; (3) prospective hospital-based studies show at least 20% of older adults electing surgical procedures have mild to moderate cognitive limitations on standardized screening metrics [14, 15]; and (4) general surgery guidelines strongly recommend at minimum preoperative cognitive screening for older adults electing surgery.

    It is possible that older adults with even subtle cognitive vulnerabilities undergoing TAVR may remain hospitalized longer with an increased cost of care. Cognitive screenings could serve as a functional biomarker to predict which patients may benefit from improved care planning thereby reducing postoperative hospital costs and stay. It is important, however, to identify a screening tool that can be used by medical staff and provide rapid information yet remain sensitive to subtle effects of abnormal aging [14].

    One potential tool is the digitally-acquired clock drawing test (CDT), where patients are first asked to draw a clock to a command and then copy a model of a clock [1519]. The CDT is a classic neuropsychological tool often used as a cognitive screener for dementia [20, 21]. The test requires an individual to “draw the face of a clock, put in all the numbers and set the hands to 10 after 11” (known as the command condition), and then copy a model of a clock with the hands set to 10 after 11 (known as the copy condition). While the command condition assesses multiple cognitive components, the copy condition appears more specific to executive and visuospatial planning deficits [2123]. Approximately ten years ago, this traditional screener was upgraded using digital technology allowing for more nuanced assessment of subtle cognitive vulnerabilities [17]. Prospective research shows validity with digital clock drawing latency and graphomotor variables [16, 18, 24, 25], although many of the variables extracted from this test are still to be examined relative to hypothetical constructs and neuroimaging variables [26, 27].

    The present proof of concept study assessed whether specific digitally-acquired latency and graphomotor CDT variables acquired during a preoperative hospital visit prior to TAVR would explain any variance in length of post-TAVR stay and hospital cost, even after considering patient age, education, comorbidity, and frailty. Typically, length of stay and hospital cost investigations include thousands of data-points [9]. Any explained variance from this preliminary investigation may provide support for larger-scale investigations across hospital networks. Although previous research has demonstrated CDT copy acquired from traditional hand-scoring methods significantly predicted length of stay in older adults undergoing elective surgery [14], the current investigation will be the first to address the question with digital assessment technology. Given that individuals with TAVR have cerebrovascular disease [28] which associates with executive and graphomotor processing speed limitations [29, 30], we a-priori explored the predictive value of CDT total clock drawing time [24] and key graphomotor metrics assessing visual attention and planning [31, 32].

    Materials and methods

    This manuscript adheres to the applicable STROBE guidelines.

    Study setting and participants

    The present study was conducted at the University of Florida (UF) and UF Health. Data were acquired via a federally-funded investigation and institutional review board-approved protocol with Health Insurance Portability and Accountability Act (HIPAA) waiver and honest broker medical record extraction. The study followed Declaration of Helsinki standards and was in accordance with all institutional guidelines. Inclusion: primary English speaking adults age 65 or older electing TAVR within UF Health from the periods of Jan 2, 2018 to Dec 31, 2019 and triaged for an in-person visit within the UF Preoperative Anesthesia Clinic using the Patient-Centered Anesthesia Triage System criteria as defined by Enneking and colleagues [33] as part of routine medical care. Exclusion: non-English speaking or not fluent in the English language; education < 4 years; visual, hearing, or motor extremity limitation that would preclude a valid clock drawing production.

    Procedure

    Licensed neuropsychologists and doctoral-level neuropsychology students trained preoperative anesthesia medical staff, including residents and attending physicians, advanced registered nurse practitioners, and registered nurses on administration of the Preoperative Frailty-Cognitive Protocol with particular attention paid to reliable administration of digitally-acquired clock drawing. As described in Amini et al. [14], training occurred in two segments. Group-based education involved separate team meetings to explain the necessity for reliability and accuracy. Individual trainings involved having a trained instructor administering the protocol to each staff member and then requiring the staff members to administer the protocol to another team member with the instructor present. Each day, a neuropsychology instructor visited each team member to assess protocols for administration problems, train new staff members (rotating residents), and troubleshoot questions.

    Each preoperative testing room contained a binder with a packet of materials for reference and administration, as well as a hand dynamometer used to assess for frailty [34]. Packets included instructions for frailty assessment, how to record education, and digitally-acquired CDT administration. The clock drawing to command was administered first, followed by the copy test condition. Each staff member placed a patient identification sticker on the paper containing patient name, medical record number, date of birth, age, sex, appointment encounter number, and admission date. Completed protocols, including the digital clock drawing data, were transferred into the patient’s electronic medical record, with electronic flags communicated ahead of time to the institutional review board honest data broker to enable record retrievals according to institutional review board approval.

    Digitally-acquired CDT

    Each participant completed clock drawing to command and copy on “smart paper” using an Anoto pen that records pen positioning 80 times per second with a spatial accuracy of 0.005 cm. As part of the study protocol, test administration was completed with a trained preoperative anesthesia staff member. Patients were presented with 21.59 cm × 27.94 cm smart paper folded in half giving the patient an area of 21.59 cm × 13.97 cm to draw their clock. Data from the digital pen are then downloaded into an in-house software system (CDT classification assist tool [17]) trained to classify each pen stroke with at least 84% accuracy into separate grouping categories. Then, a trained rater with high accuracy (93–99%) reviews the computer software classifications for accuracy before the clock scoring is finalized for data entry. For command condition, participants were instructed to “draw the face of a clock, put in all the numbers, and set the hands to 10 after 11 [21].” After the command condition, the participants were presented with a model clock and asked to copy it (known as the copy condition). The following are latency and graphomotor outcome variables of interest.

    Latency

    Total time to completion: the amount of time (s) from the moment the participant begins the first pen stroke of the clock drawing to the moment the participant finishes the last pen stroke. This measurement was acquired for both the command and copy conditions separately. Previous research demonstrated that on command condition, longer total time to completion associated with worse performance on tests measuring processing speed, language, working memory, and declarative memory, while copy time to completion associated with reduced processing speed and working memory [16].

    Graphomotor

    We examined two experimental graphomotor metrics hypothesized to measure executive abilities including visual planning and visuo-spatial organization [26], and vulnerable to the effects of aging [35].

    (1) Ideal digit placement difference: the total difference (degrees) in each digit placement on the participant’s clock drawing from the ideal-correct placement is calculated via summation of all 12 digit-differences in degrees from their ideal placement. Individuals who drew less than 12 digits, more than 12 digits, or who did not draw a clockface were excluded from these analyses (command: 20 excluded; copy: 12 excluded). Unpublished (in submission) research from our laboratory assessing 201 older adults age 55 and up who are either cognitively healthy or meet criteria for mild cognitive impairment [36] shows that the digit misplacement variable to command negatively and significantly associates with confrontation naming ability (Boston naming test [37]; r = −0.303, P < 0.001), reasoning (Wechsler Abbreviated Scale of Intelligence, Matrix Reasoning [38]; r = −0.248, P < 0.001), and visuospatial attention (Judgement of Line Orientation [39]; r = −0.248, P = 0.003), such that greater digit misplacement correlated with worse neuropsychological test performance. Digit placement did not associate with processing speed (Stroop word reading [40]; r = −0.070, P = 0.413), working memory (Wechsler Adult Intelligence Scale-Third Edition, Digit Span Backward [41]; r = −0.134, P = 0.114), or episodic memory (Wechsler Memory Scale-Third Edition, Logical Memory II [42]; r = −0.106, P = 0.212).

    (2) Hour hand distance from center: distance from the inner end of the hour hand to the center of the clock face (millimeters). We extracted this variable based on prior research demonstrating increased upward attentional bias with aging [31, 32]. It has been posited that the age-related reductions in the dorsal attention stream, mediated by the parietal lobe, may be responsible for allocating downward attention [31, 32]. With aging there is degradation of this dorsal stream, inducing an upward attentional bias [31, 32]. Therefore, when drawing a clock, it is possible that older adults with even subtle changes in visuospatial and planning abilities may deviate when determining the center of the clock (the central axis of the hour and minute hands). Unpublished research (from the aforementioned study) found that hour hand distance from center to command negatively and significantly associates with confrontation naming ability (Boston naming test [37]; r = −0.152, P < 0.05) and processing speed (Stroop word reading [40]; r = −0.159, P = < 0.05). Hour hand distance from center did not associate with reasoning (Wechsler Abbreviated Scale of Intelligence, Matrix Reasoning [38]; r = −0.076, P = 0.311), visuospatial attention (Judgment of Line Orientation [39]; r = −0.105, P = 0.165), working memory (Wechsler Adult Intelligence Scale-Third Edition, Digit Span Backward [41]; r = −0.003, P = 0.970), or episodic memory (Wechsler Memory Scale-Third Edition, Logical Memory II [42]; r = −0.044, P = 0.557).

    Other predictor variables of interest

    “Age” was defined in years of age at the time of test administration. “Years of formal education” was recorded as the number of years of formal education completed. Skipped years counted toward the total number of years. Repeated years did not add additional years. If the patient dropped out of high school, staff recorded how many full years of school the patient completed. For example, a high school graduate counted as 12 years; a bachelor’s degree counted as 16 years, and so forth. “Comorbidity” was defined by the American Society of Anesthesiologists (ASA) physical status classification [43] with scores ranging from 1 to 5, with 1 representing completely healthy and fit; 2 mild systemic disease; 3 severe systemic disease; 4 incapacitating disease that is a constant threat to life; and 5 being a patient who is not expected to live 24 h with or without surgery. “Frailty” was defined using the criteria from Fried et al. [34]. A patient qualified as frail if he/she exhibited/reported ≥ 3 of the following: (1) unintended weight loss of ≥ 4.54 kg within the last 6 months; (2) subjective exhaustion, defined as endorsing moderate feelings that everything he/she did was an effort over the last week or moderate feelings that he/she could not “get going” in the last week; (3) slow walking speed (4.57 meters in ≥ 7 s for men below 1.73 meters and women below 1.60 meters; 4.57 meters in > 6 s in men above 1.73 meters and women above 1.60 meters); (4) grip strength below a normative cutoff defined by the geriatrics evaluation and management tools [44], and (5) low physical activity as defined by the Duke Activity Status Index [45]. The final outcome variable was scored of 0–5, where 0–1 = no frailty, 2–3 = prefrailty, and 4–5 = frail.

    Hospital outcomes

    All hospital outcome variables were acquired from electronic medical records provided through an institutional review board (IRB) sanctioned honest broker. Dependent variables of interest include length of hospital stay (hours) and unadjusted total cost of hospital care (US Dollars; USD). Additional outcomes collected as sample descriptors include discharge placement and 30-day mortality.

    Statistical analyses

    Data are available upon reasonable request to the corresponding author.

    Data were checked for implausible values, missingness, and distributional form. Digitally-acquired CDT variables were assessed for multicollinearity. Due to non-normality, CDT hour hand distance from center and total time to completion were log transformed; length of stay and cost of care were square root transformed. Statistical significance was set to 0.05 and tests were two-sided.

    It is known that age, educational attainment, comorbidities, and frailty serve as risk factors for negative outcomes following surgery. We aimed to understand the contribution of cognitive performance to negative postoperative outcomes, over and above the risk associated with age, education, comorbidities, and frailty. The contribution of cognition to hospital outcomes was assessed via separate hierarchical regressions with length of stay and cost of care as the dependent variables. Age, education, ASA score [43], and Fried frailty [34] score were entered into block one, and block two consisted of CDT total time to completion, ideal digit placement difference, and hour hand distance from center. Separate models were computed for the command and copy conditions of the CDT. R2 change values were used to assess whether or not clock drawing performance to either command or copy conditions significantly improved the prediction of length of stay and cost of care, over and above age, education, ASA score [43], and frailty [34].

    Results

    Participants

    A total of 190 individuals 65+ underwent TAVR during the period of Jan 2, 2018 to Dec 31, 2019. Of those, 162 met inclusion criteria and completed a preoperative, digitally-acquired CDT to command and copy conditions (age: 78.77 ± 7.04, range 65–97; education years: 13.86 ± 3.11, range 4–26; sex: 58% male; race: 96% Caucasian; ASA score: 3 = 18.5%, 4 = 77.2%, 5 = 0.6%, missing = 3.7%; frailty: 0 = 19.1%, 1 = 14.8%, 2 = 17.3%, 3 = 17.9%, 4 = 18.5%, 5 = 4.3%, missing = 8.0%; length of stay: 62.01 ± 60.23 h; and unadjusted cost of care: $150,931.65 ± 62,070.48 USD). Missing data were identified for education (n = 10), ASA (n = 6), and Frailty (n = 13).

    Upon discharge, 132 individuals (81.98%) returned home without additional care, 19 returned home with additional care, 7 entered skilled nursing facilities, 1 entered long-term care, and 3 entered rehabilitation. Two individuals (1.2%) died within 30 days of the procedure.

    CDT performance as predictors of hospital outcomes

    Separate models were computed for the command and copy conditions of the CDT. Command condition: average time to completion was 45.42 ± 28.72 s, average ideal digit placement difference was 134.55 ± 138.17 degrees, and average hour hand distance from center was 4.17 ± 3.27 mm. Copy condition: average time to completion was 32.92 ± 15.17 s, average ideal digit placement difference was 105.66 ± 160.65 degrees, and average hour hand distance from center was 3.57 ± 2.44 mm.

    (1) Length of Stay: block one: age, education, ASA score, and frailty significantly explained 10.2% of the variance in hospital length of stay (R2 = 0.102, P = 0.015). Block two: CDT copy performance measures significantly increased R2 by 0.095, explaining an additional 9.5% of variance in length of hospital stay (R2 change = 0.095, P = 0.006); (Table 1, Figure 1).

    (2) Cost of Care: block one: age, education, ASA, and frailty did not explain a statistically significant amount of variance in cost of care (R2 = 0.045, P = 0.251). Block two: CDT copy test parameters increased R2 by 0.089, indicating an additional 8.9% of variance explained in cost of care (R2 change = 0.089, P = 0.012); (Table 1, Figure 1).

    Results from hierarchical regressions demonstrating cognitive performance via individual command and copy digitally-acquired clock drawing test predictors of length of stay and cost of care

    Outcome variableClock variableStandardized betatSig.
    Length of stayCommand
    Total time to completion (seconds)0.242.60.011
    Ideal digit placement difference (degrees)0.12−0.130.901
    Hour hand distance from center (millimeters)−0.03−0.270.787
    Copy
    Total time to completion (seconds)0.232.490.014
    Ideal digit placement difference (degrees)0.171.930.057
    Hour hand distance from center (millimeters)0.222.570.011
    Cost of careCommand
    Time to completion (seconds)0.181.940.055
    Ideal digit placement difference (degrees)−0.06−0.60.548
    Hour hand distance from center (millimeters)−0.020.190.852
    Copy
    Time to completion (seconds)0.272.780.006
    Ideal digit placement difference (degrees)0.161.720.088
    Hour hand distance from center (millimeters)0.181.950.054
    Display full size

    t: t-value; Sig.: significance (P-value)

    Participant copy condition clock drawing demonstrating hour hand distance from center and ideal digit placement difference. (A) Model clock presented to participants in the CDT copy condition; (B) drawing of a copy condition clock by a participant with longer-than-average length of stay (103.73 h) and cost of care ($ 211,159.88); (C) representation of hour hand distance from center and ideal digit placement difference for the participant’s clock. Red: circle of best fit; Green and dark blue: axes to identify center of circle; Purple: hour hand distance from center; Light blue: region for placement of each digit; Orange: distance of each digit from the ideal placement

    CDT performance on the command condition did not significantly explain variance in either model (both P > 0.05).

    Discussion

    The copy condition of the digitally-acquired CDT may be more sensitive than the command condition to subtle, preoperative cognitive impairments capable of predicting hospital outcomes and resource use after TAVR for adults older than 65. This expands upon previous research assessing the predictive value of manually scored clock drawing to command and copy in a preoperative anesthesia screening facility [14]. The present study demonstrates that specific outcome measures of copy clock drawing, but not command clock drawing, predict variance in length of hospital stay and cost of care above-beyond age, education, ASA score, and frailty in a TAVR population. Specifically, copy total time to completion was a significant predictor of both length of stay and cost of care, while hour hand distance from center was a predictor of length of stay.

    Individuals who produce errors on the copy condition, and consequently take longer to complete the copy test condition, have been shown to have more executive deficits [2123]. Previous research has shown that individuals with primary executive deficiencies and visuospatial deficits will produce similar errors on the copy condition relative to the original command condition (i.e. individuals with subcortical diseases such as small vessel vascular disease, Parkinson’s disease, or Huntington’s disease) [23, 46]. Hypothetically, individuals with subcortical diseases and executive dysfunction may be more vulnerable to perioperative stressors, as research suggests older adults with such executive difficulties prior to and following surgery have greater difficulties with post-discharge instrumental activities of daily living coupled with greater caregiver burden [1]. Taken together, the present findings support previous arguments demonstrating the efficacy of including both CDT conditions [22], but in preoperative settings, and particularly for individuals where vascular and/or executive impairment may be most prevalent. Although the current study demonstrated value for the copy condition in predicting hospital outcomes, future research investigations with larger and more diverse surgery types are warranted.

    Within the clock copy condition the measurement of total time to completion and hour hand distance from center were the leading variables significantly adding to the overall statistical models for total length of stay and hospital cost. Total time to completion has been shown to increase with age and involves both a graphomotor component and non-motor cognitive abilities [24]. Previous research has also demonstrated that copy total time to completion primarily associates with processing speed and working memory [16], which are two cognitive functions that tend to decline with age [47] and are highly vulnerable to cerebrovascular changes [48].

    At this time, it is unclear why CDT variables of interest in the command condition did not predict hospital outcomes. Total clock drawing time to command, for example, associates with numerous cognitive domains [16]. Given the many cognitive domains involved in drawing a clock to command, it may be that the command condition can identify impairment in any cognitive domain, while individuals who show errors on copy demonstrate executive “risk” necessitating closer monitoring for postoperative care. This may be particularly true for intermediate-risk surgical individuals such as those electing TAVR. Further research assessing command time to completion, hour hand distance from center, and ideal digit placement difference across larger and diverse patient groups is warranted.

    The graphomotor variables of hour hand distance from center and ideal digit placement difference are, theoretically, more sensitive to neurodegenerative changes within the dorsal attentional stream, as with aging there is atrophy of the dorsal stream which may lead to an upward attentional bias [31, 32]. Of these two variables, hour hand distance from center showed potential value for predicting length of stay. Again, it was only when these hands were misplaced in the copy condition that significant variance was explained. Collectively, these results provide rationale for larger research investigations while also appreciating the cognitive changes and type of difficulties individuals electing TAVR experience postoperatively.

    We recognize study limitations. These findings are preliminary due to our limited sample size and because two of the cognitive variables assessed (hour hand distance from center and ideal digit placement difference) are exploratory in nature. Additionally, we identified missing data in the variables of education, ASA, and frailty. Retrospective review of the data indicated that nursing staff did not report these variables and reasons for this are unknown. Moreover, we have limited details regarding the type of complications encountered in these patients, or reasons for the increased length of stay and cost (e.g., delirium). Our sample was very homogeneous, as the majority were Caucasian. However, TAVR patients nationwide are most often Caucasian men and of a mean age of 80 years old [49]. We also recognize that while our findings speak to the utility of a digitally-acquired version of the CDT, we do not compare the digitally-acquired CDT to other cognitive measures, either with or without a digital adaptation.

    Despite these limitations, the present findings highlight the promise of digitally-acquired neuropsychological tools for detecting subtle cognitive vulnerabilities that may predict negative postoperative outcomes. This is the first published study to assess a digitally-acquired cognitive assessment in well-characterized TAVR patients specifically. Study strengths include the digital technology integration, theoretical approach to clock drawing constructs, and the addition of a copy condition relative to many assessments which solely employ command clock drawing [22, 50]. In addition, these proof of concept findings lend evidence for the utility of similar investigations in larger and more diverse patient samples. The findings in the present proof of concept paper are novel and underscore the value of digitally-acquired neuropsychological parameters that cannot be efficiently measured using traditional paper and pencil tests. Future research is needed to investigate additional digitally-acquired CDT variables and whether or not they, too, have predictive value for hospital outcomes following surgery.

    Abbreviations

    ASA:

    American Society of Anesthesiologists

    CDT:

    clock drawing test

    TAVR:

    transcatheter aortic valve replacement

    Declarations

    Author contributions

    MEW, GJA, PT, and CCP contributed to study concept, MEW, CD, KMH, PT, DJL, and CCP contributed to manuscript preparation. MEW, CD, EF, AD, SA, KMH, RD, DP, CWG, GJA, PT, DJL, and CCP contributed to manuscript revisions. EF, AD, SA, GJA, PT, and CCP contributed to data acquisition. MEW, CD, CWG, PT, DJL, and CCP contribute to statistical analyses. MEW and EF contributed to figure preparation. All authors read and approved the submitted version.

    Conflicts of interest

    Drs. Dana Penney and Randall Davis are the creators of the digital CDT and previously owned stock in this company, and Dr. David Libon previously owned stock in Digital Cognition Technology.

    Ethical approval

    This study was institutional review board-approved with Health Insurance Portability and Accountability Act (HIPAA) waiver and honest broker medical record extraction. The study followed Declaration of Helsinki standards and was in accordance with all institutional guidelines and acceptable research standards. This manuscript adheres to the applicable STROBE guidelines.

    Consent to participate

    The authors have obtained and archived written informed consent from all participants in the study, with proof of consent available upon request.

    Consent to publication

    Not applicable.

    Availability of data and materials

    Data are available upon reasonable request to the corresponding author.

    Funding

    Funding Sources: National Institute of Health R01 NR014181, National Science Foundation NSF 13-543, National Institute of Health R01 AG055337-02. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

    Copyright

    © The Author(s) 2021.

    References

    Price CC, Garvan CW, Monk TG. Type and severity of cognitive decline in older adults after noncardiac surgery. Anesthesiology. 2008;108:817. [DOI] [PubMed] [PMC]
    Price CC, Tanner JJ, Schmalfuss I, Garvan CW, Gearen P, Dickey D, et al. A pilot study evaluating presurgery neuroanatomical biomarkers for postoperative cognitive decline after total knee arthroplasty in older adults. Anesthesiology. 2014;120:60113. [DOI] [PubMed] [PMC]
    Smith PJ, Attix DK, Weldon BC, Greene NH, Monk TG. Executive function and depression as independent risk factors for postoperative delirium. Anesthesiology. 2009;110:7817. [DOI] [PubMed] [PMC]
    Monk TG, Weldon BC, Garvan CW, Dede DE, van der Aa MT, Heilman KM, et al. Predictors of cognitive dysfunction after major noncardiac surgery. Anesthesiology. 2008;108:1830. [DOI] [PubMed]
    Moller JT, Cluitmans P, Rasmussen LS, Houx P, Rasmussen H, Canet J, et al. Long-term postoperative cognitive dysfunction in the elderly ISPOCD1 study. ISPOCD investigators. International study of post-operative cognitive dysfunction. Lancet. 1998;351:85761. [DOI] [PubMed]
    Oresanya LB, Lyons WL, Finlayson E. Preoperative assessment of the older patient: a narrative review. JAMA. 2014;311:211020. [DOI] [PubMed]
    Thourani VH, Kodali S, Makkar RR, Herrmann HC, Williams M, Babaliaros V, et al. Transcatheter aortic valve replacement versus surgical valve replacement in intermediate-risk patients: a propensity score analysis. Lancet. 2016;387:221825. [DOI] [PubMed]
    Tilley E, Psaltis PJ, Loetscher T, Davis DH, Harrison SL, Kim S, et al. Meta-analysis of prevalence and risk factors for delirium after transcatheter aortic valve implantation. Am J Cardiol. 2018;122:191723. [DOI] [PubMed] [PMC]
    Ando T, Adegbala O, Villablanca PA, Akintoye E, Ashraf S, Briasoulis A, et al. Predictors of hospital cost after transcatheter aortic valve implantation in the United States: from the Nationwide Inpatient Sample Database. Am J Cardiol. 2019;123:11428. [DOI] [PubMed]
    Khandelwal D, Goel A, Kumar U, Gulati V, Narang R, Dey AB. Frailty is associated with longer hospital stay and increased mortality in hospitalized older patients. J Nutr Health Aging. 2012;16:7325. [DOI] [PubMed]
    Bendayan M, Messas N, Perrault LP, Asgar AW, Lauck S, Kim DH, et al. Frailty and bleeding in older adults undergoing TAVR or SAVR: insights from the FRAILTY-AVR study. JACC Cardiovasc Interv. 2020;13:105868. [DOI] [PubMed]
    Feuchtner G, Kofler M, Plank F, Dumfarth J, Bonaros N, Min JK, et al. Frailty matters. How-to predict “I’ll be back” after TAVR. J Cardiovasc Comput Tomogr. 2018;12:22930. [DOI] [PubMed]
    Veering BT. Management of anaesthesia in elderly patients. Curr Opin Anaesthesiol. 1999;12:3336. [DOI] [PubMed]
    Amini S, Crowley S, Hizel L, Arias F, Libon DJ, Tighe P, et al. Feasibility and rationale for incorporating frailty and cognitive screening protocols in a preoperative anesthesia clinic. Anesth Analg. 2019;129:8308. [DOI] [PubMed] [PMC]
    Culley DJ, Flaherty D, Reddy S, Fahey MC, Rudolph J, Huang CC, et al. Preoperative cognitive stratification of older elective surgical patients: a cross-sectional study. Anesth Analg. 2016;123:18692. [DOI] [PubMed] [PMC]
    Dion C, Arias F, Amini S, Davis R, Penney D, Libon DJ, et al. Cognitive correlates of digital clock drawing metrics in older adults with and without mild cognitive impairment. J Alzheimers Dis. 2020;75:7383. [DOI] [PubMed] [PMC]
    Souillard-Mandar W, Davis R, Rudin C, Au R, Libon DJ, Swenson R, et al. Learning classification models of cognitive conditions from subtle behaviors in the digital clock drawing test. Mach Learn. 2016;102:393441. [DOI] [PubMed] [PMC]
    Hizel LP, Warner ED, Wiggins ME, Tanner JJ, Parvataneni H, Davis R, et al. Clock drawing performance slows for older adults after total knee replacement surgery. Anesth Analg. 2019;129:2129. [DOI] [PubMed] [PMC]
    Lamar M, Ajilore O, Leow A, Charlton R, Cohen J, GadElkarim J, et al. Cognitive and connectome properties detectable through individual differences in graphomotor organization. Neuropsychologia. 2016;85:3019. [DOI] [PubMed] [PMC]
    Libon DJ, Swenson RA, Barnoski EJ, Sands LP. Clock drawing as an assessment tool for dementia. Arch Clin Neuropsychol. 1993;8:40515. [PubMed]
    Libon DJ, Malamut BL, Swenson R, Sands LP, Cloud BS. Further analysis of clock drawings among demented and non-demented subjects. Archives of Clinical Neuropsychology. 1996;11:193205. [PubMed]
    Price CC, Cunningham H, Coronado N, Freedland A, Cosentino S, Penney DL, et al. Clock drawing in the Montreal Cognitive Assessment: recommendations for dementia assessment. Dement Geriatr Cogn Disord. 2011;31:17987. [DOI] [PubMed] [PMC]
    Cosentino S, Jefferson A, Chute DL, Kaplan E, Libon DJ. Clock drawing errors in dementia: neuropsychological and neuroanatomical considerations. Cogn Behav Neurol. 2004;17:7484. [DOI] [PubMed]
    Piers RJ, Devlin KN, Ning B, Liu Y, Wasserman B, Massaro JM, et al. Age and graphomotor decision making assessed with the digital clock drawing test: the framingham heart study. J Alzheimers Dis. 2017;60:161120. [DOI] [PubMed] [PMC]
    Cohen J, Penney DL, Davis R, Libon DJ, Swenson RA, Ajilore O, et al. Digital Clock Drawing: differentiating “thinking” versus “doing” in younger and older adults with depression. J Int Neuropsychol Soc. 2014;20:9208. [DOI] [PubMed] [PMC]
    Davoudi A, Dion C, Amini S, Libon DJ, Tighe PJ, Price CC, et al. Phenotyping cognitive impairment using graphomotor and latency features in digital clock drawing test. Annu Int Conf IEEE Eng Med Biol Soc. 2020:535760. [DOI] [PubMed] [PMC]
    Davoudi A, Amini S, Dion C, Wiggins M, Libon DJ, Price CC, et al. Towards understanding pen movement contributions to clock drawing cluster classifications. Abstracts of Posters Accepted to the International Anesthesia Research Society 2020 Annual Meeting; 2020 May 15-18; San Francisco, USA. Alphen aan den Rijn: Wolters Kluwer; 2020.
    Doerner J, Kupczyk PA, Wilsing M, Luetkens JA, Storm K, Fimmers R, et al. Cerebral white matter lesion burden is associated with the degree of aortic valve calcification and predicts peri-procedural cerebrovascular events in patients undergoing transcatheter aortic valve implantation (TAVI). Catheter Cardiovasc Interv. 2018;91:77482. [DOI] [PubMed]
    Libon DJ, Price CC, Giovannetti T, Swenson R, Bettcher BM, Heilman KM, et al. Linking MRI hyperintensities with patterns of neuropsychological impairment: evidence for a threshold effect. Stroke. 2008;39:80613. [DOI] [PubMed]
    Price CC, Mitchell SM, Brumback B, Tanner JJ, Schmalfuss I, Lamar M, et al. MRI-leukoaraiosis thresholds and the phenotypic expression of dementia. Neurology. 2012;79:73440. [DOI] [PubMed] [PMC]
    Mankowska A, Heilman KM, Williamson JB, Harciarek M. Age-related changes in the allocation of vertical attention. J Int Neuropsychol Soc. 2018;24:11214. [DOI] [PubMed]
    Mankowska A, Heilman KM, Williamson JB, Michalowski J, Harciarek M. Age-related changes in the allocation of spatially directed focal attention. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2020;27:74864. [DOI] [PubMed]
    Enneking FK, Radhakrishnan NS, Berg K, Patel S, Wishin JM, Vasilopoulos T. Patient-centered anesthesia triage system predicts ASA physical status. Anesth Analg. 2017;124:195762. [DOI] [PubMed]
    Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001;56:M14656. [DOI] [PubMed]
    Cabeza R, Dennis N. Principles of Frontal Lobe Function, 2nd ed. New York: Oxford University Press; 2012. pp. 62852.
    Jak AJ, Bondi MW, Delano-Wood L, Wierenga C, Corey-Bloom J, Salmon DP, et al. Quantification of five neuropsychological approaches to defining mild cognitive impairment. Am J Geriatr Psychiatry. 2009;17:36875. [DOI] [PubMed] [PMC]
    Kaplan E, Goodglass H, Weintrab S. The boston naming test. Philadelphia: Lea&Febiger; 1983.
    Wechsler D. Wechsler abbreviated scale of intelligence. San Antonio (TX): The Psychological Corporation; 1999.
    Benton A, Hannay HJ, Varney NR. Visual perception of line direction in patients with unilateral brain disease. Neurology. 1975;25:90710. [DOI] [PubMed]
    Stroop JR. Studies of interference in serial verbal reactions. Journal of Experimental Psych. 1935;18:64362. [DOI]
    Wechsler D. Wechsler Adult Intelligence Scale. 3th ed. San Antonio (TX): The Psychological Corporation; 1997. [DOI]
    Wechsler D. Wechsler Memory Scale 3th ed. San Antonio (TX): The Psychological Corporation; 1997.
    Dripps RD. New classification of physical status. Anesthesiology. 1963;24:111.
    Rubenstein LZ, Stuck AE, Siu AL, Wieland D. Impacts of geriatric evaluation and management programs on defined outcomes: overview of the evidence. J Am Geriatr Soc. 1991;39 Suppl 1:8S16S; discussion 7S–8S. [DOI] [PubMed]
    Hlatky MA, Boineau RE, Higginbotham MB, Lee KL, Mark DB, Califf RM, et al. A brief self-administered questionnaire to determine functional capacity (the Duke Activity Status Index). Am J Cardiol. 1989;64:6514. [DOI] [PubMed]
    Rouleau I, Salmon DP, Butters N, Kennedy C, McGuire K. Quantitative and qualitative analyses of clock drawings in Alzheimer’s and Huntington’s disease. Brain Cogn. 1992;18:7087. [DOI] [PubMed]
    Salthouse TA. Influence of processing speed on adult age differences in working memory. Acta Psychol (Amst). 1992;79:15570. [DOI] [PubMed]
    Jellinger KA. The pathology of ischemic-vascular dementia: an update. J Neurol Sci. 2002;203–204:1537. [DOI]
    Abugroun A, Daoud H, Abdel-Rahman ME, Hallak O, Igbinomwanhia E, Sanchez A, et al. National trends of outcomes in transcatheter aortic valve replacement (TAVR) through transapical versus endovascular approach: from the National Inpatient Sample (NIS). Cardiovasc Revasc Med. 2020;21:96470. [DOI] [PubMed]
    Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:6959. [DOI] [PubMed]