• Open Access
    Original Article

    Development and validation of an infrared-artificial intelligence software for breast cancer detection

    Enrique Martín-Del-Campo-Mena 1
    Pedro A. Sánchez-Méndez 2*
    Eva Ruvalcaba-Limon 3
    Federico M. Lazcano-Ramírez 4
    Andrés Hernández-Santiago 2
    Jorge A. Juárez-Aburto 2
    Kictzia Y. Larios-Cruz 5
    L. Enrique Hernández-Gómez 2
    J. Andrei Merino-González 2
    Yessica González-Mejía 2

    Explor Target Antitumor Ther. 2023;4:294–306 DOI: https://doi.org/10.37349/etat.2023.00135

    Received: November 30, 2022 Accepted: February 13, 2023 Published: April 27, 2023

    Academic Editor: Alfonso Reginelli, University of Campania L. “Vanvitelli”, Italy

    This article belongs to the special issue Artificial Intelligence for Precision Oncology

    Abstract

    Aim:

    In countries where access to mammography equipment and skilled personnel is limited, most breast cancer (BC) cases are detected in locally advanced stages. Infrared breast thermography is recognized as an adjunctive technique for the detection of BC due to its advantages such as safety (by not emitting ionizing radiation nor applying any stress to the breast), portability, and low cost. Improved by advanced computational analytics techniques, infrared thermography could be a valuable complementary screening technique to detect BC at early stages. In this work, an infrared-artificial intelligence (AI) software was developed and evaluated to help physicians to identify potential BC cases.

    Methods:

    Several AI algorithms were developed and evaluated, which were learned from a proprietary database of 2,700 patients, with BC cases that were confirmed through mammography, ultrasound, and biopsy. Following by evaluation of the algorithms, the best AI algorithm (infrared-AI software) was submitted to a clinic validation process in which its ability to detect BC was compared to mammography evaluations in a double-blind test.

    Results:

    The infrared-AI software demonstrated efficiency values of 94.87% sensitivity, 72.26% specificity, 30.08% positive predictive value (PPV), and 99.12% negative predictive value (NPV), whereas the reference mammography evaluation reached 100% sensitivity, 97.10% specificity, 81.25% PPV, and 100% NPV.

    Conclusions:

    The infrared-AI software here developed shows high BC sensitivity (94.87%) and high NPV (99.12%). Therefore, it is proposed as a complementary screening tool for BC.

    Keywords

    Breast cancer, infrared thermography, artificial intelligence, mammography, screening

    Introduction

    In Mexico, over 75% of new breast cancer (BC) cases are detected in locally advanced stages, which increases treatment costs and reduces overall survival [1]. Two of the main reasons for low rates of early BC detection are the lack of mammography units and few specialized personnel that can interpret mammograms.

    Mexico is a member country of the Organization for the Economic Co-operation and Development (OECD) with the least amount of mammography units per million inhabitants (9.7), meanwhile, countries like South Korea and the United States have 61.6 and 65.3, respectively [2]. In 2015, the Mexican Council of Radiology and Image reported 3,911 certified medical radiologists in Mexico [3]. Similarly, in 2018, the Mexican Medical Journal reported 3,819 physicians with a specialization in diagnostic-therapeutic medical imaging [4] 3.06 per 100,000 habitants, which is particularly low compared to the European average (12.8) [5] and the US (8.43) [6]. It is therefore crucial to strengthen the investment and development of new techniques that allow for more patients to be screened and facilitate earlier detection of BC at lower costs, particularly for rural and isolated regions.

    Infrared thermography is a complementary technique for BC screening. Approved by Food and Drug Administration (FDA) [7], this technique has been used extensively in research to detect BC [810]. The advantages of using infrared thermography for BC screening include its safety since it does not emit ionizing radiation or submit the breast to mechanical pressure, as well as low cost and portability.

    The use of infrared thermography is based on the principle that malignant tumors stimulate the formation of new blood vessels to nourish and sustain accelerated cellular growth, which is called angiogenesis [11], producing an increase in blood flow and therefore in the temperature around the tumor. This temperature change produces a thermal asymmetry between both breasts, which is shown as a higher surface temperature in the breast that has the tumor. The temperature difference between breasts may vary and is different for each patient, although some studies mention that the common temperature differences for BC are above 2°C [12].

    The objective of this research was to develop artificial intelligence (AI) software to detect BC from infrared images (infrared-AI software), learned from known BC cases, as detected by mammography, ultrasound, and biopsy. The infrared-AI software was then evaluated as a BC screening test, in comparison to mammography evaluations.

    Materials and methods

    Patients

    A total of 3,812 female participants were recruited for this research (≥ 18 years old). All participants attended the Breast Cancer Foundation (FUCAM A.C.) in Mexico City between June 2018 and April 2021 to receive screening mammography or complementary tests due to suspicion of BC.

    Exclusion criteria in the trials included pregnancy, previous BC diagnosis, currently undergoing BC treatment, breast implants, partial or total mastectomy, breast surgery or surgery in the thorax area within the previous two years, and/or a breast biopsy in the previous three months. During the test, patients were excluded if: they did not receive mammography after the initial infrared test; they only received a breast ultrasound, tests reported them as breast imaging reporting and data system (BI-RADS) 3,4 or 5 without follow-up at FUCAM A.C. to confirm BC; they did not receive radiologic or histopathologic evaluations, or infrared tests were poorly taken.

    This research was approved by the Research, Bioethics, and Biosafety Committee from FUCAM A.C. All participants signed informed consent.

    Infrared tests

    Prior to the infrared test, each patient answered a questionnaire about their family history, symptoms, previous activities, and conditions that affect their body temperatures, such as drug and/or stimulant intake, and current menstrual cycle phase (Supplementary material). The infrared tests were performed before the mammography, ultrasound, and/or biopsy, following the guidance of the American Academy of Thermology [13], with the allowed adjustments (Figure 1). Three basal images were taken in the first image set: frontal, 30° to the right of midline, and 30° to the left. The second image set called the dynamic test, was performed to identify which areas retained a higher temperature after cooling the breast, armpit, and neck areas using disposable hypoallergenic wet tissues. Following 1 min of rest after cooling to allow the remaining liquid to evaporate, the second set of images was taken from the same positions as the first image set (Figure 2). For patients with recent mammography or ultrasound, the infrared test was performed between 24 h and 30 days after those tests.

    Infrared test image acquisition

    Infrared test reference positions and example images

    The six infrared images and the clinical data made up a registry for each patient. Registries were stored on a software database made for this purpose. Infrared tests were performed by four nurses trained to use the infrared camera and software. The infrared camera used was a FLIR® T650sc, with an infrared resolution of 640 pixels × 480 pixels, thermal sensitivity of < 20 mK (0.02°C), and accuracy of ± 1°C.

    Research study’s design

    The research study was divided into two phases: (1) the development of the AI algorithms, and (2) clinical validation. In the second phase, a double-blind design was implemented, where the infrared test operator did not know the mammography’s results, and the mammography technicians and radiologists did not know the infrared test’s results.

    Phase 1: development of the AI algorithm

    To find the best AI model for these trials, several AI algorithms were developed and tested. The algorithms developed included architectures based on neural networks (multi-layered, convolutional, and deep learning), support vector machines (SVMs), and K-nearest neighbors. These AI algorithms were supplied with a subset of patient registries as well as the mammograms’ BI-RADS score (mammograph evaluations performed by certified radiologists from FUCAM A.C.). The number of patient registries needed to obtain an efficient AI algorithm that could distinguish between patients with or without malignancy was defined by theoretical saturation. The AI algorithms were designed to generate a binary classification: zero (0) for test results that were “non-suspicious” of BC and one (1) for test results “suspicious” of BC. The 6 categories of the BI-RADS [14] scale which was used to define the BC probability of each patient are shown in Table 1.

    Categories of BI-RADS scales and management recommendations

    AssessmentManagementProbability of malignancy
    BI-RADS 0: not conclusiveAdditional tests are requiringN/A
    BI-RADS 1: normal breastRoutine mammography screeningEssentially 0%
    BI-RADS 2: benignRoutine mammography screeningEssentially 0%
    BI-RADS 3: probably benignRequires semestral follow-up by two years≤ 2%
    BI-RADS 4: probably malignantBiopsy required> 2% and < 95%
    BI-RADS 4A: low suspicionBiopsy required> 2% and ≤ 10%
    BI-RADS 4B: moderate suspicionBiopsy required> 10% and ≤ 50%
    BI-RADS 4C: high suspicionBiopsy required> 50% and ≤ 95%
    BI-RADS 5: highly suggestive of malignancyBiopsy required≥ 95%
    BI-RADS 6: histologically confirmed malignancySurgical excision when clinically appropriateN/A
    Display full size

    N/A: not applicable

    The subset of patient registries supplied to each AI algorithm was labeled as “without BC” if they belonged to patients with mammogram BI-RADS1,2, and “with BC” if they belonged to patients with mammogram BI-RADS 3,4, or 5 where BC was confirmed by biopsy. In order to obtain an AI algorithm with high BC sensitivity, the registries from patients with BI-RADS 3,4, or 5 that had a follow-up biopsy result of benign pathology, and BI-RADS 3 cases that were re-evaluated afterward as BI-RADS 2 (mammography false positives), were not supplied to the AI algorithms.

    To evaluate and compare the efficiency of each AI algorithm and identify the best model, a subset of patient registries was kept aside from the development process described above. This “validation subset” was used to calculate the effectiveness metrics: sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV), area under the curve (AUC), and F1 score for each algorithm. For this research, only the algorithms that showed a sensitivity equal to or superior to 95% with an F1 score superior to 0.75 were kept.

    Phase 2: clinical validation

    In the second phase, a new group of participants underwent infrared-AI and mammography screening at FUCAM A.C. between September 2020 and April 2021. The findings from the infrared-AI software were consigned into individual reports according to the classification of the American Academy of Thermology based on the scale proposed by Villa Marie and Marseille [15]; when the AI algorithm outputs a “non-suspicious” (0) test result, it was reported as a Th1 or Th2. When the AI algorithm outputs a test result “suspicious” of BC (1), it was reported as a Th3, Th4, or Th5.

    The sample size for this phase was 337 patients; this was calculated using the equation on studies for diagnostic tests proposed by Pedraza and Raad [16], with α at 5% and β at 10%. The sensitivity for the mammography applied in the development phase is π1 (sensitivity from the mammography applied in the development phase), and π2 (sensitivity from the AI algorithm validation subset) is the sensitivity from the AI algorithm validation subset.

    Statistical analysis

    Descriptive statistics analysis was applied to clinical variables obtained from clinical files, radiological and histopathological reports, as well as patient questionnaires completed prior to the infrared tests. Chi [2] and Fishers’ exact tests were used to analyze the correlation between the infrared test results and the clinical variables. The statistical analyses were carried out using the software EPI Info™ 6.0 version [Centers for Disease Control and Prevention (CDC), Atlanta, USA] and web statistical calculator SISA (Daan Uitenbroek, Hilversum, Netherlands) [17].

    For validation of the infrared-AI software, the algorithm’s effectiveness metrics were calculated and compared with the same scores calculated from the mammography evaluations and biopsy. A two-tailed P ≤ 0.05 was considered statistically significant.

    Results

    Registries from 3,812 patient candidates were obtained during the study (3,500 for the AI algorithm development phase, and 312 for the clinical validation phase). Of these, 440 registries were excluded during phase 1, and 35 were excluded from phase 2 due to meeting one or more of the exclusion criteria. A total sample of 3,337 patient registries (3,060 for phase 1, and 277 for phase 2) was used in this research (Figure 3).

    Distribution of patient registries used during the study

    The average patient age was 54 years, ranging from 18 years to 90 years. One in five patients reported a family history of BC and 65.1% reported at least one activity or condition that altered their body temperature. Biopsies were performed for 300 of the 3,337 participants, of which 129 (43%) were diagnosed with BC and 171 (57%) with benign breast pathology. The sociodemographic and pathological characteristics of participants are shown in Table 2.

    Patient sociodemographic and disease characteristics

    VariableTotal
    Patients3,337
    Age (years)54 ± 10
    BMI (kg/m2)28.15 ± 4.73
      Underweight13 (0.4%)
      Normal896 (26.9%)
      Overweight1,396 (41.8%)
      Obesity1,032 (30.9%)
    Premenopausal1,038 (31.1%)
    Postmenopausal2,299 (68.9%)
    Age of menopause (years), n = 2,99947 ± 5
    Family history BC/OC
      No2,655 (79.6%)
      Yes682 (20.4%)
    Breast pain
      No2,435 (73%)
      Yes902 (27%)
    Activities and conditions that affect body temperature*
      No1,163 (34.9%)
      Yes2,174 (65.1%)
    Breast density
      A194 (5.8%)
      B2,584 (77.4%)
      C476 (14.3%)
      D12 (0.4%)
      N/A76 (2.1%)
    Histopathological test, n = 300
      Benign171 (57%)
      Malignant129 (43%)
    BC grade, n = 129
      I9 (7%)
      II69 (53.5%)
      III36 (27.9%)
      N/A15 (11.6%)
    Tumor size#, n = 129
      T168 (52.7%)
      T249 (38%)
      T310 (7.8%
      T42 (1.6%)
    Display full size

    BMI: body mass index; OC: ovarian cancer; N/A: information not available; *: physical activity, drug and stimulant consumption, menstrual cycle phase; tumor size according to the American Cancer Society classification

    Phase 1: development of the AI algorithm

    AI algorithms developed in this phase were supplied with 2,699 patient registries, of which 2,609 were mammography BI-RADS 1,2 (patients without BC) and 90 were BI-RADS 3–5 with biopsy that confirmed BC. The 289 patient registries with BI-RADS 3–5 whose biopsy indicated benign pathology, or who were re-evaluated as BI-RADS 2 after the follow-up, were not supplied to the AI algorithms (see Figure 3). The AI algorithm with the best performance during this testing was a convolutional neural network (CNN) based on the residual net 50 (ResNet 50), with additional layers connected to an output artificial neuron (Figure 4).

    Flowchart of the implementation of the AI algorithm. RGB: red, green, blue; ROI: region of interest; ID: identity

    The validation subset used for this algorithm was comprised of 72 patient registries, including 34 patients with BC and 38 patients without BC. The effectiveness metrics for the mammography used during phase 1 and the validation subset are shown in Table 3.

    Effectiveness metrics for the mammography used during phase 1 and AI validation subset

    Techniques evaluatedClinical validationSensitivitySpecificityPPVNPVAUCF1 score
    Non-suspiciousBC*
    Mammography phase 1
    BI-RADS 1,22,702199.19%92.03%34.45%99.96%N/AN/A
    BI-RADS 3–5234123π1
    AI validation subset
    0 (non-suspicious)19197.06%50.0%63.46%95.0%0.7350.7674
    1 (suspicious)1933π2
    Display full size

    Patients with histopathological results; N/A: not applicable

    Phase 2: clinical validation

    During phase 2, additional 277 registries were generated. Together with the patient registries used with the AI algorithm validation subset, this resulted in a total of 349 that were used to validate the clinical effectiveness of the infrared-AI software. Of these, 39 corresponded to patients with confirmed BC diagnoses. The effectiveness metrics of the infrared-AI software at detecting BC cases were compared against reference mammography of the same 349 patients (Table 4).

    Effectiveness of the infrared-AI software and mammography in detecting BC cases

    Screening techniquesClinical validationSensitivitySpecificityPPVNPV
    Non-suspiciousBC*
    Mammography
    BI-RADS 1,23010100.0%97.10%81.25%100.0%
    BI-RADS 3–5*939
    Infrared-AI software
    Th1,2 (non-suspicious)224294.87%72.26%30.08%99.12%
    Th3,4,5 (suspicious)8637
    Display full size

    Patients with histopathological results

    A statistical correlation was not found between the infrared-AI software test results and patient BMI (P = 0.697) or breast density (P = 0.081), nor with the presence of conditions that alters body temperature (P = 0.287). No other clinical variables showed a statistical correlation with the test results from the infrared-AI software (Table 5).

    Correlations between the infrared-AI software test results and patient characteristics

    Clinical variablesValueInfrared-AI software result# (error)Infrared-AI software result# (hit)χ2P value
    FPFNTotalTPTNTotal
    BMI (kg/m2, n = 349)Underweight0000221.810.697*
    Normal1601674451
    Overweight3713815109124
    Obesity33134156984
    Breast painNo74074171842011.970.16
    Yes12214204060
    Activities and conditions that affect body temperatureNo270271748651.130.287
    Yes5926120176196
    Breast densityA707514197.670.081*
    B6526721168189
    C12012114253
    D202000
    BC grade (n = 39)I-0-1--0.390.811*
    II119
    III113
    N/A04
    Tumor sizeT1-0-19--6.020.120*
    T2115
    T312
    T401
    Display full size

    Error is the false-positive (FP) and false-negative (FN) given by the infrared-AI software; thus, hit is the true positive (TP) and true negative (TN). N/A: information not available; -: bank cell; *: P value calculated by Fisher’s exact test

    Discussion

    In this study, an infrared-AI software developed to detect suspicious and non-suspicious cases of BC from infrared breast thermography images achieved sensitivity (94.87%) and NPV (99.12%) scores comparable to using mammography. However, the infrared-AI software’s specificity (72.26%) and PPV (30.08%) scores were inferior to mammography.

    As the standard method for BC screening, mammography has been shown to reduce patient mortality rates by 25% in developed countries with well-organized screening programs [18]. However, in Mexico and across Latin America where mammography equipment and trained personnel are less available, the goal of reducing mortality through early detection of BC has not yet been achieved [19].

    In this context, the infrared-AI software presented in this research study could be useful in certain countries since infrared thermography is safe, affordable, scalable, and approved by the FDA as an adjunctive tool for BC screening. Although the infrared-AI software sensitivity (94.87%) was inferior to that of the mammography used in the trials, the infrared-AI software demonstrated higher BC sensitivity compared with average mammography sensitivity in Mexico, which some studies estimate to be around 71–75% [20, 21]. It should be noted that the infrared-AI software presented in this research study was able to detect all cases of BC with T1 tumors (19 cases), thus showing its potential utility to detect early-stage malignant lesions.

    Since the specificity and PPV of the infrared-AI software were lower than those of the mammography used, the use of the infrared-AI software alone is not recommended for definitive diagnosis. The low specificity of thermography has been documented in other studies [22, 23], and may be due to several benign breast pathologies producing similar thermal alterations which could result in false positives [24].

    The correlation analysis showed that the infrared-AI software was not influenced by breast density, which means that the algorithm could complement mammography analyses and address the difficulty that mammography currently faces when testing young females and/or females with dense breast tissue. This is relevant in the Mexican and Latin American context, where 20% of cases of BC are detected in young women [25], reinforcing the need for more tools for BC monitoring of this age group.

    Use of AI in breast image classification

    The use of AI in breast image classification has been tested in various research studies to classify mammograms [26] as well as infrared images. In 2018, Gogoi et al. [27] revised different AI algorithms for the analysis of breast infrared images, identifying a sensitivity superior to 80% in most of them, in comparison with a sensitivity of 98% in their AI method based on polynomial SVM. Zuluaga-Gomez et al. [28] developed a CNN that classified infrared breast images from a database of 57 patients; by using “data augmentation” and “hyperparameters tuning”, their AI algorithm obtained a sensitivity of 92% and an accuracy of 94%.

    It is important to note that Zuluaga-Gomez et al. [28] and other works used publicly available databases for their research, mainly the Database for Mastology Research (DMR) database (287 patients) [29], and the Department of Biotechnology, Tripura University and Jadavpur University (DBT-TU-JU) database (100 patients) [30]. The present research study was made in a specialized medical center for breast pathologies (FUCAM A.C.) which allowed the research team to build a large proprietary database of infrared images (20,022 images from 3,337 patients) with respective clinical, radiological, and histopathological patient information. Under the scope of some recent review publication works [31, 32], this research is one of the largest combining AI and thermography.

    Additionally, unlike many studies, this research was not limited to the evaluation of an AI algorithm but also carried out clinical validation of the software itself. In a similar clinical trial, Rassiwala et al. [33] performed infrared, clinical exploration, radiologic and histopathologic tests with 1,008 female patients. Their methodology for analyzing thermal images was based on the temperature gradient calculation, and those with test results of delta T (ΔT) > 2.5 were classified as abnormal. They reported a sensitivity of 97.6%, specificity of 99.17%, PPV of 83.67%, and NPV of 99.89%.

    Research limitations

    The low capacity of the infrared-AI software to differentiate between benign and malignant pathologies, with a specificity of 72%, could be due to the exclusion of 289 patients with benign pathology from the AI algorithm’s development. This decision was made due to the research’s principal goal, which was to increase the algorithm’s BC sensitivity. Future studies could investigate whether introducing benign pathology to the AI algorithm development increases specificity without reducing sensitivity. In addition, the CNN architecture used in the infrared-AI software increases its efficiency when more data is provided [34], therefore continuing to collect data could improve the clinical effectiveness of the infrared-AI software.

    The authors acknowledge a few methodological limitations of this research. Firstly, the improbable 100% sensitivity and NPV for the used mammography are likely due to an inability to measure false negatives from FUCAM A.C.’s mammography. Similarly, the research’s scope did not include a third diagnosis test for instances where the infrared-AI software detected a suspicious case, but the mammography did not. A third diagnosis test was not implemented here because it was considered unethical to perform a biopsy on patients when the standard BC screening technique considered the patient not to be at risk of malignancy.

    Future work

    In the future, the infrared-AI software could be evaluated with a larger sample of patient registries and following a trial design that removes the methodological limitations described above. In addition, future work could evaluate the efficiency and cost-effectiveness of a BC screening strategy that integrates the infrared-AI software with mammography and ultrasound for females aged 40 years and above, and one that integrates the infrared-AI software with ultrasound for younger females.

    Conclusions

    In this work, an infrared-AI software developed to detect BC from infrared breast thermography images (infrared-AI software) showed high sensitivity (94.87%) and high NPV (99.12%), but lower specificity (72.26%) and PPV (30.08%) compared to mammography, the standard BC screening technique. The infrared-AI software is therefore proposed as a complementary tool for BC screening, but not for definitive diagnosis. Increasing the amount and range of patient data that the AI algorithm uses to build its predictive model, as well as the amount of patient data available for clinical validation, will improve its efficiency, accuracy, and potential value as a complementary BC screening tool.

    Abbreviations

    AI:

    artificial intelligence

    BC:

    breast cancer

    BI-RADS:

    breast imaging reporting and data system

    BMI:

    body mass index

    CNN:

    convolutional neural network

    FUCAM A.C.:

    Breast Cancer Foundation

    NPV:

    negative predictive value

    PPV:

    positive predictive value

    Supplementary material

    The supplementary material for this article is available at: https://www.explorationpub.com/uploads/Article/file/1002135_sup_1.pdf.

    Declarations

    Acknowledgments

    Thanks are due to FUCAM A.C. for facilitating communication with patients and for those little details given in this research, especially to the Department of Radiology.

    Author contributions

    EMDCM: Conceptualization, Methodology, Project administration, Writing—original draft. PASM: Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing—original draft, Writing—review & editing. ERL: Writing—original draft, Writing—review & editing. FMLR: Data curation, Formal analysis. Writing—original draft. AHS: Conceptualization, Software, Formal analysis. JAJA: Software, Formal analysis. KYLC: Resources, Validation. LEHG: Conceptualization, Funding acquisition, Writing—review & editing. JAMG: Conceptualization, Funding acquisition. YGM: Investigation. All authors read and approved the submitted version.

    Conflicts of interest

    The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: PASM, AHS, JAJA, LEHG, JAMG, and YGM report a relationship with Hearthcore SAPI de CV as associates, but declare to only have a scientific interest in this research. EMDCM reports a relationship with Hearthcore that includes non-financial support as a medical advisor. There are no further conflicts of interest to be declared.

    Ethical approval

    This research was conducted in accordance with the standards of the Research, Bioethics, and Biosafety Committee from FUCAM A.C. [PI 19-05], as well as with the 1964 Declaration of Helsinki and its later amendments.

    Consent to participate

    Informed consent to participate in the study was obtained from all participants.

    Consent to publication

    Informed consent to publication was obtained from relevant participants.

    Availability of data and materials

    The electronic patient record data used to support the findings of this research are restricted by FUCAM A.C. in order to protect patient’s privacy, also, the database of infrared images generated in this trial are property of Heathcore SAPI de CV. Requests for accessing the datasets should be directed to [Eva Ruvalcaba-Limon, evaruvalcaba@yahoo.com.mx] and [Pedro A. Sánchez-Méndez, pedro.sanchez@thermy.com.mx] if the researcher meets the criteria for access to confidential data.

    Funding

    This work was supported by the Social Responsibility Program of Avon Cosmetics S. de R.L. de C.V. [Cruzada Avon contra el Cáncer de Mama]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

    Copyright

    © The Author(s) 2023.

    References

    Meneses-García A, Ramírez T, Ruiz-Godoy L, Chiquete E, Mohar A. Cost of breast cancer treatment prior to the introduction of immune-based therapy in Mexico. Rev Med Inst Mex Seguro Soc. 2012;50:1924. [PubMed]
    Mammography machines [Internet]. Paris: Organization for Economic Cooperation and Development; c2019 [cited 2021 May 21]. Available from: https://data.oecd.org/healtheqt/mammography-machines.htm
    de Guadalupe Gómez Pérez M. Consejo mexicano de radiología e imagen, 40 aniversario. In: Entidades federativas actuales. Ciudad: Editorial Progreso; 2015.
    Heinze-Martin G, Olmedo-Canchola VH, Bazán-Miranda G, Bernand-Fuentes NA, Guízar-Miranda P. Los médicos especialistas en México. Gac Med Mex. 2018;154:34251. Spanish. [DOI] [PubMed]
    Clinical radiology UK workforce census 2020 report [Internet]. London: The Royal College of Radiologists; c2022 [cited 2021 Oct 11]. Available from: https://www.rcr.ac.uk/publication/clinical-radiology-uk-workforce-census-2020-report
    Garg T, Bajaj S, Dayan MJ, Makary MS, Smirniotopoulos JB, Silk M, et al. Temporal and geospatial variations among the interventional radiology physician workforce in the United States. Clin Imaging. 2021;78:1059. [DOI] [PubMed]
    CFR - code of federal regulations title 21 [Internet]. Maryland: U.S. Food & Drug Administration; c2021 [cited 2021 Jun 3]. Available from: https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfcfr/cfrsearch.cfm?fr=884.2980
    Yao X, Wei W, Li J, Wang L, Xu Z, Wan Y, et al. A comparison of mammography, ultrasonography, and far-infrared thermography with pathological results in screening and early diagnosis of breast cancer. Asian Biomed. 2014;8:119. [DOI]
    Sella T, Sklair-Levy M, Cohen M, Rozin M, Shapiro-Feinberg M, Allweis TM, et al. A novel functional infrared imaging system coupled with multiparametric computerised analysis for risk assessment of breast cancer. Eur Radiol. 2012;23:11918. [DOI] [PubMed]
    Keyserling JR, Ahlgren PD, Yu E, Belliveau N. Infrared imaging of the breast: initial reappraisal using high-resolution digital technology in 100 succesive cases of stage I and II breast cancer. Breast J. 1998;4:24551. [DOI] [PubMed]
    Guidelines for breast thermology [Internet]. Greenville: American Academy of Thermology; c2021 [cited 2021 Jul 9]. Available from: https://aathermology.org/wp-content/uploads/2018/04/AAT-Breast-Guidelines-2021v2.pdf
    Carmeliet P, Jain RK. Angiogenesis in cancer and other diseases. Nature. 2000;407:24957. [DOI] [PubMed]
    Kandlikar SG, Perez-Raya I, Raghupathi PA, Gonzalez-Hernandez JL, Dabydeen D, Medeiros L, et al. Infrared imaging technology for breast cancer detection–current status, protocols and new directions. Int J Heat Mass Transf. 2017;108:230320. [DOI]
    American College of Radiology. Breast imaging reporting and data system: BI-RADS Atlas. 5th ed. Reston, VA: American College of Radiology; 2013.
    Antonini S, Kolarić D, Herceg Ž, Ferenčić Ž, Kuliš T, Borojević N, et al. Simplified description and interpretation of pathological thermography signs in malignant breast lesions. Period Biol. 2011;113:42532.
    Pedraza RS, Raad JE. Aspectos sobre diseño y tamaño de muestra en estudios de prueba diagnóstica. Revista de la Facultad de Medicina: Universidad Nacional de Colombia. 2001;49:17580. Spanish.
    SISA. Fisher 2 by 5 [software]. 1997 [cited 2021 Oct 18]. Available from: https://www.quantitativeskills.com/sisa/statistics/fiveby2.htm
    Duffy S, Vulkan D, Cuckle H, Parmar D, Sheikh S, Smith E, et al. Annual mammographic screening to reduce breast cancer mortality in women from age 40 years: long-term follow-up of the UK Age RCT. Health Technol Assess. 2020;24:123. [DOI] [PMC]
    Uscanga-Sánchez S, Torres-Mejía G, Ángeles-Llerenas A, Domínguez-Malpica R, Lazcano-Ponce E. Breast cancer screening process indicators in Mexico: a case study. Salud Publica Mex. 2014;56:52837. Spanish. [PubMed]
    Ulloa-Pérez E, Mohar-Betancourt A, Reynoso-Noverón N. Estimation of the cost-effectiveness of breast cancer screening using mammography in Mexico through a simulation. Rev Invest Clin. 2016;68:18491. [PubMed]
    Brandan ME, Navarro YV. Detección del cáncer de mama: estado de la mamografía en México. Cancerología. 2006;1:14762. Spainish.
    Parisky YR, Sardi A, Hamm R, Hughes K, Esserman L, Rust S, et al. Efficacy of computerized infrared imaging analysis to evaluate mammographically suspicious lesions. AJR Am J Roentgenol. 2003;180:2639. [DOI] [PubMed]
    Arora N, Martins D, Ruggerio D, Tousimis E, Swistel AJ, Osborne MP, et al. Effectiveness of a noninvasive digital infrared thermal imaging system in the detection of breast cancer. Am J Surg. 2008;196:5236. [DOI] [PubMed]
    Gautherie M. Thermobiological assessment of benign and malignant breast diseases. Am J Obstet Gynecol. 1983;147:8619. [DOI] [PubMed]
    Villarreal-Garza C, Aguila C, Magallanes-Hoyos MC, Mohar A, Bargalló E, Meneses A, et al. Breast cancer in young women in Latin America: an unmet, growing burden. Oncologist. 2013;18:2634. [DOI] [PubMed]
    Sechopoulos I, Mann RM. Standalone artificial intelligence - the future of breast cancer screening? Breast. 2020;49:25460. [DOI] [PubMed] [PMC]
    Gogoi UR, Bhowmlk MK, Bhattacharjee D, Ghosh AK. Singular value based characterization and analysis of thermal patches for early breast abnormality detection. Australas Phys Eng Sci Med. 2018;41:86179. [DOI] [PubMed]
    Zuluaga-Gomez J, Al Masry Z, Benaggoune K, Meraghni S, Zerhouni N. A CNN-based methodology for breast cancer diagnosis using thermal images. Comput Methods Biomech Biomed Eng Imaging Vis. 2020;9:13145. [DOI]
    Visual Lab DMR [Internet]. Niterói: Database of mastologic images; c2021 [cited 2021 Nov 28]. Available from: https://visual.ic.uff.br/dmi/
    Bhowmik MK, Gogoi UR, Majumdar G, Bhattacharjee D, Datta D, Ghosh AK. Designing of ground-truth-annotated DBT-TU-JU breast thermogram database toward early abnormality prediction. IEEE J Biomed Health Inform. 2018;22:123849. [DOI] [PubMed]
    Singh D, Singh AK. Role of image thermography in early breast cancer detection - past, present and future. Comput Methods Programs Biomed. 2020;183:105074. [DOI] [PubMed]
    Hakim A, Awale RN. Thermal imaging - an emerging modality for breast cancer detection: a comprehensive review. J Med Syst. 2020;44:136. [DOI] [PubMed]
    Rassiwala M, Mathur P, Mathur R, Farid K, Shukla S, Gupta PK, et al. Evaluation of digital infra-red imaging as an adjunctive screening method for breast carcinoma: a pilot study. Int J Surg. 2014;12:143943. [DOI] [PubMed]
    Yamashita R, Nishio M, Do RKG, Togashi K. Convolutional neural networks: an overview and application in radiology. Insights Imaging. 2018;9:61129. [DOI] [PubMed] [PMC]