Table Info

Table 1.

The list of popular AI-based tools is divided into subcategories

Step	AI tool	Function	Reference(s)
Articles collecting	Semantic Scholar	Identifying the proper papers, extracting meaning, checking highly influential citations, and recommending the latest documents that may be of interest	[29, 30]
	Scite.ai	Identifying the most significant papers and demonstrating the connections between them	[30, 31]
	PICO Portal	Identifying the most relevant papers meeting specific PICO criteria	[35]
Literature analyzing	Genei	Condensing research papers, extracting the essential information	[37]
	ChatPDF	Extracting information from PDF files by answering the posed questions (e.g., primary outcomes from the study, conclusions, limitations)	[40, 41]
	Chatwithpdf		[40, 41]
	Perplexity AI	Answering the posed questions and providing resources	[30, 42]
	Elicit	Summarizing papers, finding themes and concepts across papers, extracting data, synthesizing the findings	[43]
Writing and refining a manuscript	Grammarly	Context-specific suggestions to help with proper grammar, punctuation, and spelling, style improvements	[48, 49]
	Trinka AI	Checking the word choice, usage, style, and grammar	[30, 48]
	QuillBot	Paraphrasing, grammar check, ensuring the appropriate vocabulary, tone, and style, text summarizing	[30, 50]
	Writefull	Text revision, language and tone check, paraphrasing, title and abstract generator	[30, 53]
	Wordtune	Paraphrasing, eliminating grammar, and spelling errors	[54, 55]
	Paperpal	Ensuring adherence to stringent quality standards (specialized in academic papers)	[30, 56]
	Jenni AI	Autocomplete in-text citations, comprehensive prompts generation, paraphrasing, paper refining, plagiarism check	[30]
Peer review	Penelope.ai	Paper evaluation, ensuring that manuscripts meet specific criteria, journal requirements	[30, 57]
	Copyleaks	Plagiarism detector across nearly every language, AI-generated content detection	[58]
	StatReviewer	Identifying methodological and statistical errors	[57]

AI: artificial intelligence; PICO: P—patients, I—intervention, C—comparison, O—outcomes

Declarations

Acknowledgments

The authors used ChatGPT and Grammarly for grammar and style corrections while preparing this work. SciteAI was utilized for the initial article search. MidJourney was used to generate graphics. After using the tool/service, authors reviewed and edited the content as needed and took full responsibility for the publication’s content.

Author contributions

MF: Conceptualization, Investigation, Writing—original draft, Writing—review & editing. MM: Conceptualization, Investigation, Writing—original draft, Writing—review & editing. AL, SM, MW, IA, LS, and MS: Writing—original draft. AZ: Validation, Writing—original draft, Writing—review & editing, Supervision. All authors read and approved the submitted version.

Conflicts of interest

Aleksandra Zielińska is the Editorial Board Member of Exploration of Digital Health Technologies, but she had no involvement in the peer-review of this article and had no access to information regarding its peer-review. The other authors declare that they have no conflicts of interest.

Ethical approval

Not applicable.

Consent to participate

Not applicable.

Consent to publication

Not applicable.

Availability of data and materials

Not applicable.

Funding

Not applicable.

Copyright

References

Jobin A, Ienca M, Vayena E. The global landscape of AI ethics guidelines. Nat Mach Intell. 2019;1:389–99. [DOI]

Jindal JA, Lungren MP, Shah NH. Ensuring useful adoption of generative artificial intelligence in healthcare. J Am Med Inform Assoc. 2024;31:1441–44. [DOI] [PubMed] [PMC]

Raman R, Lathabhai H, Diwakar S, Nedungadi P. Early Research Trends on ChatGPT: Insights from Altmetrics and Science Mapping Analysis. Int J Emerg Technol Learn. (IJET). 2023;18:13–31. [DOI]

Xu Y, Liu X, Cao X, Huang C, Liu E, Qian S, et al. Artificial intelligence: A powerful paradigm for scientific research. Innovation (Camb). 2021;2:100179. [DOI] [PubMed] [PMC]

Zhou Q, Chen Z, Cao Y, Peng S. Clinical impact and quality of randomized controlled trials involving interventions evaluating artificial intelligence prediction tools: a systematic review. NPJ Digit Med. 2021;4:154. [DOI] [PubMed] [PMC]

Lam TYT, Cheung MFK, Munro YL, Lim KM, Shung D, Sung JJY. Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review. J Med Internet Res. 2022;24:e37188. [DOI] [PubMed] [PMC]

Beam AL, Drazen JM, Kohane IS, Leong T, Manrai AK, Rubin EJ. Artificial Intelligence in Medicine. N Engl J Med. 2023;388:1220–1. [DOI] [PubMed]

Manrai AK, Beam AL, Kohane IS. What We Want to Publish at NEJM AI. NEJM AI. 2024;1:AIe2300304. [DOI]

Mahjour B, Hoffstadt J, Cernak T. Designing Chemical Reaction Arrays Using Phactor and ChatGPT. Org Process Res Dev. 2023;27:1510–6. [DOI]

10.

Hryciw BN, Seely AJE, Kyeremanteng K. Guiding principles and proposed classification system for the responsible adoption of artificial intelligence in scientific writing in medicine. Front Artif Intell. 2023;6:1283353. [DOI] [PubMed] [PMC]

11.

Feng X, Zhang H, Ren Y, Shang P, Zhu Y, Liang Y, et al. The Deep Learning-Based Recommender System "Pubmender" for Choosing a Biomedical Publication Venue: Development and Validation Study. J Med Internet Res. 2019;21:e12957. [DOI] [PubMed] [PMC]

12.

Doyal AS, Sender D, Nanda M, Serrano RA. ChatGPT and Artificial Intelligence in Medical Writing: Concerns and Ethical Considerations. Cureus. 2023;15:e43292. [DOI] [PubMed] [PMC]

13.

Khalifa M, Albadawy M. Using artificial intelligence in academic writing and research: An essential productivity tool. Computer Methods and Programs in Biomedicine Update. 2024;5:100145. [DOI]

14.

Futurepedia_3K+_AI_Tools_Dataset [Interna]. Los Angeles: kaggle.com. Available from: https://kaggle.com/datasets/shahriarrahman009/futureidea-ai-tools-dataset

15.

Zawacki-Richter O, Marín V I, Bond M, Gouverneur F. Systematic review of research on artificial intelligence applications in higher education-where are the educators? Int J Educ Technol High Educ. 2019;16:1–27. [DOI]

16.

Number of ChatGPT Users (Aug 2024) [Internet]. San Francisco: explodingtopics.com. Available from: https://explodingtopics.com/blog/chatgpt-users

17.

Pal S, Bhattacharya M, Islam MA, Chakraborty C. AI-enabled ChatGPT or LLM: a new algorithm is required for plagiarism-free scientific writing. Int J Surg. 2024;110:1329–30. [DOI] [PubMed] [PMC]

18.

Silva JATd. Linguistic precision, and declared use of ChatGPT, needed for radiology literature. Eur J Radiol. 2024;170:111212. [DOI] [PubMed]

19.

Carobene A, Padoan A, Cabitza F, Banfi G, Plebani M. Rising adoption of artificial intelligence in scientific publishing: evaluating the role, risks, and ethical implications in paper drafting and review process. Clin Chem Lab Med. 2023;62:835–43. [DOI] [PubMed]

20.

Aliyeva A, Sari E. Be or Not to Be With ChatGPT? Cureus. 2023;15:e48366. [DOI] [PubMed] [PMC]

21.

He S, Yang F, Zuo J, Lin Z. ChatGPT for scientific paper writing-promises and perils. Innovation (Camb). 2023;4:100524. [DOI] [PubMed] [PMC]

22.

Mohammad B, Supti T, Alzubaidi M, Shah H, Alam T, Shah Z, et al. The Pros and Cons of Using ChatGPT in Medical Education: A Scoping Review. Stud Health Technol Inform. 2023;305:644–7. [DOI] [PubMed]

23.

Kung TH, Cheatham M, Medenilla A, Sillos C, Leon LD, Elepaño C, et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023;2:e0000198. [DOI] [PubMed] [PMC]

24.

Kufel J, Paszkiewicz I, Bielówka M, Bartnikowska W, Janik M, Stencel M, et al. Will ChatGPT pass the Polish specialty exam in radiology and diagnostic imaging? Insights into strengths and limitations. Pol J Radiol. 2023;88:e430–4. [DOI] [PubMed] [PMC]

25.

Barbour AB, Barbour TA. A Radiation Oncology Board Exam of ChatGPT. Cureus. 2023;15:e44541. [DOI] [PubMed] [PMC]

26.

Madrid-García A, Rosales-Rosado Z, Freites-Nuñez D, Pérez-Sancristóbal I, Pato-Cour E, Plasencia-Rodríguez C, et al. Harnessing ChatGPT and GPT-4 for evaluating the rheumatology questions of the Spanish access exam to specialized medical training. Sci Rep. 2023;13:22129. [DOI] [PubMed] [PMC]

27.

Ganjavi C, Eppler MB, Pekcan A, Biedermann B, Abreu A, Collins GS, et al. Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis. BMJ. 2024;384:e077192. [DOI] [PubMed] [PMC]

28.

Akobeng AK. Principles of evidence based medicine. Arch Dis Child. 2005;90:837–40. [DOI] [PubMed] [PMC]

29.

Hannousse A. Searching relevant papers for software engineering secondary studies: Semantic Scholar coverage and identification role. IET Software. 2021;15:126–46. [DOI]

30.

Jhajj KS, Jindal P, Kaur K. Use of Artificial Intelligence Tools for Research by Medical Students: A Narrative Review. Cureus. 2024;16:e55367. [DOI] [PubMed] [PMC]

31.

Brody S. Scite. J Med Libr Assoc. 2021;109:707–10. [DOI] [PubMed] [PMC]

32.

Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Mak. 2007;7:16. [DOI] [PubMed] [PMC]

33.

Kebede MM, Cornet CL, Fortner RT. In-depth evaluation of machine learning methods for semi-automating article screening in a systematic review of mechanistic literature. Res Synth Methods. 2023;14:156–72. [DOI] [PubMed]

34.

Peng Y, Rousseau JF, Shortliffe EH, Weng C. AI-generated text may have a role in evidence-based medicine. Nat Med. 2023;29:1593–4. [DOI] [PubMed] [PMC]

35.

Joel TM, Oluwaseun E, Liza M, Brenlea F, Mark H, Jordyn F, et al. PICO Portal. J Can Health Libr Assoc J Assoc Bibl Santé Can. 2021:42:181–3. [DOI]

36.

Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5:210. [DOI] [PubMed] [PMC]

37.

Martin K. AI language models are transforming the medical writing space – like it or not! Med Writ. 2023;32:22–7. [DOI]

38.

Gao CA, Howard FM, Markov NS, Dyer EC, Ramesh S, Luo Y, et al. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. 2023;6:75. [DOI] [PubMed] [PMC]

39.

Zhavoronkov A. Caution with AI-generated content in biomedicine. Nat Med. 2023;29:532. [DOI] [PubMed]

40.

Helfrich-Schkarbanenko A. ChatWithPDF- & WebPilot-Plugin. In: Mathematik und ChatGPT. Berlin: Springer; 2023. PP. 247–57.

41.

Chubb L A. Me and the Machines: Possibilities and Pitfalls of Using Artificial Intelligence for Qualitative Data Analysis. Int J Qual Methods. 2023;22:1–16. [DOI]

42.

Fostikov A. First impressions on using AI powered chatbots, tools and search engines: ChatGPT, Perplexity and other – possibilities and usage problems. Review of the NCD. 2023;42:12–21. [DOI]

43.

Whitfield S, Hofmann MA. Elicit: AI literature review research assistant. Public Serv Q. 2023;19:201–7. [DOI]

44.

Dis EAMv, Bollen J, Zuidema W, Rooij Rv, Bockting CL. ChatGPT: five priorities for research. Nature. 2023;614:224–6. [DOI] [PubMed]

45.

Walters WH, Wilder EI. Fabrication and errors in the bibliographic citations generated by ChatGPT. Sci Rep. 2023;13:14045. [DOI] [PubMed] [PMC]

46.

Salvagno M, Taccone FS, Gerli AG. Can artificial intelligence help for scientific writing? Crit Care. 2023;27:75. [DOI] [PubMed] [PMC]

47.

Noorden RV, Perkel JM. AI and science: what 1,600 researchers think. Nature. 2023;621:672–5. [DOI] [PubMed]

48.

Petare PA. Artificial Intelligence Tools for Education: Exploring The New Horizons For Teaching Learning Process. In: Exploring new horizons: multidisciplinary perspectives in research. 1st ed. New Delhi: Unicorn Books; 2023. pp. 76–7.

49.

Ali GM, Fathia R. The role of Grammarly in assessing English as a Foreign Language (EFL) writing. Lingua Cult. 2018;12:395–403. [DOI]

50.

Amyatun RL, Kholis A. Can Artificial Intelligence (AI) like QuillBot AI Assist Students’ Writing Skills? Assisting Learning to Write Texts using AI. ELE Rev Engl Lang Educ Rev. 2023;3:135–54. [DOI]

51.

Nazari N, Shabbir MS, Setiawan R. Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial. Heliyon. 2021;7:e07014. [DOI] [PubMed] [PMC]

52.

Cavaleri M, Dianati S. You want me to check your grammar again? The usefulness of an online grammar checker as perceived by students. J Acad Lang Learn. 2016;10:A223–36.

53.

Gunter DW editor. Blockchain and Scholarly Publishing Industry: Current Use Cases—New Efficiencies in Scholarly Publishing. Harrisburg: IGI Global; 2021. pp. 284–93.

54.

Zhao X. Leveraging Artificial Intelligence (AI) Technology for English Writing: Introducing Wordtune as a Digital Writing Assistant for EFL Writers. RELC J. 2023;54:890–4. [DOI]

55.

Zhao X, Sbaffi L, Cox A. The Digitisation of Writing in Higher Education: Exploring the Use of Wordtune as an AI Writing Assistant. 2023. OSF preprint. [DOI]

56.

Pinzolits RFG. AI in academia: An overview of selected tools and their areas of application. MAP Educ Humanit. 2024;4:37–50. [DOI]

57.

Checco A, Bracciale L, Loreti P, Pinfield S, Bianchi G. AI-assisted peer review. Humanit Soc Sci Commun. 2021;8:25. [DOI]

58.

Knoedler S, Sofo G, Kern B, Frank K, Cotofana S, Isenburg Sv, et al. Modern Machiavelli? The illusion of ChatGPT-generated patient reviews in plastic and aesthetic surgery based on 9000 review classifications. J Plast Reconstr Aesthet Surg. 2024;88:99–108. [DOI] [PubMed]

59.

Gilbert FJ, Denison AR. Research misconduct. Clin Radiol. 2003;58:499–504. [DOI] [PubMed]

60.

Lee J, Le T, Chen J, Lee D. Do language models plagiarize? In: Ding Y, Tang J, Sequeda J, editors. WWW’23: The ACM Web Conference 2023; 2023 Apr 30–May 4; Austin, United States. New York: Association for Computing Machinery; 2023. pp. 3637–47.

61.

Higgins JR, Lin F, Evans JP. Plagiarism in submitted manuscripts: incidence, characteristics and optimization of screening-case study in a major specialty medical journal. Res Integr Peer Rev. 2016;1:13. [DOI] [PubMed] [PMC]

62.

Benaim EH, Wase S, Zaidi S, Monk A, Klatt-Cromwell C, Thorp BD, et al. Detection of plagiarism among rhinology scientific journals. Int Forum Allergy Rhinol. 2024. [DOI] [PubMed]

63.

Pan ET, Florian-Rodriguez M. Human vs machine: identifying ChatGPT-generated abstracts in Gynecology and Urogynecology. Am J Obstet Gynecol. 2024;231:276.e1–276.e10. [DOI] [PubMed]

64.

Yang W, Sun N, Song H. Analysis of the retraction papers in oncology field from Chinese scholars from 2013 to 2022. J Cancer Res Ther. 2024;20:592–8. [DOI] [PubMed]

65.

Singh A, Botros M, Guirguis P, Punreddy A, Mesfin A, Puvanesarajah V. Prevalence, Characteristics, and Trends in Retracted Spine Literature: 2000-2023. World Neurosurg. 2024;187:e313–20. [DOI] [PubMed]

66.

Punreddy A, Guirguis PG, Youssef M, Botros M. Current trends in retraction of plastic surgery and reconstruction research. J Plast Reconstr Aesthet Surg. 2024;93:136–9. [DOI] [PubMed]

67.

Bahadoran Z, Mirmiran P, Kashfi K, Ghasemi A. The Principles of Biomedical Scientific Writing: Citation. Int J Endocrinol Metab. 2020;18:e102622. [DOI] [PubMed] [PMC]

68.

Zuccon G, Koopman B, Shaik R. Chatgpt Hallucinates when Attributing Answers. In: Ai Q, Liu Y, Moffat A, Huang X, editors. Research and Development in Information Retrieval. SIGIR-AR’23: Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region; 2023 Nov 26–28; Beijing China. New York: Association for Computing Machinery; 2023. pp. 46–51.

69.

Hugenholtz PB, Quintais JP. Copyright and Artificial Creation: Does EU Copyright Law Protect AI-Assisted Output? IIC-Int Rev Intellect Prop Compet Law. 2021;52:1190–216. [DOI]

70.

Generative artificial intelligence and copyright law [Internet]. New York: Elsevier Inc. Available from: https://digitalcommons.unl.edu/scholcom/243/

71.

CUAJ E. Use of AI in medical publishing. Can Urol Assoc J. 2023;17:79–80. [DOI] [PubMed] [PMC]

72.

Conroy G. Scientific sleuths spot dishonest ChatGPT use in papers. Nature. 2023. [DOI] [PubMed]

73.

Prillaman M. ‘ChatGPT detector’ catches AI-generated papers with unprecedented accuracy. Nature. 2023. [DOI] [PubMed]

74.

Silva JATd. "Tortured phrases" in preprints. Curr Med Res Opin. 2023;39:785–7. [DOI] [PubMed]

75.

Else H. ‘Tortured phrases’ give away fabricated research papers. Nature. 2021;596:328–9. [DOI] [PubMed]

76.

Májovský M, Černý M, Kasal M, Komarc M, Netuka D. Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened. J Med Internet Res. 2023;25:e46924. [DOI] [PubMed] [PMC]

77.

Liverpool L. AI intensifies fight against ‘paper mills’ that churn out fake research. Nature. 2023;618:222–3. [DOI] [PubMed]

78.

Else H. ‘Papermill alarm’ software flags potentially fake papers. Nature. 2022. [DOI] [PubMed]

79.

Noorden RV. How big is science’s fake-paper problem? Nature. 2023;623:466–7. [DOI] [PubMed]

80.

Jones N. How to stop AI deepfakes from sinking society — and science. Nature. 2023;621:676–9. [DOI] [PubMed]

81.

Mangaokar N, Pu J, Bhattacharya P, Reddy CK, Viswanath B. Jekyll: Attacking Medical Image Diagnostics using Deep Generative Models. 2020 IEEE European Symposium on Security and Privacy (EuroS&P). 2020;139–57. [DOI]

82.

Schetinger V, Bartolomeo SD, El-Assady M, McNutt A, Miller M, Passos JPA, et al. Doom or Deliciousness: Challenges and Opportunities for Visualization in the Age of Generative Models. Comput Graph Forum. 2023;42:423–35. [DOI] [PubMed] [PMC]

83.

Hanna DM. The Use of Artificial Intelligence Art Generator “Midjourney” in Artistic and Advertising Creativity. J Des Sci Appl Arts. 2023;4:42–58. [DOI]

84.

Noorden RV. More than 10,000 research papers were retracted in 2023 — a new record. Nature. 2023;624:479–81. [DOI] [PubMed]

85.

Facing reality? law enforcement and the challenge of deepfakes : an observatory report from the Europol innovation lab [Internet]. Luxembourg: European Union. Available from: https://data.europa.eu/doi/10.2813/158794

86.

Krenn M, Buffoni L, Coutinho B, Eppel S, Foster JG, Gritsevskiy A, et al. Forecasting the future of artificial intelligence with machine learning-based link prediction in an exponentially growing knowledge network. Nat Mach Intell. 2023;5:1326–35. [DOI]

87.

Asan O, Bayrak AE, Choudhury A. Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians. J Med Internet Res. 2020;22:e15154. [DOI] [PubMed] [PMC]

88.

Chan KS, Zary N. Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review. JMIR Med Educ. 2019;5:e13930. [DOI] [PubMed] [PMC]

89.

Mekki YM, Zughaier SM. Teaching artificial intelligence in medicine. Nat Rev. Bioeng. 2024;2:450–1. [DOI]

90.

Conroy G. How ChatGPT and other AI tools could disrupt scientific publishing. Nature. 2023;622:234–6. [DOI] [PubMed]