Open Foundation Models in Healthcare: Challenges, Paradoxes, and Opportunities with GenAI Driven Personalized Prescription
cs.CL, cs.AI, cs.LG
Submitted: 2025-02-04
Updated: 2026-10-12
Comments: 21 pages, 4 figures
License: http://creativecommons.org/licenses/by/4.0/
The gist: In response to the success of proprietary Large Language Models (LLMs), there is a growing interest in developing open, non-proprietary LLMs and AI foundation models (AIFMs) for transparent use in
Terminology
Abstract
In response to the success of proprietary Large Language Models (LLMs), there is a growing interest in developing open, non-proprietary LLMs and AI foundation models (AIFMs) for transparent use in academic, scientific, and non-commercial applications. Open models have substantial potential to improve healthcare applications. In this paper, we provide a comprehensive survey and a taxonomy of state-of-the-art open LLMs and AIFMs for clinical tasks. In addition, we empirically evaluate open-weight LLMs on a personalized-prescription task and compare them with a proprietary model with and without Retrieval-Augmented Generation (RAG). Across 100 synthetic patient profiles, the open-weight models matched or exceeded the proprietary baseline on overall suitability accuracy without retrieval augmentation (0.810--0.850 versus 0.780), although the confidence intervals overlap; with retrieval augmentation, every model improved, and the ranking closed to within 0.04. Gains from RAG were field-dependent rather than uniform. To highlight the clinical relevance of LLM-driven personalized prescriptions, we also conduct a subjective evaluation in which two raters, blinded to model and condition, scored responses independently of each other. Their ratings did not follow the accuracy gains: retrieval raised overall suitability accuracy for every model while lowering the two-rater means for two of the four on all five dimensions. Finally, we outline the ethical implications and potential risks associated with the misuse of advanced LLMs and AIFMs, highlighting the importance of responsible and transparent deployment in healthcare contexts. Data and code used in the paper will be released upon publication.
Sources
- Language Models are Few-Shot Learners
- Sparks of Artificial General Intelligence: Early experiments with GPT-4
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
- Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting
- Revisiting Few-sample BERT Fine-tuning
- Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectives
- A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics
- On the Opportunities and Risks of Foundation Models
- Code Llama: Open Foundation Models for Code
- Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuning
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- Accelerating LLM Inference with Staged Speculative Decoding
- Training Data Leakage Analysis in Language Models
- Privacy Analysis of Deep Learning in the Wild: Membership Inference Attacks against Transfer Learning
- Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations
- Adversarial Attacks Against Medical Deep Learning Systems
- Generalizability vs. Robustness: Adversarial Examples for Medical Imaging
- Large Language Models Encode Clinical Knowledge
- VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence
- LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering