On the possibilities and limitations of LLM-based multi-agent systems for multi-criteria decision-making in healthcare operations management
Provides methodological framework for evaluating LLM-based decision support systems in critical healthcare applications.
AI Summary
Researchers propose a framework to assess reliability of LLM-generated preferences for healthcare optimization, finding significant uncertainty in multi-agent decision-making systems.
Excerpt
Multi-criteria models for healthcare operations need weights that express how stakeholders trade off patient waiting time, provider workload, and operating cost, but these weights are difficult to quantify. Teams of large language model (LLM) agents, each prompted to represent a stakeholder, have been used to supply them. We propose a framework for assessing the reliability of LLM-generated preferences as inputs to multi-objective optimization and quantifying how their uncertainty affects decisi