More and more American healthcare systems are implementing so-called “free” AI pilot programs. In theory, they are meant to improve efficiency — in practice, they often result in multimillion-dollar expenses and end in failure. Experts warn that without proper planning, reliable data, and accountability, even the most advanced algorithms bring little real-world value — and, above all, are not cost-effective.
U.S. hospitals are increasingly accepting offers for pilot deployments of generative AI systems that analyze medical data, support documentation, or assist in diagnosis. Tech companies promoting these pilots advertise them as free, but the hidden costs — in resources, integration, and staff time — are often surprisingly high. According to a report by researchers at Stanford University, such implementations can cost over $200,000, and the tested systems often never make it into clinical use.
The problem, however, lies not in the technology itself, but in the lack of clearly defined goals. A report from NANDA, developed in collaboration with the Massachusetts Institute of Technology (MIT), shows that as many as 95% of AI pilots in healthcare fail — not because the algorithms don’t work, but because the projects lack specific success criteria. In many cases, they simply test “how AI performs” without analyzing whether it actually solves a real clinical problem or improves existing workflows.
Experts emphasize that successful AI implementation in medicine requires three kinds of discipline:
- Design discipline – clearly defining the purpose and point of application;
- Evaluation discipline – establishing measurable success metrics (e.g., reducing documentation time);
- Partnership discipline – choosing a vendor who understands clinical realities and is accountable for results.
Ignoring any of these principles often leads to situations where a supposedly “free” pilot ends up generating extra costs and staff frustration.
It’s also worth noting that many institutions still test generative AI in isolated pilot projects instead of integrating it with existing systems. This results in fragmented data and inconsistent outcomes. Without full system integration — and without adhering to the three pillars above — test results are unlikely to be positive, as both time and staff involvement are far more expensive than they might appear at first glance.