Generative AI Will Expose Healthcares Ugly Identity Crisis
How generative AI in healthcare is helping cut admin burden
Double-checking AI’s results is key, he says, as is being able to match the options it provides with a patient’s actual symptoms and history. “AI isn’t good at problem-solving, which is one of the toughest parts of medicine,” Schwartzstein notes. Generative artificial intelligence is gaining traction as one of the most transformational technologies of our time by tackling some of humanity’s most challenging problems, augmenting human performance and maximizing productivity.
AHA does not claim ownership of any content, including content incorporated by permission into AHA produced materials, created by any third party and cannot grant permission to use, distribute or otherwise reproduce such third party content. Some states have laws and ethical rules regarding solicitation and advertisement practices by attorneys and/or other professionals. The National Law Review is not a law firm nor is intended to be a referral service for attorneys and/or other professionals.
By using solutions like Cohere Classify and Cohere Rerank they have developed an interactive interface based on natural language processing to provide users with infectious disease intelligence fast. Medical data analysis is a cornerstone of modern healthcare, and generative AI has the potential to revolutionize this field. By analyzing large datasets, generative AI can identify patterns and trends that may not be apparent to human analysts, providing valuable insights that can improve patient care and outcomes. AI now gives medicine students and professionals access to practical training, which was previously available only on-site at the hospital, including the operating room. By participating in AI-powered training and treatment simulations, healthcare professionals can practice new skills and gain access to knowledge in an interactive, engaging setting.
For example, AI-backed drug discovery supports the approval of customized cancer therapies that target undruggable mutations. Some firms can use generative AI to uncover compounds that mitigate the progression of different diseases. While AI can assist with healthcare tasks, ultimate responsibility for patient care and decision-making lies with healthcare professionals, necessitating physician oversight.
Clinical diagnosis assistance
“Our thesis has been the more administrative burden we remove, the higher the quality and the higher experience the care will be.” Dr. Heather Bassett is the Chief Medical Officer with Xsolis, the AI-driven health technology company with a human-centered approach. With more than 20 years experience in healthcare, Dr. Bassett provides oversight of Xsolis’ data science team, denials management team and its physician advisor program. Gen AI can support healthcare professionals, allowing them to focus more on people, not paperwork.
At IMO Health, we’re actively seeking to enhance the integration of healthcare provider data with payer systems, specifically targeting the life sciences sector. Our approach includes mining data for clinically relevant information, while ensuring compliance through diligent internal review processes. With the widespread usage of tools like ChatGPT and Copilot, it’s clear that generative AI is here to stay – and the healthcare sector is experimenting with its potential. Generative AI is a type of artificial intelligence capable of creating new, unique content by learning from data.
In terms of functionality, AI models can use these learning approaches to engage in ‘computer vision,’ a process for deriving information from images and videos; ‘natural language processing’ to derive insights from text; and ‘generative AI’ to create content. The passage of AB 3030, along with other recent AI laws out of California,[1] clearly signals California legislators’ focus on AI transparency as a necessary industry standard. These regulations coincide with the American Medical Association’s (“AMA”) Principles for Augmented Intelligence Development, Deployment, and Use, which identified transparency as a priority in the implementation of AI tools in healthcare. California’s approach also broadly follows the White House’s Blueprint for an AI Bill of Rights, which states that people have a right to know when and how automated systems are being used in ways that impact their lives.
MONAI, an open-source AI framework designed for medical imaging analysis and diagnostics, will provide powerful tools and resources to help clinicians and researchers develop efficient AI models, speeding up the diagnostic process. Holoscan will be a platform for real-time data processing from various medical devices, enabling instant data analysis that assists in surgical navigation and monitoring. The seminar will explore how MONAI and Holoscan will combine to improve the overall performance of digital surgeries, reducing risks and increasing success rates to improve patient outcomes. A. Generative AI and healthcare are intersecting to pioneer new frontiers in personalized treatment and medical innovation. It can be utilized to generate synthetic medical images for training AI algorithms, augmenting limited datasets and improving the accuracy of diagnostic models.
We interviewed Rao to discuss responsible AI, how responsible AI should be applied in healthcare, how to combine responsible AI specifically with generative AI, and what society must understand about adopting responsible AI. Technology leaders, for example, are partnering with the Cancer AI Alliance to step into this future now and transform cancer research using AI. This vision of the future is not a distant aspiration—it’s a tangible goal we’re working toward that relies on both technology and human expertise, each amplifying the other’s strengths, to create a healthier world for all. However, some health systems are already anticipating these AI adoption challenges and working to tackle them early on. Dunbrack predicted that health systems will likely prioritize the development of fair, unbiased and transparent AI algorithms as they navigate potential shifts in regulation. Vickers cautioned that though such regulatory relaxation could encourage innovation, it could also pose risks if new AI tools are adopted too quickly as a result.
While AI dominates headlines for its breakthroughs in creative fields and business automation, its potential to reshape healthcare is still emerging. Clinical Quality Language (CQL), for example, offers a potential area for AI transformation. Like all AI, generative models produce content based on previously captured data from past behaviors.
These tools combine NLP analysis with rules from the output language, like syntax, lexicons, semantics, and morphology, to choose how to appropriately phrase a response when prompted. Currently, all AI models are considered narrow or weak AI, tools designed to perform specific tasks within certain parameters. Artificial general intelligence (AGI), or strong AI, is a theoretical system under which an AI model could be applied to any task. One of the report’s key findings makes a direct correlation between GenAI spending and return on investment. In the past 12 months, healthcare firms invested an average of $2.7 million in GenAI, but firms reporting the highest ROI significantly outspent others, investing around $6.4 million on average.
Generative AI in healthcare: Q&A with IMO Health CTO Chuck Levecke
For example, physicians may be disciplined by the California Medical Board or Osteopathic Medical Board. Educating the public and the caregivers on the negative consequences of generative AI is essential to ensure the responsible useof generative AI. As a result, responsible AI for generative AI must consider more extensive governance and oversight as well as rigorous testing under different contexts. A. When it comes to generative AI, it brings in more powerful and complex technology that can potentially cause more harm than traditional AI. In March 2024, HMS announced thirty-three recipients of the Dean’s Innovation Awards for the Use of Artificial Intelligence in Education, Research, and Administration. “We need people at the table who are always evaluating data for bias and bringing another lens,” she said.
Mechanisms to incorporate healthcare professionals’ expertise into the model development process can significantly improve the relevance and accuracy of generated outputs. Let’s explore some other challenges that this disruptive technology poses along with potential solutions that healthcare organizations can leverage to drive the Generative AI impact in their business. Virtual patient models are a prominent use case of Generative AI in healthcare, allowing for immersive medical training and simulation experiences that enable healthcare professionals to practice complex procedures in a risk-free environment. Generative AI for healthcare automates administrative duties such as scheduling, billing, and inventory management, allowing healthcare professionals to focus on patient care. The healthcare industry usually faces challenges such as chronic disease management, escalating healthcare costs, regulatory compliance issues, and staffing shortages.
By retrieving information specific to certain subpopulations, the model could analyze a patient’s condition from multiple perspectives, potentially reducing the risk of bias contained in the generated content. For instance, when targeting different gender groups, RAG could retrieve research findings on their specific physiological patterns, common disease spectra, clinical manifestations, as well as related recommendations on clinical practice21,22,23. Similarly, for different ethnic groups, RAG enables access to research reports involving their genetic, environmental, and lifestyle factors, to understand differences in disease incidence rates and unique symptom presentations24. Furthermore, for other specific subpopulations (such as different age groups, socioeconomic statuses, etc.), RAG can retrieve tailored medical evidence to help comprehensively understand their unique health needs25. Although there remain challenges in ensuring access to high-quality data for underrepresented groups, RAG offers possible solutions to mitigate these issues. The intervention, which included a lecture and an assignment, integrated ChatGPT v. 3.5, an AI-driven tool, into the fieldwork seminar course curriculum to assist students in generating diverse intervention strategies.
Trump cancels Biden executive order on AI safety – Fierce Biotech
Trump cancels Biden executive order on AI safety.
Posted: Tue, 21 Jan 2025 19:45:00 GMT [source]
Identifying the path to value for the adoption of any tool is crucial, but the rapidly evolving landscape of AI makes this difficult in the healthcare industry, leading many organizations to hesitate. Healthcare providers are already exploring similar approaches across a wide variety of clinical review and synthesis use cases, including automated clinical coding, guideline summarization and personalization of care information. As these tools get deployed across healthcare, MacTaggart said, it’s important to keep in mind that organizations should provide the right care at the right time with the right providers, modalities and appropriate use of algorithms. Heisey-Grove said the industry needs to start asking questions and demanding more transparency.
However, in reality, these patients generally have different disease progression and prognoses due to differences in their biomarkers (e.g., DNA, RNA, proteins, metabolites, host cells, and microbiomes)44. Although collecting and protecting such sensitive data remains a challenge, RAG could better leverage this information for precision medicine practices. Specifically, the RAG system may be able to comprehensively analyze a patient’s biomarkers, classify them into more granular subgroups, and recommend appropriate personalized treatment plans to physicians based on established clinical guidelines.
Monitor the performance of the integrated Generative AI application continuously and keep improving based on the feedback received from users. Visit inizioevoke.com as we continue to explore how these innovations empower our teams – and our clients – to lead in an ever-evolving industry. A leader in generative AI antibody discovery
, Absci Corporation, has entered into a partnership with AstraZeneca to develop an AI-designed antibody to treat cancer. By joining forces, the two companies hope to speed up the process of developing a drug that would aid in treating cancer sufferers. A state study from mid-2023 reports that 95%
of ElliQ users agree it reduces feelings of isolation and acts as a mood booster. The hand is connected to a person’s nerves and bones, with AI translating signals into hand movements.
Health disparities present additional challenges to marginalized groups in accessing medical resources and health services, potentially hindering the achievement of fairness. Although generative AI models are trained on extensive data, the pre-training data itself exhibits imbalances in representing different groups. For example, 92.64% of the pre-training corpus of GPT-3 is derived from English sources, resulting in limited coverage of communities that use other languages1. This skewness could make it challenging to meet the medical needs of underrepresented groups. Despite the excitement around genAI, healthcare stakeholders should be aware that generative AI can exhibit bias, like other advanced analytics tools. Additionally, genAI models can ‘hallucinate’ by perceiving patterns that are imperceptible to humans or nonexistent, leading the tools to generate nonsensical, inaccurate, or false outputs.
Data analysis
The hype around these tools has put pressure on stakeholders to adopt AI while ensuring a clear return on investment (ROI), which creates unique challenges for healthcare stakeholders. MacTaggart pointed out that while healthcare organizations need good data for successful AI, they need a solid infrastructure to support data. Department of Health and Human Services, described generative AI as a tool set that potentially could be applied to a variety of public health system challenges. While there’s been a movement to press forward with utilization, there hasn’t been an intentional approach to govern the technology, according to States.
These approaches to pattern recognition make ML particularly useful in healthcare applications like medical imaging and clinical decision support. Looking to the future, Dr. Elton believes that large multimodal models will be more effective because they can diagnose multiple conditions and act as a backup or second reader for medical images. He envisions a shift away from numerous single-purpose models toward more comprehensive multimodal systems, which could enhance diagnostic capabilities and streamline processes in healthcare. Generative AI technology presents exciting opportunities for healthcare organizations to communicate more effectively with patients and build loyalty.
Healthcare leaders IQVIA, Illumina and Mayo Clinic, as well as Arc Institute, are using the latest NVIDIA technologies to develop solutions that will help advance human health. J.P. Morgan Healthcare Conference—NVIDIA today announced new partnerships to transform the $10 trillion healthcare and life sciences industry by accelerating drug discovery, enhancing genomic research and pioneering advanced healthcare services with agentic and generative AI. She pointed to a recent investigative series called “Embedded Bias” in STAT News that detailed how race-based algorithms are already widely used throughout the health care delivery system and why it’s so difficult to change them. This emerging era of healthcare powered by generative AI promises more than just improvements to existing processes. It offers the potential to fundamentally reimagine our approach to health, shifting our focus from treating illness to fostering wellness.
- “Everybody wanted to jump in [to the AI space] because they saw the promise, and they wondered, ‘How do we apply that in healthcare?'” he explained.
- As healthcare organizations collect more and more digital health data, transforming that information to generate actionable insights has become crucial.
- We wanted to make sure people knew you cannot copy and paste patient health information into these tools unless this is a tool that has been reviewed and approved for that purpose by OSF.
- In today’s systems, clinicians are burdened not only with the pressure of delivering quality care but also with documenting, uploading, submitting and reading reports, as well as calling tech support when they run into issues.
- As the examples I’ve shared perfectly demonstrate, access to AI in healthcare has been heavily democratized.
Similar increases in user comfort and acceptance of AI tools have been reported in medical and nursing education following exposure education or nursing (15, 16). Value-based care has been an aspirational goal for healthcare systems, focusing on patient outcomes rather than procedural volume. Generative AI and CQL can enable real-time, data-driven care models that link care delivery directly to outcome-based reimbursement models. This integration allows healthcare providers to adopt personalized, outcome-focused care plans and ensures these plans are encoded in CQL to support reimbursement and reporting requirements seamlessly. Administrative tasks are a significant source of clinician burnout, with many providers spending more time on paperwork than on patient care. Generative AI, combined with CQL, has the potential to transform how healthcare organizations approach complex processes, such as prior authorizations, medical billing and claims review.
And so, we partnered with Microsoft on that because I wanted to teach people how to do prompt engineering, how to write a good prompt, which is at the core of all of this, right? We taught them to use Microsoft Copilot, and we did that by creating about 35 examples of good prompts that were tried and practiced, and then we developed an approach using Microsoft Power Apps to do crowdsourcing with that inside the organization. The other challenge we had was that with 24,000 mission partners, we had to raise the level of education, or level set the education, for everybody — from our patient transporters to surgeons. Another consideration is that although GenAI can be a powerful tool, it’s exactly only that—a tool. It’s only as powerful as the information and data it’s given, and if it’s built off of bias or flawed data, that’s what it will use as its baseline. Therefore, it’s the responsibility of those inputting and collecting the data to keep the system robust.
Multiple organizations, including Sanofi, Bayer, and Novartis, have taken this approach and launched AI assistants on their respective platforms. Develop specialized AI models tailored to healthcare administrative tasks, leveraging techniques such as natural language processing and knowledge representation. Invest in data preprocessing and feature engineering to enhance model performance on healthcare-specific datasets. Collaborate with healthcare organizations to identify and prioritize tasks that can benefit from AI automation. In the absence of specific research on OT students use of ChatGPT, this study highlights the potential of generative AI as a valuable tool in healthcare education, aligning with broader trends in AI adoption across various fields. While no prior studies have explored AI’s direct impact on OT intervention planning, the findings are consistent with research in related disciplines where AI has been shown to reduce cognitive load and improve clinical care (15).
Improving speed and safety of drug development
Some healthcare systems, for example, have started using AI to identify high-risk patients early and suggest preventive measures. When combined with CQL, these suggestions can be encoded into clinical workflows, ensuring they are actionable and interoperable across different systems. This not only promotes a proactive approach to patient care but also fosters stronger collaboration between providers and payers, enhancing trust and transparency. CQL is a standardized language that can express clinical knowledge and logic in a machine-readable format. Historically, CQL has been used by health IT systems to encode clinical guidelines and quality measures, ensuring consistent interpretation across various healthcare platforms.
Healthcare healthcare AI finds itself in 2025 pregnant with possibilities yet surrounded by pitfalls. —policymakers and healthcare leaders must set directives guiding not only what to do but also when to do it. Also, as reported by Stat News last year, at the testing of GPT-4 as a diagnostic assistant, physicians at Beth Israel Deaconess Medical Center in Boston noted that the model identified the incorrect diagnosis as its top suggestion two-thirds of the time. Research by the Deloitte Center for Health Solutions suggests that medical organizations are increasingly recognizing the benefits of Generative AI for Healthcare. The integration of digital twins and advanced AI technologies will allow organisations to optimise investments in customers, accounts, channels and content, driving differentiation and growth. Clinics can also upload their own videos to the app from external drives and via integrations with laparoscopic or surgical robot systems.
“We believe that gen AI and AI overall is transforming how healthcare professionals access and use information to make powerful decisions confidently,” Waters remarked. “Clinicians come to this field to make a difference in the lives of patients. Feeling confident in their decisions and not seeing technology as a barrier is critical as we look to the future.” “The most interesting thing is that we will be able to solve problems daily for our patients and improve our outcomes by giving people the right tools to make decisions,” explained Dr. Sam, Chief Medical Strategy Officer at Numan (UK). For example, in the UK most of the budget is spent on curative treatments, interventions or medicines but a minimal amount of the budget is spent on prevention, mental health or any other thing that contributes to the well-being,” added. Generative AI is considered the subset of AI (Artificial Intelligence) and unlocks fruitful opportunities in the drug recovery process.
To understand health AI, one must have a basic understanding of data analytics in healthcare. At its core, data analytics aims to extract useful information and insights from various data points or sources. In healthcare, information for analytics is typically collected from sources like electronic health records (EHRs), claims data, and peer-reviewed clinical research.
In this perspective, we analyze the possible contributions that RAG could bring to health care in equity, reliability, and personalization. Additionally, we discuss the current limitations and challenges of implementing RAG in medical scenarios. The online survey polled 100 United States-based physicians who work in large hospitals or health systems, see patients and are currently using one or more clinical decision support tools. The integration of generative AI and CQL is not a flashy revolution; it’s a strategic leap toward a more efficient, equitable healthcare system. While fully realizing this potential requires industry collaboration, careful planning and responsible implementation, the synergy between generative AI and CQL sets the stage for profound, long-term improvements in healthcare delivery. This isn’t just about technology—it’s about reshaping healthcare to serve patients, providers and payers in a fairer, more connected way.
Despite these potentially transformative applications, healthcare organizations must understand that generative AI will be only as good as the data it has been trained/fine-tuned upon. If the data is not prepared well or carries any kind of biases, the outcomes of the models will also reflect those problems, hitting the reputation of the business. With a gen AI-driven approach, teams could fine-tune models like GPT-4 vision and use them to study and generate reports from medical data, automating and accelerating the entire process for good. Yes, the idea is still fresh, but early experiments show it is a promising application of gen AI in healthcare. In fact, a study by JAMA Network found that AI-generated reports for chest radiographs had the same level of quality and accuracy as those produced by human radiologists. Organizations have been experimenting with predictive and computer vision algorithms for a while now, most notably to forecast the success of treatments and diagnose dangerous diseases earlier than humans.
For instance, less than 2% of medical research funding goes towards pregnancy, childbirth and female reproductive health. Among them, around 1.3 billion people are being forced deeper into poverty, or extreme poverty, by financially devastating payments for health services. I think I will use it to generate ideas for my school-based placement since I don’t have a lot of confidence in generating interventions for emotional regulation skills. Throughout this endeavor, the researchers documented their procedures and findings to maintain transparency and uphold the rigor of the qualitative analysis.
The only problem is our past behaviors are rooted in three major conflicts we are yet to reconcile – and the data shows we’ve been captured for a while now. The bill’s length (roughly one page) and relative anonymity (its passage did not receive much publicity from the governor or Legislature) make it an anomaly in California healthcare privacy law, one of the most extensive privacy frameworks in the country. However, this bill is one of 18 laws on generative AI that Governor Newsom signed into law in the month of September alone, making it one small part of a broader push to regulate AI in all relevant industries.
We did a very brief survey at the end of the education, asked them just a couple of questions, and we did have 80% of the organization complete this mandatory education. And one of the things we asked them was, ‘Did this help enhance your knowledge of the subject matter? Being able to diminish the documentation burden is probably one of the biggest ones for clinicians, but there are so many other use cases. You want to use that information, but because we’re a healthcare system, we have to protect patient health information at all costs.