A recent study published in JAMA Internal Medicine says that most of the ChatGPT’s responses about health related queries are 79% times more accurate and superior than general physicians. We can see how smart Artificial Intelligence (AI) has become. From the past year, AI has been proving itself useful in a number of tasks and is capable of understanding and communicating in normal human language. ChatGPT is one of the most important and advance models of AI which was released in 2022.
The author of the study, John W. Ayers, found out that use of AI, especially ChatGPT, can be very useful in healthcare. Physicians and healthcare workers are currently experiencing a burnout and with AI contributing in healthcare, it can answer questions of patients. To prove that ChatGPT is truly capable of that, the researchers conducted a study and asked ChatGPT the question a patient would ask physicians. Reddit was used for this study. They asked questions in a subreddit r/AskDocs with 474,000 members. The study was focused on getting answers from physicians as physicians could give better quality answers as compared to other healthcare workers.
ChatGPT also gave answers to the same questions which were asked in Reddit. ChatGPT’s responses were given to experts to evaluate. After the responses were gathered from both sources, they were given to experts without telling them which response was AI generated and which was human. 79% of the responses given ChatGPT were evaluated as better. The ratings given to physicians were just ‘acceptable’. 27% of the physicians answers were below ‘acceptable’. Only 3% of ChatGPT’s answers were below ‘acceptable’. ChatGPT’s answers were said to be more empathetic than physicians’ too.
Image: DIW-Aigen
Read next: OpenAI Comes Up With New CriticGPT Model That Finds Errors In ChatGPT’s Replies
The author of the study, John W. Ayers, found out that use of AI, especially ChatGPT, can be very useful in healthcare. Physicians and healthcare workers are currently experiencing a burnout and with AI contributing in healthcare, it can answer questions of patients. To prove that ChatGPT is truly capable of that, the researchers conducted a study and asked ChatGPT the question a patient would ask physicians. Reddit was used for this study. They asked questions in a subreddit r/AskDocs with 474,000 members. The study was focused on getting answers from physicians as physicians could give better quality answers as compared to other healthcare workers.
ChatGPT also gave answers to the same questions which were asked in Reddit. ChatGPT’s responses were given to experts to evaluate. After the responses were gathered from both sources, they were given to experts without telling them which response was AI generated and which was human. 79% of the responses given ChatGPT were evaluated as better. The ratings given to physicians were just ‘acceptable’. 27% of the physicians answers were below ‘acceptable’. Only 3% of ChatGPT’s answers were below ‘acceptable’. ChatGPT’s answers were said to be more empathetic than physicians’ too.
Read next: OpenAI Comes Up With New CriticGPT Model That Finds Errors In ChatGPT’s Replies
