Health IT
PANEL DISCUSSION: Global perspective on using IT to measure and improve quality and safety
Started by Andrew Kanter, MD MPH on 26 Sep 2010
Last edited by Robert Szypko on 02 Aug 2011
Medinfo 2010 was held in Cape Town, South Africa from September 12-15, 2010. It was very well attended with representation from many countries, particularly from Africa. It was an excellent opportunity to bring the world of health informatics to the continent of Africa. A lot of exciting informatics activities have been brewing in Africa and in Global South countries for the past several years. It is particularly appropriate that Medinfo should come to Africa at the 10 year anniversary of UN promise on the Millennium Development Goals. The American Medical Informatics Association annual meeting will be held in Washington, DC from November 13-17, 2010. This close approximation of these two important meetings provides an opportunity to build upon the momentum begun before Cape Town to achieve an inclusive global informatics effort, particularly to serve those in resource-poor settings.
This discussion panel will be on the global perspectives on the role of health informatics on improving quality and safety. It will take place formally between September 27th and October 8th. It will take place simultaneously here and at http://grou.ps/medinfo2amia2010/talks/4047835 and atWe are grateful to have three panelists who will be online to facilitate the discussion. The panel will consist of the following:
Andrew S. Kanter, MD MPH- Moderator. Director of Health Information Systems/Medical Informatics for the Millennium Villages Project at the Earth Institute, Columbia University and Assistant Professor of Clinical Biomedical Informatics and Clinical Epidemiology at the Earth Institute.
David W. Bates, MD MSc- Panelist. Chief, Division of General Internal Medicine, Brigham and Women's Hospital, Boston. Professor of Medicine, Harvard Medical School, Professor of Health Policy and Management at the Harvard School of Public Health and Director of the Center for Patient Safety, Research and Practice at Brigham and Women's Hospital and Harvard Medical School.
Jean Marie Rodrigues, MD - Panelist. Founding Chair of the Department of Public Health and Medical Informatics at the University of Saint Etienne Hospital, France. WHO Collaborating Center for International Classifications in French Language, Paris, France, and WHO collaborator for International Classification of Diseases, 11th Edition (ICD 11) and International Classification of Patient Safety (ICPS).
Dean Sitting, PhD - Panelist. Professor, School of Biomedical Informatics, The University of Texas Health Science Center at Houston. Member University of Texas, Houston-Memorial Hermann Center for Healthcare Quality and Safety.
Discussion Topic:
What is the role of international health informatics in improving quality and safety, particularly in low-resource settings?
As director of a program to implement health information systems in rural Africa, as part of an overall, integrated development effort to lift villages out of poverty and help countries achieve the Millennium Development Goals, this is a particularly important topic for me. We are implementing an open source stack of applications called the Millennium Global Village-Network (MGV-Net) which includes both the mobile device, RapidSMS-based system known as ChildCount+ and the electronic medical record framework known as OpenMRS. We believe that providing Information and Communication Technology (ICT) at the point-of-care, can markedly improve our ability to monitor and evaluate health care delivery in the most disadvantaged of populations, while improving the quality of care of the patients and the quality of life of the providers. Including Community Health Workers (CHWs), Nurses, Clinical Officers as well as Doctors in our health information systems offers the opportunity to effect positive changes where they are needed most (while at the same time providing more timely and accurate information to program administrators and Ministries of Health for planning purposes). Africa and other similar environments provide both challenges and opportunities. Most of these are beyond the scope of this discussion, but in particular, I wonder if the panel would provide some initial thoughts, and answers to some questions to get the discussion going.
1. What are the most important areas for newly innovating health systems to focus on to ensure quality of care and patient safety, particularly as applied to the Global South?
2. What special considerations are needed when taking Quality/Safety lessons from existing health information systems and applying them in these settings?
3. How do we ensure scalability and sustainability of Quality/Safety-focused systems when dealing with resource-poor settings?
Come back tomorrow for the beginning of the discussion!
Keywords: Conferences & Meetings health care in low resource settings health information technology Health Systems Strengthening & Service Quality Monitoring & Evaluation Safety

Neelam Adhikari
Looking forwaed to it.
Neelam
--
Neelam Adhikari MD
Rector
Patan Academy of Health Sciences
P.O.Box#26500
Kathmandu,Nepal
Tel: +977-1-5545112
Cell: 98510-53122
Fax: +977-1-5545114
Office secretory: Sushila Rai
Tel:+977-1-5545112
Web: www.pahs.edu.np
1:14 AM, 27 Sep 2010 | Permalink
Andrew Kanter, MD MPH
I will now provide some introductory thoughts from our panelists, which will be followed by their responses to the first questions I posed. Please follow along and contribute questions or comments!
expand commentDavid Bates, MD MSc:
Information technology has tremendous potential to improve safety in healthcare from a number of perspectives, but this potential is just now beginning to be realized. Not surprisingly, many of the presentations at Medinfo in Cape Town related to this. Among the areas that appeared to receive a lot of attention were computer order entry; surveillance for adverse events, especially adverse drug events and health-care associated infections; and discussion of medication-related decision support. One exciting development was the presentation of the ICPS, the International Classification of Patient Safety, which has been developed by the World Alliance for Patient Safety of the World Health Organization. There was also a continuing focus on the unintended consequences of information technology, some of which have safety implications.
Other areas which should perhaps receive more attention in the future include evaluation of the impact of clinical data exchange on patient safety, using IT to routinely measure the frequency of adverse events beyond adverse drug events and infections, the use of national ...
7:58 AM, 27 Sep 2010 | Permalink
Andrew Kanter, MD MPH
Dean F. Sittig, Ph.D.
expand commentProfessor, School of Biomedical Informatics , The University of Texas Health Science Center at Houston
Member, University of Texas, Houston-Memorial Hermann Center for Healthcare Quality and Safety
My research interests center on the design, development, implementation, and evaluation of all aspects of clinical information systems. In addition to my work on measuring the impact of clinical information systems on a large scale, I am also working to improve our understanding of both the factors that lead to success, as well as, the unintended consequences associated with computer-based clinical decision support and provider order entry systems.
As I get older, I am beginning to realize that many of the difficulties we have had, and continue to have, in implementing and moving health information technology (HIT) projects from the “prototype” stage into the routine healthcare delivery process is due to the paucity of theoretical or conceptual models that could help us understand the complex socio-technical interactions between the hardware, software, people, and processes involved.
Towards that end, we have developed a new, 8-dimension, socio-technical model of safe and effective health information technology implementation and use. The 8 dimensions are not independent, sequential, or hierarchical, but rather are interdependent ...
7:59 AM, 27 Sep 2010 | Permalink
Andrew Kanter, MD MPH
Dr. Jean Marie Rodrigues: Preliminary thoughts on the three questions:
1. What are the most important areas for newly innovating health systems to focus on to ensure quality of care and patient safety, particularly as applied to the Global South?
This question need to be answered to identify first the most important
goals of the health care systems of this countries which are not necessarly
the same as for more developed countries. for instance is the access equity
or the access itself of the population an important goal compare to insure
patient care quality and safety?
2. What special considerations are needed when taking Quality/Safety lessons from existing health information systems and applying them in these settings?
The main lesson is that we have to extract the most efficient process for
these countries and probably not all of them.
3. How do we ensure scalability and sustainability of Quality/Safety-focused systems when dealing with resource-poor settings?
It is probably a world community responsibility to help these countries
for sustainability and to follow their opinion for scalability with caution.
8:05 AM, 27 Sep 2010 | Permalink
A/Prof. Terry HANNAN
All, thse comments by David are very relevant to where I am located at the moment in the Department of Pediatric Hematology and Oncology in Modena Italy. Last week i found on the WHO site a classification for functionality that has important relevance to assessing the functionality of children (all ages) post pre-term birth and chemotherapy. The deparment here wants to provide some measure of outcomes based not on survival alone. I hope this si a suitable contribution to this discussion. Terry Hannan
expand commentICF CHECKLIST-(from WHO)
(International Classification of Functioning, Disability and Health)
Version 2.1a, Clinician Form:
http://apps.who.int/classifications/icfbrowser/Default.aspx [Select Children's and Youth version from Language/Version box.
Dr Terry J. Hannan MBBS;FRACP;FACHI;FACMI
Consultant Physician
Clinical Associate Professor School of Human Health Sciences, University of Tasmania
Department of Medicine, Launceston General Hospital Charles Street Launceston 7250
President Australasian College of Health Informatics(2007-9)
Visiting Professor Universita Degli Studi, Dr Modena e Reggio Emelia, Italy. Sep-Nov 2010
Ph. +61 3 6348 7578
Mob. 0417 144 881
Fax + 61 3 6348 7577
Email
CONFIDENTIALITY NOTICE AND DISCLAIMER
The information in this transmission may be ...
8:13 AM, 27 Sep 2010 | Permalink
A/Prof. Terry HANNAN
Dean, the following comment caught my eye.
expand comment"I am beginning to realize that many of the difficulties we have had, and continue to have, in implementing and moving health information technology (HIT) projects from the "prototype" stage into the routine healthcare delivery process is due to the paucity of theoretical or conceptual models that could help us understand the complex socio-technical interactions between the hardware, software, people, and processes involved."
Has not this been done in industry at all levels? This begs the question does health care delivery have additional more complex less understood socio-technical issues than "industries"? As Warner Slack has indicated, "Medicine is not a business. Our business is clinical medicine."
Dr Terry J. Hannan MBBS;FRACP;FACHI;FACMI
Consultant Physician
Clinical Associate Professor School of Human Health Sciences, University of Tasmania
Department of Medicine, Launceston General Hospital Charles Street Launceston 7250
President Australasian College of Health Informatics(2007-9)
Visiting Professor Universita Degli Studi, Dr Modena e Reggio Emelia, Italy. Sep-Nov 2010
Ph. +61 3 6348 7578
Mob. 0417 144 881
Fax + 61 3 6348 7577
Email
CONFIDENTIALITY NOTICE AND DISCLAIMER
The information in this transmission may be confidential and/or protected ...
8:22 AM, 27 Sep 2010 | Permalink
Om Goeckermann
Is there a published resource discussing the 8 Dimensional Model?
om
1:59 PM, 27 Sep 2010 | Permalink
Andrew Kanter, MD MPH
Reply from Dean Sittig:
There is: Dean F. Sittig, PhD; Hardeep Singh, MD, MPH. Eight Rights of Safe Electronic Health Record Use JAMA. 2009;302(10):1111-1113.
I'd be happy to send you a copy if you can't get one (dean.f.sittig at uth.tmc.edu). We have another more detailed paper coming out in Quality and Safety in Healthcare very soon. I'd send you a pre-print of that too if you wanted.
2:23 PM, 29 Sep 2010 | Permalink
Andrew Kanter, MD MPH
Another reply from Dean Sittig:
expand commentIn response to Terry Hannan who asked..."Has not this been done in industry at all levels? This begs the question does health care delivery have additional more complex less understood socio-technical issues than "industries"?
I don't know if it has more or less of these S-T issues, but I don't think we regularly think about all of them the way that others do. Take Apple for example, their Ipod, iPhone, iPad trifecta which is due as much to hardware and software as it is to content (think itunes and app stores), internal policies and procedures (think how they "police" all the apps that are available), and the User Interface. To think that anyone of these is more important than the others is wrong. Others have many of the same, but not all, the same features, functions, content etc. but it is the way that they put it all together that makes their greatness.
Likewise in informatics...we have developed many different systems, features, interventions with wildly different results and we don't really know why some systems work well in some organizations and poorly in others...remember Han et al's Unexpected ...
2:24 PM, 29 Sep 2010 | Permalink
Steven Wanyee Macharia
Andrew, I think the 8 dims are very apt but one thing that I have constantly grappled with working at various levels and interacting with actors playing different roles of services provision in healthcare is one of culture and attitude. It has been drummed over and over again that at the end of the day, positively influencing the entire continuum of health services provision on the value of health data/information is key and central to attaching a priceless value on data; everything else in terms of the structure and systems that support generation and use of health data/info can only follow that in that order. That is not to say or discount that there are obviously efforts that continue to function in parallel and the complexity of achieving that goal demands for that anyway. In Africa and specifically my home country Kenya for example, it is not a natural culture for us to associate the question "how do you know" for any statement, allegation or declaration made with a demand for objective evidence.The natural tendency is to associate that more with authority (the source in form of human being of that statement, allegation, declaration) - and not to ...
expand comment3:21 AM, 30 Sep 2010 | Permalink
A/Prof. Terry HANNAN
My response to Steven's valid statements are based on our initial experiences in Kenya (MMRS/AMPATH).
expand commentBill Tierney and I "sat in the dirt" (physically and metaphorically) with the local end-users for soem 18 months and initlally 'fitted the information' using the technologies and knowledge we had into their normal workflow patterns. It 'appeared' as if they were doing the same activities as normally except in e-format.
Then we provided them with 'outputs' that demonstrated that they could easily 'measure' what they do.
For example, with 2 years of clinic data they recorded 0% HIV/TB diagnoses over 63,000+ patient visits.
The 'cultural change' as indicated by Steven was that the clinic staff became interogative of the clinical data (i.e. the information management system chnaged their behaviour). Some outcomes of this change were;
>From 2 weeks ? 1 hour to produce monthly MOH reports (#1 among rural health centers)
Document drug use ? order refills earlier
Quantify amount of free care provided ? increased funding from the Kenyan MOH
MOH advisory committee recommended that the MMRS be used in all rural health centers
Noted a village with too few children being vaccinated ? nurse sent to intervene: vaccinate, educate
Noted a ...
5:22 AM, 30 Sep 2010 | Permalink
Steven Wanyee Macharia
I have a question to David Bates, is reduction of potential and/or actual risk posed to patients by HIT the same as using HIT to improve patient safety? do those two address the same thing?
11:03 AM, 30 Sep 2010 | Permalink
Andrew Kanter, MD MPH
Half way through the discussion on global informatics and patient safety and quality... Please check out the conversation here or on grou.ps!
8:47 PM, 3 Oct 2010 | Permalink
Andrew Kanter, MD MPH
Reply from David Bates:
Good question--they aren't the same thing in my view. HIT can affect safety overall, and can both prevent errors and harm, as well as raise the risk of harm. Some studies assess the net risk--that is to say, harm prevented less harm created. Many other recent studies have focused on harm created, or unintended consequences. When HIT is used to try to improve safety in an area, it makes sense to both measure the overall impact on safety, and also to assess the frequency of new problems created so these errors can be engineered out.
David Bates
9:27 AM, 5 Oct 2010 | Permalink
Andrew Kanter, MD MPH
David's answers to the three questions:
expand comment1. What are the most important areas for newly innovating health systems to focus on to ensure quality of care and patient safety, particularly as applied to the Global South?
I think that using low-cost solutions in creative ways is one of the top priorities. Many countries and organizations are delivering content and collecting data using cell phone technology, for example. It will also be possible to begin measuring data in much more routing ways. See also this paper we wrote on these issues, which has some good examples.
Evaluating eHealth: undertaking robust international cross-cultural eHealth research. (http://www.ncbi.nlm.nih.gov/pubmed/19753106)
Bates DW, Wright A.
PLoS Med. 2009 Sep;6(9):e1000105. Epub 2009 Sep 15. No abstract available. PMID: 19753106 [PubMed - indexed for MEDLINE]Free PMC ArticleFree text
2. What special considerations are needed when taking Quality/Safety lessons from existing health information systems and applying them in these settings?
One thing that is clearly important is designing simple interfaces that minimize the likelihood of error.
3. How do we ensure scalability and sustainability of Quality/Safety-focused systems when dealing with resource-poor settings?
This is a substantial challenge ...
9:31 AM, 5 Oct 2010 | Permalink
Leo Anthony Celi
Hi, everyone,
expand commentI represent Sana (previously Moca), a volunteer organization hosted at MIT. We
are in the process of developing a course on implementation and evaluation of
eHealth technologies. The initial course will be primarily didactic with a
strong emphasis on building information systems to facilitate the creation of a
culture of quality and safety in healthcare. Quality improvement concepts,
including the design of learning systems, application of industry tools such as
Lean Sigma, use of Plan-Do-Study-Act cycles for process optimization, Positive
Deviance, and systems approach to errors, among others, will be presented in the
context of ongoing eHealth projects. The course will be offered at MIT in 2011
and will be disseminated by the MIT Open Course Ware for free so that it can be
shared with healthcare organizations around the world. The subsequent iterations
of the course will be more project-oriented where the Boston-based students will
work with students from other countries incubating eHealth projects and under
the mentorship of faculty members from MIT, Harvard and Sana’s partner
universities, and local eHealth experts. Target students will come from
different disciplines to foster the same collaborative ecosystem that has worked
so well for our group.
We are looking ...
1:20 PM, 5 Oct 2010 | Permalink
Zach Landis Lewis
This looks like something we will want to take notes from.
1:23 PM, 5 Oct 2010 | Permalink
Zach Landis Lewis
Apologies for the earlier misdirected message. Thank you to everyone who has already contributed to this important discussion.
expand commentIn response to the first question: "1. What are the most important areas for newly innovating health systems to focus on to ensure quality of care and patient safety, particularly as applied to the Global South?" I would like to share a paper we recently published describing experiences implementing a point-of-care EMR in Malawi over the past eight years. From the paper:
"We believe that paper-based systems cannot work efficiently or accurately once large patient numbers are reached and that computerized systems are essential, a position supported by experienced practitioners in this field. Furthermore, we believe that the traditional approach to M&E where the M&E process exists as a separate layer or “wrapper” around the clinical process has several shortcomings. Recognizing that M&E data and patient care data are essentially one, we advocate an approach that tightly couples M&E and patient care processes, recording data once at the point-of-care (POC).
Here, we describe the rationale and experience of using a touchscreen electronic medical record (EMR) system at the POC to monitor and support ART scale-up in Malawi. The ...
1:58 PM, 5 Oct 2010 | Permalink
Jose Arindaeng, MD MPH
I read with interest the post about eHealth monitoring and evaluation. As an end user of various EMR programs, I've seen the limitation of some programs if used a tool for evaluation of quality measures.
3:16 PM, 5 Oct 2010 | Permalink
Jose Arindaeng, MD MPH
"This begs the question does health care delivery have additional more complex less understood socio-technical issues than "industries""
Unfortunately or fortunately (depending on which fence you sit)the answer is yes. The practice of medicine is premised on the virtue of compassion. Thus the business of economics were often neglected or added as an afterthought.
3:32 PM, 5 Oct 2010 | Permalink
A/Prof. Terry HANNAN
This is a very stimulating discussion. As an 'older' informatician who was guided by original workers in this field (B.Blum/W.Slack/H.Bleich/O.Barnett) and their proteges, Safran, Tierney, Bates, James, Pestotnik, and others we have confirmation that there is an "intimate" (deliberate use of this word) between what we do in direct patient care-make decsions and manage information - and the outcomes related to costs, quality, resource utilisation, etc. So if we can 'measure' these functions of decision support the cost measurements and economic consequences of care can be evaluated.[See concept dictionary ideas]. To add to this we already have evidence that through appropriate decsion support we can measure and improve care. Also these tools allow us to uncover what we did not know and expected which is that not all information management tools are effective. A good example of this is the recent commentary by David Bates on "hard hold" alerts for Adverse Drug Events. As these technologies evolve we will see new ideas and innovations as we uncover what we did not know but have assumed we did. A bit like evolution. In the end the most significant changes will be in the human-technological-information ...
4:00 PM, 5 Oct 2010 | Permalink
Om Goeckermann
The information management decisions made here also guide follow-on technologies.
We have seen how Frontline SMS is being used by the newly emerging Crisis mapping community and the move from Health IT to Politically relevant information use is not a 'leap'.
Health IT have had a big jumpstart and the refinements have been very interesting and almost 'magical' in terms of capability improvements.
On the flipside, hackers who have become interested in humanitarian efforts have made huge strides in recent months developing software that is Open Source and very intriguing.
Health IT might be able to leverage and inform this community to develop still more useful ways to provide and manage care.
One very important aspect that I still maintain, is that the Health community is most likely to provide a basis for building Standards for information exchange.
Ultimately, everything comes down to an individual, in a certain location.
This person needs something and has something to offer.
That is the basis for my work, and the discussion panels here have been a tremendous help. Thank you GHD for allocating resources to provide this innovative Health IT community a home.
Om
om
3:09 AM, 6 Oct 2010 | Permalink
Steven Wanyee Macharia
Zach, I agree with you that M&E data and patient care data are inevtiably tightly coupled and to extend to you statement, for me, its in the perspective of granularity of that data; you cannot get anymore granular than patient level data. M&E data s guided alot by well developed indicators, but the source of populating those indicators really is the patient level data. I have a very personal interest in M&E for EMRs having spent two lifetimes in both worlds of M&E and EMRs. We are currently developing an electronic M&E system for EMRs and will be glad to share our experience in anyone else interested in that area.
3:24 AM, 6 Oct 2010 | Permalink
Andrew Kanter, MD MPH
I think my question for the panel would follow-up on Zach, Steve and Jose's comments on using EMRs (patient-level data) for populating M&E and quality indicators. In Africa, there is no other data available most of the time. The paper-based systems are usually rarely used and the quality of the data which is not used at the point of care is very poor. Projects like OpenMRS which we use along with Community Health Worker systems like ChildCount+ (MGV-Net) try to make the data actionable locally... and then can be used for more programmatic and epidemiological functions.
In Uganda, all of the Millennium Village cluster encounters are entered into OpenMRS. We found that nearly 60% of patients who had negative tests for malaria were still be treated. When we instituted an intervention, the number of mistreatments went down by over 50% and we not only saved a substantial amount of money on inappropriate use of medications, but the patients presumably were treated with something that might have helped them. We could not have figured out the problem (fever -> test -> negative result -> treatment with Coartem) if we didn't have row-level data.
8:30 AM, 6 Oct 2010 | Permalink
Andrew Kanter, MD MPH
So my question is... how do we ensure that we can get this kind of data in resource-poor settings... other than the "8-fold path" described by Dean, in reality, what do we have to do to bring these kinds of patient safety and quality tools down to where they are needed most (a la Zach, Steven and Jose)?
8:57 AM, 7 Oct 2010 | Permalink
Andrew Kanter, MD MPH
Some comments from Dr. Rodrigues:
1) Applying to the global south solutions successful in the north needs some precautions
It is necessary to check that this will create more good than harm, and for this reason I would recommend insuring quality of care and patient safety by using a reporting procedure based on the Information model developed by WHO and unfortunately called ICPS (for International Classification of Patient Safety) rather than relying on the electronic patient record which is the optimal solution in developed countries.
2) Concerning scalability and sustainability, I would suggest as well to have simple goals... meaning that the overall ICPS information model which is adequately fulfilled by some national or infra national PS reporting systems shall be reviewed to produce a more simple model easier to install and to maintain.
3) Of course this shall not exclude the global south to develop more ambitious program of electronic patient records.
12:21 PM, 8 Oct 2010 | Permalink
Andrew Kanter, MD MPH
Thanks, everyone! This ends the formal discussion on this topic (global health informatics and patient safety/quality). I will try to summarize and post later, but if our panelists which to make a final statement, I would be happy to include them. Thank you to all contributors (and listeners).
10:16 AM, 10 Oct 2010 | Permalink
Hamish Fraser, MBChB, MRCP, MSc
I am a bit late to the discussion but have been following it with interest and with Andy’s permission I would like to add some thoughts. Several themes have come through for me in working on health information systems in developing countries over the last decade. Firstly successful projects are very much a result of addressing many key factors, it’s not just about software. Following Dean’s point on the 8 factors I focus on four general categories:
expand comment- Leadership support and buy-in. This includes identifying the most important goals and outputs that support improved quality of care, as well as other outputs in program management. Too often the goals of having an EMR are ill defined and driven more by documentation than the use the data is put to. Leadership also needs to set a policy framework and ensure the factors below are addressed.
- Infrastructure. This is clearly essential for electronic data management but can vary enormously even within a resource poor environment. Taking existing EMR projects, at one end you have AMPATH that used OpenMRS in one main site at Moi university, bringing in paper forms and sending them back with printed reports and patient summaries (but ...
12:00 PM, 10 Oct 2010 | Permalink
Jose Arindaeng, MD MPH
Great posts. I'm looking forward to Dr. Kanter's summary and report. I'm very anxious to see how we would design the programs and implement these in resource-poor environment.
2:50 AM, 20 Oct 2010 | Permalink