Knowledge Management Processes to Support Evidence Based Practice in Healthcare – a Swedish Case Study

Tracking #: 719-1929

Authors: 
Hanife Rexhepi
Anne Persson

Responsible editor: 
Guest Editors EKAW 2014 Schlobach Janowicz

Submission type: 
Conference Style
Abstract: 
The primary and basic component of healthcare is information. When practitioners make decisions as well as treat and care for patients they interpret patient specific data based on evidence based medical knowledge. This process is complex as evidence is infrequently available in a form that can be acted upon at the time of care. Therefore the aim of this paper is to (1) explore how primary care, secondary care and municipality care in Sweden work with the process of managing knowledge, and (2) explore how practitioners experience access to medical knowledge. The results demonstrate major deficiencies in in the knowledge management (KM) process of the organizations. The KM process is not systematically reflected in the organizational culture, strategy or in practice, which causes major difficulties for practitioners to work according to evidence based medicine.
Full PDF Version: 
Tags: 
Reviewed

Decision/Status: 
[EKAW] reject

Solicited Reviews:
Click to Expand/Collapse
Review #1
Anonymous submitted on 07/Aug/2014
Suggestion:
[EKAW] conference only accept
Review Comment:

Overall evaluation
Select your choice from the options below and write its number below.

== 3 strong accept
== 2 accept
== 1 weak accept
== 0 borderline paper
== -1 weak reject
== -2 reject
== -3 strong reject
0

Reviewer's confidence
Select your choice from the options below and write its number below.

== 5 (expert)
== 4 (high)
== 3 (medium)
== 2 (low)
== 1 (none)
4

Interest to the Knowledge Engineering and Knowledge Management Community
Select your choice from the options below and write its number below.

== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor
4

Novelty
Select your choice from the options below and write its number below.

== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor
2

Technical quality
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor
4

Evaluation
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 not present
3

Clarity and presentation
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor
4

Review
Please provide your textual review here.

The work presents results of a case study among Swedish clinical practitioners (managers, physicians, nurses, nursing assistants) that maps the status of using knowledge management processes in their daily working agenda. The authors also analyse the collected results, point out the major strong / weak points and suggest a couple of remedies for identified sub-optimal practices.

The topic is definitely relevant to EKAW (albeit more in the `in use' context). The overall goal of the authors is very commendable and the case study methodology is sound and clearly described. The scale and representativeness of study also seem to be sufficient to draw valid conclusions. There are, however, several problems that make me feel like the text is appropriate for an in-use, or perhaps poster track of the conference, but not substantial enough for a journal article.

1. The methodology is OK, but it'd be interesting to learn more details about the questionnaires and about how the answers were exactly evaluated (how were the questions defined (pre-defined fields, scales, free text, combination of more, ...), how were the answers quantified, what was the local and/or statistical distribution of certain specific answers, were there any significant surprising correlations among the results, etc.).

2. The results and suggestions for remedy of the sub-optimal practices are rather vague and obvious. Especially in case of remedy suggestions, it is hard to see how they can be measurably applied in practice no matter how much sense they intuitively make. Adding that, the study would be much more beneficial. The results don't bring anything surprising - the bottom line seems to be that people are often too busy and/or poorly motivated to participate in an organised knowledge management system, but this is a pretty general and well known problem (c.f. [1,2,3]). More domain- and country-specific results would be much more interesting for the reader, and if there are none to be found, an explicit explanation and justification of that should have been made.

3. As the authors did quite a lot of work when conducting the interviews and collecting the answers, it would have been interesting to support their remedy suggestions also by some explicit questions in the interviews on how the queried people would improve the current practice in knowledge management at their institute. This could have been done by presenting couple of well known strategies being used in practice (ontologies for knowledge integration across departments, wikis for personal knowledge management and/or for collaboration integrated with hospital information systems, etc.), plus giving simple examples to make sure people understand it, and then use this to support improvement suggestions using the statistically relevant analysis of the actual practitioner feedback.

4. The study seems to focus mostly on process aspects of knowledge management in health care, but does not mention medical and healthcare standards much. This is becoming quite an important aspects of healthcare knowledge management (c.f., DICOM or HL7) and thus may be pretty relevant to a complete case study.

[1] Alexander Ardichvili, Vaughn Page, Tim Wentling, (2003) "Motivation and barriers to participation in virtual knowledge-sharing communities of practice", Journal of Knowledge Management, Volume 7 Issue 1, pp. 64 - 77
[2] Shin-Yuan Hung, Alexandra Durcikova, Hui-Min Lai, Wan-Mei Lin, (2011), "The influence of intrinsic and extrinsic motivation on individuals' knowledge sharing behavior", International Journal of Human-Computer Studies, Volume 69, Issue 6, pp. 415-427
[3] Daegeun Hong, Euiho Suh, Choonghyo Koo, (2011), "Developing strategies for overcoming barriers to knowledge sharing based on conversational knowledge management: A case study of a financial company", Expert Systems with Applications, Volume 38, Issue 12, pp. 14417–14427

Review #2
Anonymous submitted on 24/Aug/2014
Suggestion:
[EKAW] conference only accept
Review Comment:

Overall evaluation
Select your choice from the options below and write its number below.

== 3 strong accept
== 2 accept
== 1 weak accept
== 0 borderline paper
== -1 weak reject
== -2 reject
== -3 strong reject

1

Reviewer's confidence
Select your choice from the options below and write its number below.

== 5 (expert)
== 4 (high)
== 3 (medium)
== 2 (low)
== 1 (none)

4

Interest to the Knowledge Engineering and Knowledge Management Community
Select your choice from the options below and write its number below.

== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor

4

Novelty
Select your choice from the options below and write its number below.

== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor

3

Technical quality
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor

3

Evaluation
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 not present

1

Clarity and presentation
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
== 3 fair
== 2 poor
== 1 very poor

3

Review

The article, entitled `Knowledge Management Processes to Support Evidence Based Practice in Healthcare – a Swedish Case Study,' presents a study on knowledge management in the context of healthcare. The authors report on preliminary work, paving the way towards a knowledge management (KM) project that aims at providing a single access point to a wide variety of practitioners. The article contains a relevant contribution to the area of KM for healthcare, providing new qualitative evidence on medical practices collected through 62 semi-structured interviews with stakeholders, resulting in a number of observations relevant to any IS developer operating in the medical sector.

The main limitation of the article is in its presentation, which hinders its contribution. The discussion feels at times rather unfocused, and can benefit from streamlining and re-structuring. For this reason, I recommend that the authors solve the following issues in the revised version of the article prior publication:

- Project stakeholders: The authors indicate that their "knowledge portal" targets all healthcare professionals except physicians. Why is that the case? More explicit definition of user groups and stakeholders (e.g. managers, nurses, nurse assistants, etc) would help clarify the discussion. The power relations between these groups should be discussed more explicitly.

- Medical domain: For the KM reader unaccustomed to the healthcare domain in the Swedish context, it would be beneficial to provide brief definitions of terms such as "primary, secondary and municipality care."

- Abstract: The abstract feels too generic, and should reflect the content of the paper more closely. In particular, it should mention that the interviews constitute the core contribution of the paper.

- Theoretical background: This section is very generic. The knowledge lifecycle is a general framework for organizations, but how does it relate specifically to the healthcare domain? How does healthcare differ to any other complex domain of practice? This section should be shortened and the disciplinary areas of interests should be identified more clearly.

- Figure 1: The role of measurement is left explained in the part of the text. Please explain what you mean by "measurement" here.

- Research approach: This initial outline should be moved to the introduction, and the abstract and the introduction should refer to the research approach explicitly. The fact that the authors performed a literature review is obvious from Section 2.

- Methodology and data analysis. "Open/Axial coding": the authors should explain more in detail how they applied Grounded Theory in their interviews, clarifying how the findings were extracted from the interviews. What issues were encountered in the process?

- Findings: This section is the most problematic, as it presents long, loosely connected paragraphs. The authors should re-organize this section into more subsections, bringing the reader's attention to core findings. A table could be used to summarize the findings, grouping them by user group (managers, nurses, nurse assistants, etc.) and thematic area (creation, storage, sharing, etc.), allowing the reader to have an overview of the different groups' needs and perspectives. The same issue applies to section "Discussion," which does not appear sufficiently separate from section "findings". The two sections could be merged and split into a number of subsections to increase the general clarity of the paper.

- The role of patients: in the interviews, how did the different stakeholders view KM w.r.t. patients? As the patients are a crucial element in the knowledge architecture, it seems necessary to clarify this point. Do stakeholders have different information needs regarding general scientific literature and regarding their patients? Is it reasonable to host all this information in the same system?

- KM costs: The authors argue that explicit KM processes would benefit the healthcare delivery and the practice of evidence-based medicine. Although this is indeed a reasonable claim, KM has costs which should not be ignored or minimized. The authors point out that time is considered an issue, as documenting activities is time-consuming. Did any participants express concerns on the costs of embedding such KM procedures in their daily schedule? This issue deserves expansion.

Minor issues and typos:

- (11, 12, 13, 14) -> [11, ...]

Review #3
Anonymous submitted on 25/Aug/2014
Suggestion:
[EKAW] conference only accept
Review Comment:

Overall evaluation
Select your choice from the options below and write its number below.

== 3 strong accept
== 2 accept
== 1 weak accept
== 0 borderline paper
-1 weak reject
== -2 reject
== -3 strong reject

Reviewer's confidence
Select your choice from the options below and write its number below.

== 5 (expert)
4 (high)
== 3 (medium)
== 2 (low)
== 1 (none)

Interest to the Knowledge Engineering and Knowledge Management Community
Select your choice from the options below and write its number below.

== 5 excellent
== 4 good
3 fair
== 2 poor
== 1 very poor

Novelty
Select your choice from the options below and write its number below.

== 5 excellent
== 4 good
3 fair
== 2 poor
== 1 very poor

Technical quality
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
3 fair
== 2 poor
== 1 very poor

Evaluation
Select your choice from the options below and write its number below.
== 5 excellent
4 good
== 3 fair
== 2 poor
== 1 not present

Clarity and presentation
Select your choice from the options below and write its number below.
== 5 excellent
== 4 good
3 fair
== 2 poor
== 1 very poor

Review

Knowledge management processes to support evidence based practice in healthcare - a swedish case study.

This paper report on a study that they did for managing knowledge in primary care, secondary care and municipality care in Sweden. The main observations are that the KM process is not systematically reflected in their organizational culture, and that there are major obstacles to work according to the evidence based medicine approach. They discussed their results based the knowledge cycle in organizations from the literature. Their insights of this field report are valueable to share, but may be more in the medical informatics area.

This is only an appropriate in-use paper for EKAW. It is a report on applying KM in the medical field. Actually it is more a field report, without lessons for the KM community, but insights for medical knowledge management. Another more medical oriented venue would may be more appropriate.

The paper is not appropriate for SWJ.

Detail comments:

The authors uses the word knowledge in a rather broad way. I think that the paper would be benefit from making more distinction among the different type of knowledge that is available in medical domain, like medical guidelines, medical literature (pubmed), clinical trials etc.

The goal is to identify the possibilities for IT-based knowledge repository, a kind of medical knowledge portal. In the study the physicians are excluded. It would be useful to motivate this choice, and emphasize that this will result in different findings.

Data collection: it would be useful to give more insight how the interviews are spread over the different type of persons.
After reading section 3, I expected that the results are a set of concepts, and even may be reasoning processes. Do you have those concepts?
What is exactly the results of the “open coding” and “axial coding”?

In the discussion:
“they must teach by giving employees the right tools to capture and disseminate knowledge”
This is rather general, do you have some recommendation?

In the last paragraph, section 5, the authors mention that the managers do not know what to measure. How does this relate to the whole field of medical quality measurements (indicators)?

typo/ comment:
“The results from the interviews will be presented in section 4 “—> “in this section”

typo: mangers