|
|
||||||||
1 Department of Family Medicine, Robert Wood Johnson Medical School, University of Medicine and Dentistry of New Jersey, New Brunswick, NJ
2 Center for Research in Family Practice and Primary Care, Cleveland, Ohio
3 Cancer Institute of New Jersey, New Brunswick, NJ
4 University of Medicine and Dentistry of New Jersey, New Jersey Medical School, Newark, NJ
CORRESPONDING AUTHOR: John G. Scott, MD, PhD, Department of Family Medicine, One Worlds Fair Drive, Somerset, NJ 08873, scottjg{at}umdnj.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS Based on data from ethnographic field notes, we constructed matrices identifying how practice members interact when practice-level decisions are made. SNA software (UCINet and KrackPlot) calculates quantitative measures of network structure including density, centralization, hierarchy and clustering coefficient. The software also generates a visual representation of networks through network diagrams.
RESULTS The 2 examples show clear distinctions between practices for all the SNA measures. Potential uses of these measures for analysis of primary care practices are described.
CONCLUSIONS SNA can be useful for quantitative analysis of interaction patterns that can distinguish differences among primary care practices.
Key Words: Evaluation studies health care delivery health services research social networks
| INTRODUCTION |
|---|
|
|
|---|
SNA combines the concept of the sociogram (a visual representation of relationships in a social group) with elements of graph theory to analyze patterns of interaction among people in various kinds of networks, allowing quantitative comparisons between different network structures.12 There is a large body of scholarly literature describing the use of SNA. Much of this work addresses the basic science of SNA, that is the development of theoretical models of network organization and the mathematical derivation of quantitative measures of network characteristics.13 More recent work examines the association of these quantitative measures with organizational performance outcomes. Cummings and Cross, for example, found that degree of hierarchy, core-periphery structure, and structural holes of leaders correlated negatively with performance in 182 work groups in a large telecommunications company,14 and Aydin et al found that increased network communication density was associated with higher use of an electronic medical record system by nurse practitioners and physicians assistants.15 There have also been studies showing how network parameters change with time. Shah, for example showed that network centrality decreased after downsizing in a consumer electronics firm,16 whereas Burkhardt and Brass documented increased network centrality after introduction of a new computer system in a federal agency.17
In this article, using data from 2 primary care practices as examples, we detail SNA measures that can be used to quantify patterns of decision making and discuss how these measures could be used to facilitate the design and measure the outcomes of interventions to change organizational behavior in primary care practices.
| METHODS |
|---|
|
|
|---|
Construction of the SNA Matrix
SNA analyzes patterns of connections (ties) among information-processing agents (nodes). Data are recorded in the form of an adjacency matrix, where each node is assigned both a column and a row in the matrix. A matrix constructed in this way will have two cells representing the intersection of any 2 nodes, 1 above and 1 below the diagonal. If a connection or tie exists between 2 nodes, then a 1 (or another positive number representing the strength of the tie) is entered in the matrix cell representing the intersection of these 2 nodes. If no tie exists, then a 0 is entered. It is not necessary that the 2 cells for each pair of notes have the same value. For example, in Figure 1A
, A consults B when making a decision, but B does not consult A. In this case, the cell at the intersection of row A and column B would contain a 1, but the intersection of row B and column A would contain a 0. A matrix that has this property is called a directed matrix. If the tie being studied is not directional (ie, if A talks to B, then B must also talk to A), then the matrix cells below the diagonal are identical to those above the diagonal and are ignored in the SNA calculations (Figure 1B
).
|
Because our data consisted of ethnographic field notes rather than survey responses, our approach to constructing the SNA matrices was somewhat more complex than the method described above. A team consisting of the observers who had recorded the data for the practices and a family physician analyzed the field notes and the transcribed interviews. Each team member individually constructed a social network adjacency matrix for both practices using a spreadsheet (Microsoft Excel) with each practice member assigned both a column and a row. For every person represented on a row of the spreadsheet, team members used qualitative data to answer the question, "Whom does this person consult when significant decisions need to be made in the practice?" For each column in the row, the entry of a 1 or 0 indicated the presence or absence of consultation of that practice member by the person represented on the row. This resulted in a directed as opposed to an undirected matrix, meaning in this case that connections between members were not necessarily reciprocal. Reciprocal connections would occur only if 2 members consulted each other when making decisions.
Unlike structured interviews or surveys, these ethnographic field notes may not provide specific information about each pair of practice members; however, they provide important contextual data for interpreting the SNA results. Statements or observations often describe the interaction of an individual with a group of practice members or interactions between groups. Thus we were able to assign values in the matrix to all the members in each group. In practice 1, for example, we assigned 0 to all the columns for the practice leader, whom we will call "Dr. Smith," indicating that he consulted no one in the practice when making decisions. The following illustrates how data elements from observation, in-depth interviews, and key informant interviews were used to assign those values:
ObservationsPractice leader: "Dr. Smith seems to have a very hands-on approach to management of his office. Regarding office organization in decision making, I noticed that most of the decision-making seems to come from Dr. Smith and that there is little in the way of staff empowerment. Decisions are communicated throughout the practice via memo and not very systematically."
In-depth interviewsOffice manager: "Long-term goals are set by Dr. Smith, who has a clear goal and change is managed principally by Dr. Smith. Decision-making tends to be top-down and all financial management decisions are made by Dr. Smith." Front desk supervisor: "When significant changes need to be made, Dr. Smith makes them. Dr. Smith often sets policies and doesnt follow them himself." Dr. Smith (referring to a new electronic medical record system): "I came up with those plans and I tried to get (the office manager) and the staff to enact the goals I recommended."
Key informant interviewsThe office manager: "Reports that Dr. Smith generally doesnt appreciate some of the expertise around. She describes a sort of micromanaging that he does." The nursing supervisor: "Reports that one thing that she does want to mention and make sure it gets into the notes is that Dr. Smith often does not hear when he is spoken to."
Matrix values for the remaining practice members in practice 1 and practice 2 were assigned in similar fashion using the 3 kinds of qualitative data noted above. The team met together to share the individual matrices. There were only minimal differences among the observers, which were resolved by consensus. The resulting matrices were then imported into UCInet18 and Krack-Plot19 software to compute several quantitative measures of network structure for each of the 2 practices.
| RESULTS |
|---|
|
|
|---|
|
Network Density
The first measure constructed was network density. The density of a network is the number of actual connections between members divided by the number of possible connections. Density values range from 0 to 1.12 In these decision-making networks, higher density indicates a greater degree of interaction among the members in the process of making decisions. In our example practices, the practice 2 network is more than twice as dense as the practice 1 network, indicating that there are many more decision-making interactions in practice 2 than in practice 1 (Table 1
).
|
Hierarchy
Hierarchy is the degree to which the network approaches a perfect hierarchy, that is, the degree to which all relations are unidirectional. An organization chart would be an example of a perfect hierarchy. Hierarchy values were calculated using KrackPlot software.19 Practice 1 has a very high hierarchy value, whereas the hierarchy value of practice 2 is 0 (no unidirectional relations) (Table 1
).
Centralization
Centralization is the degree to which a network approaches the configuration of a "star" network. A star network has 1 node in the center that connects to all other nodes. No nodes have connections to any other node except the central node. The centralization score is expressed as a percentage and can vary from 0 (every member is connected to every other member) to 100 (all members are connected to only 1 member). The centralization percentage thus indicates the degree of asymmetry in the distribution of connections in the network. A high centralization score indicates that some members have many more connections than others. For these directed decision-making networks, there are 2 components to centralization. High indegree centralization would indicate that a small number of members are consulted by the rest of the members. High outdegree centralization would indicate that a small number of members do most of the consulting of others.21 Table 1
shows the indegree and outdegree centralization percentages for practices 1 and 2. Both show a relatively high degree of centralization, but practice 1 has much more marked asymmetry in the indegree and outdegree percentages than practice 2.
| DISCUSSION |
|---|
|
|
|---|
The measures we calculated have been associated with performance outcomes in other organizations14,22,23 and have been used to measure organizational change with time.17,24 Although we cannot make any statistical inferences from the differences in only 2 practices, adaptations of regression and correlation statistics have been developed for use with network data25,26 that provide a practical way to examine association of network parameters with performance outcomes in large numbers of practices. We might hypothesize based on the outcome studies cited above, for example, that network density would correlate positively with practice adherence to treatment guidelines for hypertension, and that degree of hierarchy would correlate negatively. These hypotheses could be tested using network data. Significance testing using SNA measures could also be used in randomized controlled trials to evaluate the impact on decision making or other communication patterns of interventions aimed at organizational change.
Another possible use of SNA quantitative measures would be to help tailor interventions in practices based on their network parameters. An intriguing article by McGrath and Krackhardt27 explores how different network configurations might predict what sorts of interventions would be most effective in producing sustainable organizational change.
We used decision-making patterns in this analysis, but the technique would lend itself to the study of any other observed interaction among agents in the complex social systems of primary care practices, such as office communication patterns, clinical information flow, or referral patterns. SNA could also be used to complement and triangulate other quantitative measures of organizational performance that use survey methodology.28
SNA is a useful tool for quantitative analysis of the complex systems represented by primary care practices. A broad range of potential applications of this tool is possible, including using it to help design interventions to promote practice organizational change.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Funding support; This study was funded by a National Heart Lung Blood Institute Grant R01 HL070800-01. Analysis of these data was also supported in part by a Research Center grant from the American Academy of Family Physicians (Center for Research in Family Practice and Primary Care).
Received for publication October 3, 2004. Revision received April 21, 2005. Accepted for publication April 25, 2005.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. Merrill and G. Hripcsak Using Social Network Analysis within a Department of Biomedical Informatics to Induce a Discussion of Academic Communities of Practice J. Am. Med. Inform. Assoc., November 1, 2008; 15(6): 780 - 782. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. C. Stange In This Issue: Subtle Clinical Policy Ann. Fam. Med, September 1, 2005; 3(5): 386 - 388. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |