LDRS591, Unit 6, Response

This is a response to Simarjit’s post question: Since the qualitative process is ‘explorative’ and ‘evolves’ along the way, the results could be interpreted in different ways. Since the reader doesn’t always have access to the analysis tools or programs used by the researchers, how does the reader reconcile their interpretation with that of the researchers? Seems like trust in the researchers is an important element to the consumer of qualitative research.

Simarjit,

You are right that qualitative research is exploratory and evolves. I see the evolution of the research in the contradicting results found from one study to another that find differing results due to culture, the social beliefs in the time of history they conduct the study, or other factors. For example, I explored studies analyzing female leadership this past week and found a range of data that found women were equally capable or less capable than men in leading. Studies in the past reflected the social beliefs of leadership being a masculine characteristics, while more recent studies reflect the growing acknowledgement of women’s capabilities. Research is continually building and responding to one another, but I believe research always has a best answer. It is up to the reader to find the most accurate interpretation of a study, and that means not basing her interpretation solely on herself or the single research she read. To answer your question specifically, I have two suggestions on how readers can reconcile their interpretation with the researchers’ below:

  1. Reading different studies: Similar studies that produce contradicting results or similar findings help consumers of research reports find credible and accurate findings. Considering different results helps readers find a more well-rounded understanding of the study results, and similar findings confirm the accuracy of the researchers’ findings.
  2. Understanding the research and data analysis process: Plano-Clark & Creswell (2015) state, “A reader of research […] need[s] to understand both the process researchers use to analyze qualitative data and how the results of this process are reported to fully appreciate and evaluate the findings presented in a qualitative research report” (p. 353). Evaluating the processes the researchers use can help readers find credible processes that will yield reliable results. Basing one’s judgement on the credibility of the described processes is much more reliable than basing it on the researchers’ or one’s own interpretations.

References

Plano-Clark, V., & Creswell, J. (2015). Understanding research: A consumer’s guide (2nd ed.). Boston, MA: Pearson.

LDRS591, Unit 6, Activity 6.4

As a consumer of research reports, the most important things for me in the methods and results section of a high-quality qualitative research report are…

  1. A credible sample that provides well-rounded and accurate results. The researchers’ attention to finding the “right” participants where their characteristics such as race, sex, age, and culture is crucial to providing good data. As Plano-Clark & Creswell (2015) state, “[Purposeful sampling] is best suited for qualitative research because the researcher is able to select the individuals who are most appropriate for a study of the central phenomenon” (p. 332). There are limited participants, and finding the right participants to provide rich and meaningful information provides greater accuracy!
  2. Clear and rigorous procedures that offer credible data and analysis. Providing a clear framework of the study’s procedure not only helps readers understand the study, but also shows the attention the researchers implemented to provide consistency in their data collection. Also, their use of rigorous procedures that adhere to credible standards of qualitative studies that involves processes such as audits, triangulation, and bracketing reveals credibility in their results.
  3. A good presentation of data that clearly outlines and compares the data collected. Due to the nature of data collection in qualitative studies, there are lots of words as participants are interviewed or asked to complete a questionnaire and this can cause an overwhelming sight on a study. Providing a well structured presentation of the data with subtitles, charts, tables, and the researchers’ interpretations help me understand the participants better and the data the researchers focused on and considered.

Question: I personally find it difficult to understand a study fully without a full documentation or example of the questions used to collect data from their participants – I like the details! Do you think it is important for researchers to provide all these questions and responses from participants, or do you find this unnecessary information?

References

Plano-Clark, V., & Creswell, J. (2015). Understanding research: A consumer’s guide (2nd ed.). Boston, MA: Pearson.

Link to blog question: https://create.twu.ca/ldrs591-sp18/unit-6-learning-activities/

LDRS591, Unit 6, Activity 6.3

E. Russell, Maxfield, and J. Russell’s (2017) study is evaluated based on Plano-Clark & Creswell’s (2015) seven criteria for evaluating the data analysis of a qualitative research report (p.  301) below:

  1. The analysis process used rigorous qualitative procedures (2/3) – Russell et al. (2017) sorted and analyzed the data using a hand coding process (p. 86) that involved “a lot of time reading and rereading the data” (p. 86), but failed to provide “verbatim transcripts and electronic scans of all gathered data” (Plano-Clark & Creswell, 2015, p. 377).
  2. Strategies were used to validate the findings (2/3) – Russell et al. (2017) used triangulation to validate their results, and “had another researcher preform an analysis for comparison” (p. 86). Despite this, there is not a clear indication of the researchers using at least three of the four strategies Plano-Clark & Creswell (2015) identified as crucial to validating results: bracketing, triangulation, member checking, and audits.
  3. The findings include a description of people, places, or events in the study (1/3) – The study provides details on each participants’ organizational position and for-profit sector as shown in Table 2 (Russell et al., 2017, p. 85), and general information on the age range, sex, and location of the study. Plano-Clark & Creswell (2015) state, “A good qualitative description […] should transport you into the context of the research and help you get to know the people, setting, or events that are important in the study” (p. 366). Due to the researcher’s emphasis on anonymity, there are broad but not many narrow descriptions. While I feel the study still provides a general idea of its participants, further details on the people and setting of the organizations would have benefited the study.
  4. The findings include appropriate themes about the central phenomenon (2/3) – There are seven meaningful themes identified in the two attributes found in the results that are supported by multiple quotes and perspectives. A comparison table and further interpretation from the researchers’ voice would have benefited this area.
  5. The findings relate multiple themes to each other (3/3) – The themes are linked through the two attributes identified: 1) validation as a leader, and 2) freedom from management. There are multiple layers of categories within the two attributes that connect consistently to the central question of how “senior leaders interpret the personal benefits derived from serving the needs of followers” (Russell et al., 2017, p. 76).
  6. The data analysis represents a good qualitative process (2/3) – The data analysis involved a dynamic coding process that involved open codes, axial codes, and selective codes that were interpreted based on the data collected. The researchers reveal a credible process with relatively accurate results despite a low sample number and limitations created by the questionnaire such as “discovering how these leaders arrived at their position of leadership” (Russell et al., 2017, p. 93).
  7. The findings provide a good exploration of the central phenomenon (2/3) – The findings provide detailed information in understanding “the benefits to one’s self-interest from being a servant leader” (Russell et al., 2017, p. 93). Overall, the findings were well focused on the study’s research question and added to the discussion of servant leadership.

References

Plano-Clark, V., & Creswell, J. (2015). Understanding research: A consumer’s guide (2nd ed.). Boston, MA: Pearson.

Russell, E. J., Maxfield, R. J., & Russell, J. L. (2017). Discovering the self-interest of servant leadership: A grounded theory. Servant Leadership: Theory and Practice, 4(1), 75-97. Retrieved from http://www.sltpjournal.org/uploads/2/6/3/9/26394582/06russell_vol_4_issue_1.pdf

LDRS591, Unit 6, Activity 6.2

Plano-Clark & Creswell’s (2015) evaluation of participants and data collection in a qualitative research report is implemented on E. Russell, Maxfield, & J. Russell’s (2017) study below:

  1. The sampling strategy is appropriate and justified (2/3) – Russell et al. (2017) select a variety of leaders from “organizations headquartered in the Western United States” (p.  84) which provide perspectives from numerous for-profit sectors such as education, legal services, and finance. This proposes a well selected variety of participants. While the sampling strategy that used questionnaires was purposeful, interviews could have better served the purpose of the study; the researchers also acknowledge this by recommending the use of interviews for future studies.
  2. The sample size is appropriate and justified (1/3) – Plano-Clark & Creswell (2015) state a grounded theory study should include 20 to 30 individuals (p. 336), but Russell et al. (2017) only use 14 senior level leaders for their study. Russell et al. (2017) acknowledge this is a limitation, but state,”Researchers relied on data saturation to determine the study’s sample size” (p. 85).
  3. The data types are appropriate (2/3) – The open-ended questions asked on the questionnaires provide a good venue for participants to share their experience through a framework that allows the researchers to collect quantitative information, but as Plano-Clark & Creswell (2015) mention, the data collected is limited “because participants often write very little […] and researchers cannot ask the participants for clarifying information” (p. 340).
  4. The data are gathered using rigorous qualitative procedures (2/3) – Although not all the questionnaire questions are provided, Russell et al. (2017) “developed a script consisting of open-ended questions to be used as the study questionnaire” (p. 84) and provide examples of the questions in the results section of the page. The benefit of the questionnaires is they can keep a good collection of their detailed questions and answers. The researchers also conducted a pilot project to refine the questions, but due to the nature of questionnaires, no follow-up questions were asked to further probe for data.
  5. Data collection issues are handled ethically and thoughtfully (3/3) – Russell et al. (2017) indicate their respect of their participants’ rights by reinforcing the volunteer aspect of the participation and protecting the anonymity of their participants through their procedure. “The researchers removed any personal identifiers” (p. 85) and ensured trustworthiness by “triangula[ting] data sources from multiple participants, had another researcher preform an analysis for comparison, and presented the data as in-depth rich descriptions” (p. 85).
  6. The selected participants are information rich (3/3) – As Table 2 (Russell et al., 2017, p. 85) indicate, the sampling was well rounded in age and gender from a variety of sectors in senior level leadership. The participants are a clear fit for the study.
  7. The database provides extensive and credible information about the central phenomenon (2/3) – Russell et al. (2017) provide great examples of their data that include open-ended questions and answers that relate to the central research question collected via different questionnaires. It is unknown of how long the overall process took and I believe further details of the information gathered could have been provided.

References

Plano-Clark, V., & Creswell, J. (2015). Understanding research: A consumer’s guide (2nd ed.). Boston, MA: Pearson.

Russell, E. J., Maxfield, R. J., & Russell, J. L. (2017). Discovering the self-interest of servant leadership: A grounded theory. Servant Leadership: Theory and Practice, 4(1), 75-97. Retrieved from http://www.sltpjournal.org/uploads/2/6/3/9/26394582/06russell_vol_4_issue_1.pdf

LDRS591, Unit 6, Activity 6.1

l will evaluate E. Russell, Maxfield, and J. Russell’s (2017) study based on Plano-Clark & Creswell’s (2015) seven criteria for evaluating the research design of a qualitative research report (p.  301).

  1. A research design guides the conduct of the qualitative study (3/3) –  Russell et al. (2017) use the qualitative grounded theory “to discover how senior level leaders perceive personal benefits derived from serving the needs of their followers” (p. 75); this study researched the action of perceiving personal benefits through online questionnaires that questioned 14 senior level leaders. As the grounded theory approach seeks to explain “a process, action, or interaction [….] built from the experiences and perspectives of participants,” Russell et al. (2017) seems knowledgeable about the design and use accurate terms to describe the grounded theory process.
  2. The choice of the research design is appropriate  and justified (3/3) – Russell et al. (2017) justify their choice of using the qualitative grounded theory by stating: “The design allows for an analysis of data using a constant comparative method” (p. 84). Beyond this reasoning, the nature of the study that considers the experience of its participants’ interpretation of their personal benefits derived from serving followers requires personal assessments of leaders “who have experienced the process” (Plano-Clark & Creswell, 2015, p. 298) that the grounded theory offers.
  3. Good qualitative data collection procedures are used (2/3) – Plano-Clark & Creswell (2015) state, “You often find that the grounded theory researcher interviewed people” (p. 298). While Russell et al. (2017) do not interview their participants directly, they choose to collect their participants’ experience and perspectives through online questionnaires to protect their anonymity which equally serves the study’s purpose. The researchers ran a pilot study to refine the questions, and “established a secure database for data collection and storage to ensure data reliability” (p. 85).
  4. Good qualitative analysis procedures are used (3/3) – A good grounded research analyses “data using multiple stages of coding” (Plano-Clark & Creswell, 2015, p. 298). Russell et al. (2017) adhere to this characteristic by using “a tiered process for the sorting and analysis of the data” (p. 86) which included open codes and axial codes.
  5. Good qualitative results and interpretations are reported (3/3) – The results are organized well into two categories (or attributes) and a sample of the questionnaire answers are presented to support the two attributes. Overall, the conclusion and discussion of the data interpret the generated theory that leaders benefits from serving followers.
  6. The study used a rigorous research design (3/3) – The study’s process and analysis fit together logically and coherently. The article begins with a clear framework of the characteristics of servant leadership, and explore its research question thoroughly.
  7. The use of the qualitative research design addressed the study’s purpose (3/3) – The research design fits the study’s intent and answers the study’s intent of understanding how senior leadership perceives personal benefits of serving their followers; “leaders realize personal benefits from serving the needs of followers” (Russel et al., 2015, p. 92).

References

Plano-Clark, V., & Creswell, J. (2015). Understanding research: A consumer’s guide (2nd ed.). Boston, MA: Pearson.

Russell, E. J., Maxfield, R. J., & Russell, J. L. (2017). Discovering the self-interest of servant leadership: A grounded theory. Servant Leadership: Theory and Practice, 4(1), 75-97. Retrieved from http://www.sltpjournal.org/uploads/2/6/3/9/26394582/06russell_vol_4_issue_1.pdf