Mixed Method
Mixed Methods Dissertation Checklist
The following provides guidance for reporting on mixed-methods studies.
All items may not be relevant to your particular study; please consult with your chair for guidance.
The checklist items may not necessarily be in the order that works best for your dissertation. Please consult with your committee; however, the checklist should work well in the absence of other considerations.
Instructions for Students:
Indicate on the checklist the page number (use the actual document page number, not the MS Word pagination) where the appropriate indicator is located.
Respond to comments from the chair and/or URR in the comment history box. Do not delete previous commentsjust add your response and use some means to clearly identify your remarks (different font/bold/italics/color).
Instructions for the chair and/or URR
Provide specific feedback in the comment history column. Do not delete previous comments – just add your response and use some means to clearly identify your remarks (different font/bold/italics/color).
If you made detailed comments on the draft (using track changes and comments), you can make reference to the draft rather than restate everything in the checklist comment history section.
Date: (click here and type today’s date )
Student’s Name: Student ID (for office use only) --
School: (click here and pull down to select school name )
Committee Members’ Names:
Chairperson
Member
University Research Reviewer
Front Matter | |
Checklist Items | Comment History |
Title: [Insert Dissertation Title] | |
Type of mixed-methods study. | |
Participant group. | |
Abstract | |
Describe the research problem and why it is important. | |
Identify the purpose of the study. | |
State the theoretical foundations and/or conceptual frameworks as appropriate. | |
Summarize the key research question(s). | |
Describe, concisely, the overall research design, methods, and data analysis procedures. | |
Identify key results, conclusions, and recommendations that capture the heart of the research (for the final study only). | |
Conclude with a statement on the implications for positive social change. |
CHAPTER 1 | ||
Checklist Items | Pg/NA | Comment History |
Introduction | ||
Describe the topic of the study, why the study needs to be conducted, and the potential positive social change. implications of the study | ||
Preview major sections of the chapter. | ||
Background | ||
Briefly summarize research literature related to the scope of the study topic. | ||
Describe a gap in knowledge in the discipline that the study will address. | ||
End the section on why the study is needed. | ||
Problem Statement | ||
State the research problem. | ||
Provide evidence of consensus that the problem is current, relevant, and significant to the discipline. | ||
Frame the problem in a way that builds upon or counters previous research findings focusing primarily on research conducted in the last 5 years. | ||
Address a meaningful gap in the current research literature. | ||
Purpose of the Study Provide a concise statement that serves as the connection between the problem being addressed and the focus of the study. The purpose contains: | ||
Indication that a mixed methods paradigm is being used. | ||
The study intent (such as describe, compare, correlate, explore, and develop). | ||
The independent, dependent, and covariate variables and/or concept/phenomenon (as appropriate to the particular study). | ||
Research Question(s) and Hypotheses | ||
State the research questions. | ||
For quantitative components, state the null and alternative hypotheses that identify the independent and dependent variables being studied, the association being tested, and how the variables are being measured. | ||
Theoretical and/or Conceptual Framework for the Study (Studies must include either a theoretical foundation or a conceptual framework section or both.) | ||
Theoretical Foundation | ||
Identify the theory or theories and provide the origin or source. | ||
State concisely the major theoretical propositions and/or major hypotheses with a reference to more detailed explanation in chapter 2. | ||
Explain how the theory relates to the study approach and research questions. | ||
Conceptual Framework This applies to qualitative and to some epidemiological studies (as well as some other quantitative studies) and to some mixed-methods studies. | ||
Identify and define the concept and/or phenomenon that grounds the study. | ||
Describe concisely the conceptual framework (for qualitative components, the contextual “lens”; for quantitative components, the body of research that supports the need for the study) as derived from the literature with more detailed analysis in chapter 2. | ||
State the logical connections among key elements of the framework with a reference to a more thorough explanation in chapter 2. | ||
State how the framework relates to the study approach and key research questions, as well as to the instrument development and data analysis, where appropriate. |
Nature of the Study | ||
Provide a concise rationale for selection of the design and / or tradition. | ||
Briefly describe the key study variables (independent, dependent, and covariate in quantitative components) or concept/phenomenon (qualitative components. | ||
Briefly summarize the methodology (from whom and how data are collected and how data will be analyzed). | ||
Definitions | ||
Provide concise definitions of key concepts or constructs. | ||
Define terms used in the study that have multiple meanings (e.g., socioeconomic status, educator, health service professional, among others ) (Do not include common terms or terms that can easily be looked up in a dictionary.) | ||
Include citations that identify support in the professional literature for the definition or operational definition. | ||
Assumptions | ||
Clarify aspects of the study that are believed but cannot be demonstrated to be true. Only include assumptions critical to the meaningfulness of the study. | ||
Describe the reasons why the assumption(s) was (were) necessary in the context of the study. | ||
Scope and Delimitations | ||
Describe specific aspects of the research problem that are addressed in the study and why the specific focus was chosen (issue of internal validity). | ||
Define the boundaries of the study by identifying populations included and excluded and theories and/or conceptual frameworks most related to the area of study that were not investigated (this is an issue of external validity). | ||
Address potential generalizability (quantitative components) or transferability (qualitative components). | ||
Limitations | ||
Describe limitations of the study related to design and/or methodological weaknesses (including issues related to limitations of internal and external validity, construct validity, and confounder variables). | ||
Describe any biases that could influence study outcomes and how they are addressed. | ||
Describe reasonable measures to address limitations. |
Significance | ||
Identify potential contributions of the study that advance knowledge in the discipline. This is an elaboration of what the problem addresses. | ||
Identify potential contributions of the study that advance practice and/or policy, as applicable. | ||
Describe potential implications for positive social change that are consistent with and bounded by the scope of the study. | ||
Summary | ||
Summarize the main points of the chapter. | ||
Provide transition to chapter 2. |
CHAPTER 2 | ||
Checklist Items | Pg/NA | Comment History |
Introduction | ||
Restate the problem and the purpose. | ||
Provide a concise synopsis of the current literature that establishes the relevance of the problem. | ||
Preview major sections of the chapter. |
Literature Search Strategy | ||
List accessed library databases and search engines used. | ||
List key search terms and combinations of search terms (with more detailed search terms located in an appendix, if appropriate). | ||
Describe scope of literature review in terms of years searched as well as types of literature and sources searched, including seminal literature as well as current peer-reviewed literature. | ||
In cases where there is little current research, and few(if any) dissertations and/or conference proceedings, describe how this was handled. | ||
Theoretical Foundation (as appropriate) | ||
Name the theory or theories. | ||
Provide origin or source of the theory. | ||
Describe major theoretical propositions and/or major hypotheses, including delineation of any assumptions appropriate to the application of the theory. | ||
Provide a literature- and research-based analysis of how the theory has been applied previously in ways similar to the current study. | ||
Provide the rationale for the choice of this theory. | ||
Describe how and why the selected theory relates to the present study and how the research questions relate to, challenge, or build upon existing theory. |
Conceptual Framework (as appropriate) | ||
Identify and define the concept and/or phenomenon. | ||
Synthesize primary writings by key theorists, philosophers, and/or seminal researchers related to the concept or phenomenon. | ||
Provide key statements and definitions inherent in the framework. | ||
Describe how the concept or phenomenon has been applied and articulated in previous research and how the current study benefits from this framework. | ||
Literature Review Related to Key Variables and Concepts Provide an exhaustive review of the current literature that includes the following information: | ||
Describe studies related to the constructs of interest and chosen methodology and methods that are consistent with the scope of the study. | ||
Describe ways researchers in the discipline have approached the problem and the strengths and weakness inherent in their approaches. | ||
For Quantitative Components | ||
Review and synthesize studies related to the key independent, dependent, and covariate variables to produce a description and explanation of what is known about the variables, what is controversial (i.e., mixed findings by researchers), and what remains to be studied. | ||
Review and synthesize studies related to the research questions. |
For Qualitative Components | ||
Review and synthesize studies related to the key concepts and/or phenomena under investigation to produce a description of what is known about them, what is controversial, and what remains to be studied. | ||
Review and synthesize studies related to the research questions and why the approach selected is meaningful. | ||
Summary and Conclusions | ||
Concisely summarize the major themes in the literature. | ||
Summarize what is known as well as what is not known in the discipline related to the topic of study. | ||
Describe how the present study fills at least one of the gaps in the literature and will extend knowledge in the discipline. | ||
Provide transitional material to connect the gap in the literature to the methods described in chapter 3. |
CHAPTER 3 | ||
Checklist Items | Pg/NA | Comment History |
Introduction | ||
Restate the study purpose as described in chapter 1. | ||
Preview major sections of chapter 3. | ||
Setting | ||
Explain why the setting is relevant to the study. | ||
Describe the attributes of the environment (for example, physical setting, scope and size of the organization, and key members of the organization that impact the study. | ||
Research Design and Rationale | ||
Restate research questions as described in chapter 1. | ||
State and define central concept and/or phenomenon of the study. | ||
Identify and justify the mixed-methods design and how the two data collection and analysis strategies work together as the best approach to answering your research questions (for example, quantitative qualitative or qualitative quantitative). | ||
Describe why both methods are important to addressing the research question. | ||
Provide rationale for the chosen data collection analysis and interpretation of timing decisions (for example, concurrent and sequential), including how the integration between quantitative and qualitative data occurs. | ||
Role of the Researcher | ||
Define and explain your role as observer, participant, or observer-participant. | ||
Reveal any personal and/or professional relationships the researcher may have with participants, with emphasis on supervisory or instructor relationships involving power over the participants. | ||
State how any researcher biases and/or power relationships are managed. | ||
Describe other ethical issues, as applicable (these could include doing a study within one’s own work environment, conflict of interest or power differentials, and justification for use of incentives) and the plan for addressing these issues. | ||
Methodology (needs to be described in sufficient depth so that other researchers can replicate the study) | ||
Participant Selection Logic | ||
Identify the population, if appropriate. | ||
Identify and justify the sampling strategy. | ||
State the criterion (a) on which participant selection is based. | ||
Establish how participants are known to meet the criterion(a). | ||
State number of participants and/or cases and the rationale for that number (for quantitative components, if applicable, justify the sample size using power analysis that includes justification for the effect size, alpha level, and power level chosen). | ||
Explain specific procedures for how participants will be identified, contacted, and recruited. | ||
Describe the relationship between saturation and sample size (qualitative components). | ||
Instrumentation | ||
Qualitative Components | ||
Identify each data collection instrument (observation sheet, interview protocol, focus group protocol, videotape, audiotape, artifacts, archival data, and other kinds of data collection instruments). | ||
Identify source for each data collection instrument (published or researcher produced). Permission to use is included in the appendix. | ||
For published data collection instruments, identify:
| ||
For researcher-developed instruments, identify:
| ||
Quantitative Components | ||
For published instruments provide:
| ||
For researcher-developed instruments provide:
| ||
For all instruments, establish sufficiency of instrumentation to answer research questions. | ||
Intervention studies or those involving manipulation of an independent variable | ||
Identify materials and/or programs applied as treatment or manipulation. | ||
Provide information on the developer of the materials and/or programs.
| ||
Provide evidence that another agency will sponsor intervention studies (such as clinical interventions). | ||
Procedures for Pilot Studies (as appropriate) | ||
Include all procedures for recruitment, participation, and data collection associated with the pilot study and the main study. | ||
Describe the relationship of the pilot study to the main study (e.g., what is the purpose of the pilot study?). | ||
Include the IRB approval number for the completed dissertation. | ||
Procedures for Recruitment, Participation, and Data Collection (for students collecting their own data) | ||
Thoroughly describe recruiting procedures. | ||
Describe how participants will be provided informed consent. | ||
Describe how data are collected. | ||
Explain how participants exit the study (for example, debriefing procedures, etc.). | ||
Describe any follow-up procedures (such as requirements to return for follow-up interviews, treatments, etc.). | ||
For qualitative components For each data collection instrument, provide details of data collection:
| ||
For pilot studies (as appropriate and in addition to what is described for all studies) Describe the relationship of the pilot study to the main study (e.g., what is the purpose of the pilot study?). | ||
For intervention studies (as appropriate and in addition to what is described for all studies) Describe clearly and thoroughly the nature of the treatment, intervention, or experimental manipulation; how it will be designed and administered; and by whom and to whom it will be administered. | ||
For studies using archival data (as appropriate and in addition to what is described for all studies)
| ||
Data Analysis Plan | ||
For quantitative components:
| ||
For qualitative components:
| ||
State the plan for how quantitative and qualitative data will be integrated in the analysis. | ||
Threats to Validity | ||
Describe threats to external validity (for example, testing reactivity, interaction effects of selection and experimental variables, specificity of variables, reactive effects of experimental arrangements, and multiple-treatment interference, as appropriate to the study) and how they will be/were addressed. | ||
Describe threats to internal validity (for example, history, maturation, testing, instrumentation, statistical regression, experimental mortality, and selection-maturation interaction, as appropriate to the study) and how they will be/were addressed. | ||
Describe any threats to construct or statistical conclusion validity. |
Issues of Trustworthiness | ||
Credibility (internal validity): Describe appropriate strategies to establish credibility, such as triangulation, prolonged contact, member checks, saturation, reflexivity, and peer review. | ||
Transferability (external validity): Describe appropriate strategies to establish transferability, such as thick description and variation in participant selection. | ||
Dependability (the qualitative counterpart to reliability): Describe appropriate strategies to establish dependability, such as audit trails and triangulation. | ||
Confirmability (the qualitative counterpart to objectivity): Describe appropriate strategies to establish confirmability, such as reflexivity. | ||
Intra- and intercoder reliability, where applicable. | ||
Ethical procedures | ||
Agreements to gain access to participants or data (include actual documents in the IRB application). | ||
Describe the treatment of human participants including the following (include actual documents in the Institutional Review Board [IRB] application): | ||
| ||
| ||
| ||
Describe treatment of data (including archival data), including issues of: | ||
| ||
| ||
Other ethical issues as applicable (these issues could include doing a study within one’s own work environment, conflict of interest or power differentials, and justification for use of incentives). | ||
Summary | ||
Summary of the main points of the chapter. | ||
Transition to chapter 4. |
CHAPTER 4 | ||
Checklist Items | Pg/NA | Comment History |
Introduction | ||
Review briefly the purpose and research questions. | ||
Preview the organization of chapter 4. | ||
Pilot Study (if applicable) | ||
Describe the pilot study and how it will be (was) conducted. | ||
Report any impact of the pilot study on the main study (for example, changes in instrumentation, data analysis strategies, etc.). | ||
Setting | ||
Describe any personal or organizational conditions that influenced participants or their experience at the time of the study that may affect interpretation of the study results (for example, changes in personnel, budget cuts, and other trauma). | ||
Demographics | ||
Present participant demographics and characteristics relevant to the study. | ||
Data Collection | ||
State number of participants from whom each type of data was collected. | ||
Describe location, frequency, and duration of data collection for each data collection instrument. | ||
Describe how the data were recorded. | ||
Present any variations in data collection from the plan presented in chapter 3. | ||
Present any unusual circumstances encountered in data collection. | ||
Data Analysis | ||
Report process used to move inductively from coded units to larger representations including categories and themes. | ||
Describe the specific codes, categories, and themes that emerged from the data using quotations as needed to emphasize their importance. | ||
Describe qualities of discrepant cases and how they were factored into the analysis. | ||
Results (order of presentation depends on the specific design) | ||
Qualitative Components | ||
Address each research question (chapter may be organized by research question or patterns/themes). | ||
Present data to support each finding (quotes from transcripts, documents, etc.). | ||
Discuss discrepant cases and/or disconfirming data, as applicable. | ||
Include tables and figures to illustrate results, as appropriate, and per the current edition of the Publication Manual of the American Psychological Association. | ||
Quantitative Components | ||
Report descriptive statistics that appropriately characterize the sample. | ||
Report statistical analysis findings, organized by research questions/hypotheses, including:
| ||
Report results of post-hoc analyses of statistical tests, if applicable. | ||
Report any additional statistical tests of hypotheses that emerged from the analysis of main hypotheses, as appropriate for the study. | ||
Include tables and figures to illustrate results, as appropriate, and per the current edition of the Publication Manual of the American Psychological Association | ||
Evidence of Trustworthiness | ||
Credibility: Describe implementation of/adjustments to credibility strategies stated in chapter 3. | ||
Transferability: Describe implementation of/adjustments to transferability strategies stated in chapter 3. | ||
Dependability: Describe implementation of/adjustment to consistency strategies stated in chapter 3. | ||
Confirmability: Describe implementation of/adjustment to consistency strategies stated in chapter 3. | ||
Intra- and intercoder reliability, if applicable: Describe implementation of/adjustment to consistency strategies stated in chapter 3. | ||
Summary | ||
Summarize answers to research questions. | ||
Provide transition to chapter 5. |
CHAPTER 5 | ||
Checklist Items | Pg/NA | Comment History |
Introduction | ||
Concisely reiterate the purpose and nature of the study and why it was conducted. | ||
Concisely summarize key findings. | ||
Interpretation of the Findings | ||
Describe in what ways findings confirm, disconfirm, or extend knowledge in the discipline by comparing them with what has been found in the peer-reviewed literature described in chapter 2. | ||
Analyze and interpret the findings in the context of the theoretical and/or conceptual framework, as appropriate.
| ||
Limitations of the Study | ||
Describe the limitations to generalizability and/or trustworthiness that arose from execution of the study. These should be used to revise what was written in chapter 1 for the proposal. | ||
Recommendations | ||
Describe recommendations for further research that are grounded in the strengths and limitations of the current study as well as the literature reviewed in chapter 2.
| ||
Implications | ||
Positive Social Change | ||
| ||
| ||
Describe methodological, theoretical, and/or empirical implications, as appropriate. | ||
Describe recommendations for practice, as appropriate. | ||
Conclusion | ||
Provide a strong “take home” message that captures the key essence of the study. |
APA Form and Style Check | ||
Checklist Items | Comment History | |
Citations and Referencing | ||
All citations have been cross-checked to ensure that there are corresponding references (and that there are no references that do not have associated citations). | ||
All sources are cited correctly per APA formatting requirements (for example, studies listed in alphabetical order by first author; no first names of authors). | ||
Grammar, Spelling, and Syntax | ||
The paper has been thoroughly checked for grammar, spelling, and syntax errors. | ||
For the final dissertation, the dissertation has been checked for correct verb tense representing a completed study. | ||
Headings | ||
Headings are used, consistent with the Walden Dissertation Template, to make sections of thought distinct. | ||
Use of the Writing Center Template | ||
The Writing Center Dissertation Template (APA, 6th edition) was used to construct the proposal and/or dissertation so that all formatting is correct. |