Miss Professor
Research Evaluation Checklist
Complete the checklist below for the study/article you are to evaluate.
Define topic and need.
What phenomenon does the study investigate?
Is the phenomenon a problem, an opportunity, or a dilemma?
What symptoms (easily observable signs) indicate that it is a problem, opportunity or a dilemma?
How do people who know this organization explain these symptoms? What do administrators want to know about the phenomenon?
How can it be expressed in manageable terms?
Assess relevant knowledge.
How much is already known?
Is additional background information necessary? Should this research be conducted?
Is the topic a special case of a broader, more fundamental and important problem?
Identify variables and measures, and research questions and hypotheses.
What variables associated with the phenomenon are investigated? How are the variables measured?
What are the research questions?
What specific hypotheses are formulated?
Identify and analyze the research design.
What is the research design—exploratory, descriptive, or causal research? Is this non-experimental, quasi-experimental, or experimental research? What is the nature of data—primary or secondary?
What is the source of data—interviews, questionnaires, existing databases? Are answers obtained through interviews and questionnaires objective?
Analyze the sample.
What is the population from which the respondents have been selected? How large is the sample?
Is it random, stratified, or other sample?
Gather data.
How are data gathered?
Does the procedure of gathering data ensure objectivity?
Analyze data.
Are the data words (qualitative data) or numbers (quantitative)? How are qualitative data analyzed?
How are quantitative data recorded and checked for accuracy? What statistical methods are used to analyze data?
Assess results.
What are the answers to research questions? Are hypotheses supported?
What evidence did the study produce that helps answer research questions or support/refute hypotheses?
Evaluate recommendations.
What recommendations can be made on the basis of results?
What recommendations are made that cannot be supported with results?
Evaluate the study.
What limitations does the study have?
What improvements in research design can be recommended?
Page 3 of 3
Research Methods in Health Administration
