Educational Measurement and Evaluation Exam Review
Course Introduction
Educational Measurement and Evaluation explores the foundational principles and techniques used to assess student learning and educational outcomes. The course covers key topics such as test construction, types of assessments, reliability and validity, scaling, and interpretation of test scores. Students will learn how to design fair and effective assessments, use quantitative and qualitative data to evaluate educational processes, and apply statistical tools for measurement accuracy. Emphasis is placed on ethical considerations, practical challenges of implementing assessments in diverse classroom settings, and the use of evaluation results for improving teaching and learning.
Recommended Textbook
Educational Research 5th Edition by
John W. Creswell
Available Study Resources on Quizplus
17 Chapters
376 Verified Questions
376 Flashcards
Source URL: https://quizplus.com/study-set/3267
Page 2
Chapter 1: The Process of Conducting Research Using Quantitative
and Qualitative Approaches
Available Study Resources on Quizplus for this Chatper
29 Verified Questions
29 Flashcards
Source URL: https://quizplus.com/quiz/64869
Sample Questions
Q1) Describe three ways in which a research study might contribute to knowledge about an educational topic.
Answer: Possible answers include: It adds to knowledge; it adds to practice; it lifts up the voices of participants; it informs policy debates and decisions.
Q2) Which of the following is the best reason for selecting either a quantitative or qualitative approach to your study?
A)You are more comfortable with words than numbers.
B)Your research problem addresses characteristics of one of the approaches.
C)You already have a survey to use.
D)Your literature review suggests one of the approaches.
Answer: B
Q3) A researcher decides to study an elementary-school classroom.This investigator wants to surprise the teacher and the students and comes in to the class unannounced during a spelling test.Describe the type of ethical issue that arises in this situation.
Answer: The ethical issue involved is one of honoring a research site and not wanting to disturb it unnecessarily.
To view all questions and flashcards with answers, click on the resource link above. Page 3
Chapter 2: Identifying a Research Problem
Available Study Resources on Quizplus for this Chatper
16 Verified Questions
16 Flashcards
Source URL: https://quizplus.com/quiz/64870
Sample Questions
Q1) In order to justify the importance of a research problem in a statement of the problem section of a study,the researcher might use all of the following sources except?
A)Draw on personal experiences
B)Rely on the advice of experts
C)Use results to develop an incomplete theory
D)Talk with colleagues in the workplace
Answer: D
Q2) Look at paragraph 4 of the mothers' trust in school principals study (Shelden et al.,2010).On what basis do the authors justify the need to study the research problem?
Answer: Evidence from past research studies
Q3) Why would a researcher mention the audience in a "statement of the problem" section of a study?
A)Because members of the audience need to use the study
B)Because members of the audience will vote to publish the study
C)Because members of the audience will want to use the study
D)Because members of the audience need to see the study's relevance
Answer: D
To view all questions and flashcards with answers, click on the resource link above. Page 4
Chapter 3: Reviewing the Literature
Available Study Resources on Quizplus for this Chatper
26 Verified Questions
26 Flashcards
Source URL: https://quizplus.com/quiz/64871
Sample Questions
Q1) You are examining a research study that you have found in your literature search.The task now is to determine if the study is a relevant one to use in your literature review.What factor below is NOT a criterion that you might employ?
A)The literature focuses on the same topic as your proposed study.
B)The literature examines the same population that you plan to study.
C)The literature can be located and obtained from your academic library.
D)The literature is in a readily accessible form,such as an online journal.
Answer: D
Q2) Identify how you would narrow your computerized ERIC search to research studies so that you capture important data-based studies on your topic.
Answer: You can combine your topic terms with "research" to narrow your search to research studies.
Q3) The literature review in the beginning of a quantitative study helps to
A)establish the central role of literature in the study.
B)reduce the role of the literature in the study.
C)specify the variables importance for the questions.
D)predict the results in the study.
Answer: C
To view all questions and flashcards with answers, click on the resource link above.
Page 5
Chapter 4: Specifying a Purpose and Research Questions or
Hypotheses
Available Study Resources on Quizplus for this Chatper
29 Verified Questions
29 Flashcards
Source URL: https://quizplus.com/quiz/64872
Sample Questions
Q1) In the mothers' trust in school principals study (Shelden et al.,2010),the authors advance in paragraph 14 the question: "What are the perspectives of mothers of children with disabilities on trust in school principals?" What is the central phenomenon being explored in this study that can be gleaned from this question?
Q2) What is the independent variable?
Q3) The difference between a hypothesis and a research question is that the hypothesis
A)predicts what the researcher will expect to find.
B)hypothesizes the relationship among variables.
C)is a statement of fact rather than a question.
D)requires statistical testing in a research study.
Q4) Select the best reason below for why a purpose statement is important.
A)It justifies the problem for the reader.
B)It informs the reader of the central ideas addressed in your study.
C)It provides the reader with the question you are attempting to answer.
D)It informs the reader of your predictions about relationships among attributes.
Q5) Identify the independent variables:
Q6) What is the dependent variable?
Page 6
To view all questions and flashcards with answers, click on the resource link above.
Chapter 5: Collecting Quantitative Data
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64873
Sample Questions
Q1) The researcher has a list of all students in the elementary school that have been designated as "gifted" students.In the process of quantitative data collection,this list represents
A)the target population of "gifted" students.
B)the population of "gifted" students.
C)the random sample of "gifted" students.
D)the mailing list of "gifted" students.
Q2) Which of the following is the best example of a unit of analysis level in quantitative data collection?
A)Trust
B)Gender
C)Individual
D)Social-interaction
Q3) In the question below,indicate the type of scale used by the author:
Q4) What is the most rigorous sampling procedure that a quantitative researcher could use?
A)Simple random sampling
B)Systematic cluster sampling
C)Randomized design sampling
D)Selective study sampling
To view all questions and flashcards with answers, click on the resource link above. Page 7
Chapter 6: Analyzing and Interpreting Quantitative Data
Available Study Resources on Quizplus for this Chatper
26 Verified Questions
26 Flashcards
Source URL: https://quizplus.com/quiz/64874
Sample Questions
Q1) Which of the following is a possible outcome of hypothesis testing?
A)The beta weight of the null
B)The probability of chi
C)The effect size
D)The probability of alpha
Q2) Briefly define the z score.
Q3) Briefly define the standard deviation.
Q4) Which of the following factors is most important to consider in selecting an appropriate statistical test for a quantitative study?
A)How many independent variables are in the data
B)Whether the codes suggest it is appropriate
C)How many research questions are in the study
D)Whether the independent variable relates to the question
Q5) The following steps are procedures in quantitative data analysis EXCEPT
A)examining the trends in the data.
B)determining effect sizes.
C)scoring the data.
D)analyzing the differences among themes.
Q6) Why it is important to check for effect size in addition to hypothesis testing?
Q7) Briefly define the mean.
To view all questions and flashcards with answers, click on the resource link above. Page 8
Chapter 7: Collecting Qualitative Data
Available Study Resources on Quizplus for this Chatper
25 Verified Questions
25 Flashcards
Source URL: https://quizplus.com/quiz/64875
Sample Questions
Q1) One of the greatest disadvantages of conducing telephone interviews is that
A)the researcher will not be able to record the interview.
B)the researcher will not have probes in the protocol.
C)the researcher may not be able to understand the interviewee's perceptions as well.
D)the researcher may have difficulty taking notes during the interview.
Q2) What a disadvantage of using interviews in qualitative research?
A)You cannot measures the variables.
B)You cannot record ice-breakers in the conversation.
C)The researcher hears what the interviewer wants to hear.
D)The data are filtered through the researcher's lens.
Q3) Ethical issues often arise in collecting qualitative data.Which one of the following situations may raise an ethical issue in qualitative research?
A)Participants may disclose sensitive information during interviews.
B)Participants may talk openly about their indigenous culture.
C)Participants may sign a waiver providing information to the researcher.
D)Participants may withhold important information during an interview.
Q4) List two of the steps when collecting audio-visual material in qualitative research.
To view all questions and flashcards with answers, click on the resource link above. Page 9
Chapter 8: Analyzing and Interpreting Qualitative Data
Available Study Resources on Quizplus for this Chatper
19 Verified Questions
19 Flashcards
Source URL: https://quizplus.com/quiz/64876
Sample Questions
Q1) The following are forms for presenting findings visually in qualitative research EXCEPT?
A)A comparison table of teacher and student views
B)A graph showing the interconnection of themes
C)A demographic table indicating personal characteristics
D)A table that presents significant results in the study
Q2) List the five elements to include in the final section in which you interpret findings for a qualitative study?
Q3) The point at which themes are fully developed and new evidence is not likely to provide additional themes is
A)validation.
B)saturation.
C)thematic conclusion.
D)authentication.
Q4) What advice would you give someone who needs to transcribe an audio recording from an interview? List four recommendations.
Q5) What is a narrative discussion in qualitative research?
To view all questions and flashcards with answers, click on the resource link above. Page 10
Chapter 9: Reporting and Evaluating Research
Available Study Resources on Quizplus for this Chatper
23 Verified Questions
23 Flashcards
Source URL: https://quizplus.com/quiz/64877
Sample Questions
Q1) A qualitative researcher discusses how she came to compose the narrative and the reasons for her stance in the study.This is an example of standard _____.
A)Participatory evaluation standards
B)Procedural evaluation standards
C)Philosophical evaluation standards
Q2) You are looking at a journal article from a leading educational journal.You are trying to identify its physical structure.The following are good strategies to use to identify the structure EXCEPT?
A)You examine the number and type of levels of headings in the report.
B)You search for how the author answered each of the research questions.
C)You examine the number of pages given to each section of the study.
D)You locate the six steps in the process of research.
Q3) What do you find missing in this example of a poor model of balancing research and content?
Q4) List the five sections typically found in a quantitative research report in the order in which you would find them stated:
Q5) Rewrite the model to improve its balance.
Q6) What evidence from the passage are you basing your decision on? Be specific.
To view all questions and flashcards with answers, click on the resource link above. Page 11
Chapter 10: Experimental Designs
Available Study Resources on Quizplus for this Chatper
19 Verified Questions
19 Flashcards
Source URL: https://quizplus.com/quiz/64878
Sample Questions
Q1) In an experiment,this type of group receives an alternative form of the treatment so that they benefit from the study.
A)Experimental group
B)Control group
C)Comparison group
D)Alternate group
Q2) Why are groups compared in an experiment?
A)Because they differ in important characteristics
B)To isolate whether the treatment affects the outcome
C)To identify if the groups statistically differ
D)To eliminate whether groups have different experiences
Q3) Which one of the following is a characteristic of an experiment?
A)Participants self-assign into the intervention or control
B)Allow a deep understanding of the participants' experiences
C)Allow researchers to compare groups
D)Have no threats to validity
Q4) Define what is meant by a threat to internal validity.
Q5) In this experiment,did the experimental treatment groups (token-economy structure and the contingency-contract structure)outperform the control group in terms of the outcome? Justify your response.
To view all questions and flashcards with answers, click on the resource link above. Page 12
Chapter 11: Correlational Designs
Available Study Resources on Quizplus for this Chatper
22 Verified Questions
22 Flashcards
Source URL: https://quizplus.com/quiz/64879
Sample Questions
Q1) A researcher collects scores for male and female students and scores running from a 50 to a 99 on a math final test.This researcher is interested in correlating these scores to determine if there is an association between gender and test scores.What correlation statistic would this researcher use?
A)Pearson correlation statistic
B)Phi-coefficient statistic
C)Point-biserial correlation
D)Regression statistic
Q2) A researcher conducting a study examining the influence of stress on achievement in a middle school draws the conclusion that stress causes low achievement scores.What correlational ethical issue is the researcher breaching?
A)The ethical issue of seeking permissions from school personnel to conduct the study.
B)The ethical issue of data reporting and potentially reporting contradictory findings.
C)The ethical issue of establishing causality when the results show patterns of relationships.
D)The ethical issue of reporting an association between scores when causality exists.
To view all questions and flashcards with answers, click on the resource link above.
Chapter 12: Survey Designs
Available Study Resources on Quizplus for this Chatper
21 Verified Questions
21 Flashcards
Source URL: https://quizplus.com/quiz/64880
Sample Questions
Q1) A researcher conducts a study of adolescents and their smoking behaviors.In reporting the results,the researcher mentions the names of specific students who are only occasional smokers.What specific ethical issue is presented in this study?
A)The issue of studying and reporting on a sensitive topic
B)The issue of putting the students at risk of encouraging smoking
C)The issue of linking specific participants with identifiable information
D)The issue of not destroying survey instrument after the study concludes
Q2) Which of the following issues regarding response rates would be most concerning to survey researchers?
A)The response rate is less than 50%.
B)The responses rate did not improve after follow-up.
C)The incentive did not appear to be successful.
D)The responses returned indicate response bias.
Q3) What factor best distinguishes among the different types of quantitative survey designs?
A)The time when data are collected
B)The study of one group at one point in time
C)The collection of questionnaire or interview data
D)The use of longitudinal data over time
To view all questions and flashcards with answers, click on the resource link above.
Page 14
Chapter 13: Grounded Theory Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64881
Sample Questions
Q1) List two forms of evidence in this study that suggests the type of grounded theory design that you identified in the last question.
Q2) Since interviewing is often a central means of gathering data in a grounded theory study,what potential ethical issue might arise when conducting a grounded theory interview?
A)The interviewer exercising power and authority over the interviewee.
B)The interviewer talking too much about his/her position on the subject.
C)The interviewer taking up too much time from the interviewee.
D)The interview scheduled for a room with others in it.
Q3) In the definition of grounded theory design,the factors listed below are characteristics of this design EXCEPT
A)it involves qualitative procedures.
B)it explains a process.
C)it uses a sample from a population.
D)it provides a broad,conceptual explanation.
Q4) Of the three different designs within grounded theory researchsystematic,emerging,and constructivist - which approach did the authors use?
Q5) Identify the process being explored in this grounded theory study.
To view all questions and flashcards with answers, click on the resource link above. Page 15
Chapter 14: Ethnographic Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64882
Sample Questions
Q1) Why are ethical issues in ethnography often associated with the data collection phase of research?
A)In data collection,this phase is the most rigorous aspect of the research.
B)In data collection,ethnographers often are invasive of personal space.
C)In data collection,ethnographers often spend extensive time in the field.
D)In data collection,ethnographers ask personal questions.
Q2) In ethnographic fieldwork,information supplied by the participants in a study is known as
A)emic data.
B)negotiation data.
C)etic data.
D)fieldwork data.
Q3) An ethnographer concludes a study with an interpretation of the shared patterns of behavior of teenage skateboarders in a middle school.What aspects is this ethnographer likely to include in this interpretation?
A)A cultural theme that provided a framework for the study
B)An identification of three patterns of behavior shown by the teenagers
C)A detailed description of the challenges skateboarders give themselves
D)The personal meaning of skateboarding for each teenager
Q4) What is the culture-sharing group that this researcher is exploring?
Page 16
To view all questions and flashcards with answers, click on the resource link above.
Chapter 15: Narrative Research Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64883
Sample Questions
Q1) A narrative researcher has collected stories from a research participant through five hours of conversations.These conversations are transcribed.In order to tell the story of this individual,the researcher now needs to analyze the transcriptions.From the options listed below,what is the researcher primarily looking for as she analyzes the text?
A)A theory of the individual's life experiences
B)The stories about how the culture of the individual works
C)The themes that emerge from the conversations
D)The key elements of the individual's story
Q2) A researcher wishes to study Hispanic adolescents who are recent immigrants to an urban high school.The inquirer wishes to advocate for these adolescents and identify the types of issues that may hinder their assimilation into the high school.In a narrative research study,this inquirer is using
A)high school student stories.
B)a theoretical lens.
C)a lens of oppression.
D)an assimilation perspective.
Q3) List three of the criteria for evaluating a narrative research
To view all questions and flashcards with answers, click on the resource link above. Page 17
Chapter 16: Mixed Methods Designs
Available Study Resources on Quizplus for this Chatper
21 Verified Questions
21 Flashcards
Source URL: https://quizplus.com/quiz/64884
Sample Questions
Q1) A mixed methods researcher needs to identify how she will analyze the data from her study.What criterion is best to use to identify her qualitative data analysis strategy?
A)She should consider identifying descriptions and themes.
B)She needs to match her data analysis strategy to her design.
C)She needs to analyze both quantitative and qualitative data.
D)She needs to identify how others have analyzed data in similar studies.
Q2) Of the factors listed below,which one is a disadvantage of using mixed methods research?
A)The two forms of data may yield multiple perspectives.
B)The design requires extensive data collection that may stretch a researcher's resources.
C)The design is a newer approach to research relative to quantitative and qualitative.
D)The design cannot incorporate a theory.
Q3) In a convergent design,ethical issues may arise when the researcher
A)first converges the data.
B)begins to give unequal weight to one form of data.
C)involves other researchers in a study.
D)draws interpretations from unequal sample sizes.
To view all questions and flashcards with answers, click on the resource link above. Page 18
Chapter 17: Action Research Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64885
Sample Questions
Q1) Peg is an elementary school teacher who has just completed an action research study and written a report.She is most likely to share the report
A)by submitting it to a scholarly journal for publication.
B)by preparing into a book for publication and wide dissemination.
C)by sending it to other teachers who can immediately use the results.
D)by sending it to university researchers for use in their practices.
Q2) A researcher plans to study how a community supports or does not support a bond issue.This researcher plans to conduct action research and gather both quantitative and qualitative data.The intent of this researcher is further to lobby with the city council for better schools for minority children.What type of action research design should this researcher use?
A)An advocacy action research design
B)A mixed methods action research design
C)A participatory action research design
D)A practical action research design
Q3) In what way does Heil's project illustrate the cyclical nature of action research?
Q4) In what ways did Heil's project involve the collection of both quantitative and qualitative data?
To view all questions and flashcards with answers, click on the resource link above.
Page 19