Educational Measurement and Evaluation
Midterm Exam
Course Introduction
Educational Measurement and Evaluation is a course designed to introduce students to the fundamental concepts, principles, and practices involved in assessing and evaluating learning outcomes within educational settings. The course explores various types of assessment tools and techniques, including formative and summative assessments, standardized tests, and classroom-based evaluations. Students will learn about reliability, validity, test construction, scoring, interpretation of results, and ethical considerations in measurement. Emphasis is placed on using assessment data to inform instruction, improve educational practices, and support student learning and development.
Recommended Textbook
Educational Research 5th Edition by
John W. Creswell
Available Study Resources on Quizplus
17 Chapters
376 Verified Questions
376 Flashcards
Source URL: https://quizplus.com/study-set/3267
Page 2
Chapter 1: The Process of Conducting Research Using Quantitative
and Qualitative Approaches
Available Study Resources on Quizplus for this Chatper
29 Verified Questions
29 Flashcards
Source URL: https://quizplus.com/quiz/64869
Sample Questions
Q1) Identify three skills that you bring to research from your life experiences.
Answer: Possible answers include:An ability to solve puzzles; an ability to write,such as letters; an ability to look up materials in the library; an ability to focus attention for a sustained period of time
Q2) List three potential shortcomings of educational research today.
Answer: Possible answers include: Lack of direct useful conclusions; contradictory or vague results; questionable data; unclear statements of intent; lack of full disclosure of data collection procedures; inadequate description of the research problem
Q3) Look at the title to the mothers' trust in school principals study (Shelden et al.,2010),"School Principals' Influence on Trust: Perspectives of Mothers of Children with Disabilities." What qualitative characteristic does this title suggest to a reader?
Answer: Participants' experiences or views of mothers of children with disabilities
Q4) Place in order from 1 to 6 the steps in the process of research:
Answer: __2__ reviewing the literature __3__ specifying a purpose __5__ analyzing and interpreting data __6__ reporting and evaluating research __4__ collecting data __1__ identifying a research problem
To view all questions and flashcards with answers, click on the resource link above.
Page 3
Chapter 2: Identifying a Research Problem
Available Study Resources on Quizplus for this Chatper
16 Verified Questions
16 Flashcards
Source URL: https://quizplus.com/quiz/64870
Sample Questions
Q1) Below you will find a narrative hook presented by a researcher in a study.Unfortunately,it is not a good narrative hook.Rewrite it to be a better hook,keeping in mind the purpose of a good hook.
Answer: The good model needs to focus on an issue or a problem,such as,"The frequency of AIDS is escalating among junior high and high school student populations today."
Q2) What characterizes the best stance on using quotes from the literature in the "statement of the problem" section of a research study?
A)Long quotes should not be used.
B)Quotes should be used sparingly.
C)Find quotes for statistical trends.
D)Short quotes should be used.
Answer: B
Q3) Read through the opening paragraphs (1-12)of the parent involvement study (Deslandes & Bertrand,2005).Of the major components that are typically included in a good "statement of the problem" section,which one is missing?
Answer: Clearly stating an issue or a problem that leads to the study
To view all questions and flashcards with answers, click on the resource link above. Page 4
Chapter 3: Reviewing the Literature
Available Study Resources on Quizplus for this Chatper
26 Verified Questions
26 Flashcards
Source URL: https://quizplus.com/quiz/64871
Sample Questions
Q1) For what reason would you be particularly cautious about using papers posted to Web sites on the Internet for your literature review?
A)The papers may be difficult to locate with the search engine.
B)The papers would take a long time to print out.
C)The papers may not be screened for high quality.
D)The papers may be off-topic to the topic you plan to study.
Answer: C
Q2) Take a topic of your choice and identify five steps that you would use to conduct a computer search of the ERIC database.These steps need not necessary be listed in order for them to be correct.
Answer: Potential answer for steps in this process include:Answer:Identifying terms to search Answer:Logging on the ERIC Web site page or going to the library and using the ERIC CD-ROM system Answer:Entering key terms on the search page Answer:Narrowing the search to journal articles and research studies Answer:Limiting the search to specific years Answer:Reviewing the search results Answer: Examining specific search abstracts for studies Answer:Locating studies in the library
To view all questions and flashcards with answers, click on the resource link above.
Page 5
Chapter 4: Specifying a Purpose and Research Questions or
Hypotheses
Available Study Resources on Quizplus for this Chatper
29 Verified Questions
29 Flashcards
Source URL: https://quizplus.com/quiz/64872
Sample Questions
Q1) In the following quantitative purpose statement,indicate the intervening variable:
A)College students
B)Self-esteem
C)Social interactions
D)High grades
Q2) What are four elements are present?
Q3) The difference between a hypothesis and a research question is that the hypothesis
A)predicts what the researcher will expect to find.
B)hypothesizes the relationship among variables.
C)is a statement of fact rather than a question.
D)requires statistical testing in a research study.
Q4) Identify the dependent variables:
Q5) Rewrite this poor example of a qualitative central research question:
Q6) In the mothers' trust in school principals study (Shelden et al.,2010),the authors advance in paragraph 14 the question: "What are the perspectives of mothers of children with disabilities on trust in school principals?" What is the central phenomenon being explored in this study that can be gleaned from this question?
Page 6
To view all questions and flashcards with answers, click on the resource link above.
Chapter 5: Collecting Quantitative Data
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64873
Sample Questions
Q1) In the question below,indicate the type of scale used by the author:
Q2) In the parent involvement study,Deslandes and Bertrand (2005)mentioned the following in paragraph 18,about the variable,"parents role:"
Q3) Various forms of evidence can be used to establish the validity of scores on an instrument.Which of the following forms is a source of validity evidence that you might use?
A)Evidence based on the test scores at two different times
B)Evidence based on the ratings of multiple observers
C)Evidence based on the consistency of the test scores
D)Evidence based on the relationship of test scores to external variables
Q4) Snowball sampling is illustrated with which of the following procedures?
A)A researcher accumulates participants over time in the design.
B)A researcher asks a principal to have her teachers fill out instruments.
C)A researcher uses a random numbers table to select participants.
D)A researcher selects individuals who are willing to participate.
Q5) Describe the purpose of having an informed consent form in a research study:
To view all questions and flashcards with answers, click on the resource link above. Page 7
Chapter 6: Analyzing and Interpreting Quantitative Data
Available Study Resources on Quizplus for this Chatper
26 Verified Questions
26 Flashcards
Source URL: https://quizplus.com/quiz/64874
Sample Questions
Q1) Briefly define the standard deviation.
Q2) If a researcher sets the alpha at .05 and obtains a p value of .06,this means that a null hypothesis would
A)fail to be rejected.
B)be slightly higher than alpha.
C)be very close to the alpha level.
D)be accepted as different.
Q3) Briefly define the mean.
Q4) When inspecting data,we examine the database for scores that are A)outside of the mean.
B)outside of the median.
C)outside of the accepted range.
D)outside of the standard deviation.
Q5) Why it is important to check for effect size in addition to hypothesis testing?
Q6) In the parent involvement study (Deslandes & Bertrand,2005),the researchers state a finding in paragraph 27:
A)that the results were statistically significant.
B)that the probability alpha level was set too low.
C)that the authors should have set an exact p value.
Page 8
D)that the partial results indicated a significant p value of .001.
To view all questions and flashcards with answers, click on the resource link above.
Chapter 7: Collecting Qualitative Data
Available Study Resources on Quizplus for this Chatper
25 Verified Questions
25 Flashcards
Source URL: https://quizplus.com/quiz/64875
Sample Questions
Q1) Which of the following points is most important when conducting qualitative interviews?
A)Take good field notes.
B)Find an open site for the interview.
C)Audio-record the questions and responses.
D)Obtain consent when the research is completed.
Q2) You are recording information on your observational protocol.What type of notes would you record on this protocol?
A)Participant fieldnotes
B)Reflective fieldnotes
C)Observational fieldnotes
D)Audio fieldnotes
Q3) Which one of the following provides a good reason for why qualitative researchers select only a few participants?
A)The number of people available is typically small.
B)With each additional participant,less depth is possible.
C)The individuals who can answer the questions are few.
D)The researcher does not want to generalize findings.
Q4) List two of the steps when collecting audio-visual material in qualitative research.
To view all questions and flashcards with answers, click on the resource link above. Page 9
Chapter 8: Analyzing and Interpreting Qualitative Data
Available Study Resources on Quizplus for this Chatper
19 Verified Questions
19 Flashcards
Source URL: https://quizplus.com/quiz/64876
Sample Questions
Q1) Read through the following transcript passage.
a.First code word(s)_________________________
b.First code word(s)lines _____________________
c.Second code word(s)_______________________
d.Second code word(s)lines ___________________
Q2) What does the term,"simultaneous" mean in the process of qualitative data analysis?
A)Returning back and forth between collecting and coding data
B)Coding data,collecting data,and writing a description at the same time
C)The processes of transcribing and analyzing data are coordinated
D)The data collection,analysis,and reporting writing are distinct phases
Q3) The point at which themes are fully developed and new evidence is not likely to provide additional themes is
A)validation.
B)saturation.
C)thematic conclusion.
D)authentication.
Q4) What is a narrative discussion in qualitative research?
Q5) List the five elements to include in the final section in which you interpret findings for a qualitative study?
To view all questions and flashcards with answers, click on the resource link above. Page 10
Chapter 9: Reporting and Evaluating Research
Available Study Resources on Quizplus for this Chatper
23 Verified Questions
23 Flashcards
Source URL: https://quizplus.com/quiz/64877
Sample Questions
Q1) Why would a researcher want to "encode" a research report with good research terms?
A)It shows that the researcher knows how to conduct research.
B)It shows the coding process used in qualitative research.
C)It shows the audience that the study should be published.
D)It shows how much the researcher understands.
Q2) You are looking at a journal article from a leading educational journal.You are trying to identify its physical structure.The following are good strategies to use to identify the structure EXCEPT?
A)You examine the number and type of levels of headings in the report.
B)You search for how the author answered each of the research questions.
C)You examine the number of pages given to each section of the study.
D)You locate the six steps in the process of research.
Q3) A qualitative study should be evaluated in terms of whether the researcher includes multiple levels of data analysis.This is an example of standard _____.
A)Participatory evaluation standards
B)Procedural evaluation standards
C)Philosophical evaluation standards
Q4) What evidence from the passage are you basing your decision on? Be specific.
To view all questions and flashcards with answers, click on the resource link above. Page 11
Chapter 10: Experimental Designs
Available Study Resources on Quizplus for this Chatper
19 Verified Questions
19 Flashcards
Source URL: https://quizplus.com/quiz/64878
Sample
Questions
Q1) You are conducting an experiment with several school districts to identify if district goal setting as a treatment influences the outcome of high student achievement in the districts.Your experimental unit of analysis would be
A)an organization.
B)the school districts.
C)schools in the school districts.
D)students in the school districts.
Q2) You read a journal article in which the researcher compares two existing third grade classrooms,one using a new behavioral management approach and the other using the usual approach.The researcher did not randomly assign the approach.What type of design is this study?
A)Quasi-experimental design
B)Dual group design
C)Experimental design
D)Within-group design
Q3) In this experimental study,what was the dependent variable or outcome assessed in the study?
Q4) Define what is meant by a threat to internal validity.
Q5) Define what is meant by a threat to external validity.
To view all questions and flashcards with answers, click on the resource link above. Page 12
Chapter 11: Correlational Designs
Available Study Resources on Quizplus for this Chatper
22 Verified Questions
22 Flashcards
Source URL: https://quizplus.com/quiz/64879
Sample Questions
Q1) A researcher collects scores for male and female students and scores running from a 50 to a 99 on a math final test.This researcher is interested in correlating these scores to determine if there is an association between gender and test scores.What correlation statistic would this researcher use?
A)Pearson correlation statistic
B)Phi-coefficient statistic
C)Point-biserial correlation
D)Regression statistic
Q2) Correlational designs have benefited from what quantitative developments in the history of research?
A)The development of computers
B)The refinements in the calculations of correlations
C)The measurement of continuous variables
D)The identification of multiple variables to measure
Q3) Why are some cells left blank?
Q4) Examine Table 1,the correlation matrix of all of the variables in the study.What
Q5) What pattern of association would you expect to find if the scores were plotted for the variable,funding,and the variable,number of teachers?
Q6) What association is the strongest of all of the variables in the matrix?
Page 13
To view all questions and flashcards with answers, click on the resource link above.
Chapter 12: Survey Designs
Available Study Resources on Quizplus for this Chatper
21 Verified Questions
21 Flashcards
Source URL: https://quizplus.com/quiz/64880
Sample Questions
Q1) A researcher conducts a study of adolescents and their smoking behaviors.In reporting the results,the researcher mentions the names of specific students who are only occasional smokers.What specific ethical issue is presented in this study?
A)The issue of studying and reporting on a sensitive topic
B)The issue of putting the students at risk of encouraging smoking
C)The issue of linking specific participants with identifiable information
D)The issue of not destroying survey instrument after the study concludes
Q2) Select the best reason for conducing a pilot test of a questionnaire.
A)To provide response data to begin analyzing sooner
B)To improve the response rate for the questionnaire
C)To prenotify participants of your intent to send the questionnaire
D)To determine that the individuals in the sample can understand the questions
Q3) What factor best distinguishes among the different types of quantitative survey designs?
A)The time when data are collected
B)The study of one group at one point in time
C)The collection of questionnaire or interview data
D)The use of longitudinal data over time
Q4) Was this an example of longitudinal or cross-sectional research?
To view all questions and flashcards with answers, click on the resource link above. Page 14
Chapter 13: Grounded Theory Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64881
Sample Questions
Q1) Which one of the following is a key characteristic of the constructivist approach to grounded theory advanced by Charmaz?
A)The use of predetermined categories in axial coding
B)The development of strong conclusions about the data.
C)The use of active codes that capture life experiences
D)The use of diagrams or conceptual maps
Q2) You are looking at a figure of an axial coding paradigm in grounded theory research.You might see the following boxes of information EXCEPT A)causal conditions.
B)intervening conditions.
C)themes.
D)strategies.
Q3) What statement below BEST captures why a grounded theorist engages in memoing during a study?
A)To keep a daily log of activities during the study
B)To send ideas to other researchers on the team
C)To elaborate on ideas in the data and in the categories
D)To reflect on the emerging theory that has been developed
Q4) Identify the process being explored in this grounded theory study.
To view all questions and flashcards with answers, click on the resource link above. Page 15
Chapter 14: Ethnographic Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64882
Sample Questions
Q1) A researcher is conducing a case study of three teachers within a school.Which of the following data collection procedures is the researcher most likely to take?
A)Spend at least four months in the classrooms collecting data.
B)Emphasize fieldnotes and observations of the school's cultural scene.
C)Focus on active collaboration between the researcher and teachers.
D)Collect as many types of data as possible for an in-depth understanding.
Q2) An ethnographer concludes a study with an interpretation of the shared patterns of behavior of teenage skateboarders in a middle school.What aspects is this ethnographer likely to include in this interpretation?
A)A cultural theme that provided a framework for the study
B)An identification of three patterns of behavior shown by the teenagers
C)A detailed description of the challenges skateboarders give themselves
D)The personal meaning of skateboarding for each teenager
Q3) What is the culture-sharing group that this researcher is exploring?
Q4) Reflexivity in ethnography means:
A)The researcher has good reflexes and can sense things.
B)The researcher openly discusses the participant views.
C)The researcher openly discusses her or his role in the study.
D)The researcher comments on why he/she undertook the study
To view all questions and flashcards with answers, click on the resource link above. Page 16
Chapter 15: Narrative Research Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64883
Sample Questions
Q1) When narrative researchers describe focusing in on individual experiences,they are referring to
A)learning how individuals experience personal situations.
B)learning how individuals experience their families.
C)learning how individuals experience their lives through storytelling.
D)learning how individuals experience life through the process of focusing.
Q2) Which of the following is the best strategy for validating the accuracy of the report?
A)Send the report to an expert to review for accuracy.
B)Write the narrative in the same order as the audio transcription.
C)Seek approval from an institutional review board.
D)Collect journals and photographs in addition to interviews.
Q3) In narrative research,these are the movements of individuals through the story illustrating the character's thinking or behaviors.What is this narrative element?
A)Characters
B)Actions
C)Problem
D)Resolution
Q4) List three of the criteria for evaluating a narrative research
To view all questions and flashcards with answers, click on the resource link above.
17
Chapter 16: Mixed Methods Designs
Available Study Resources on Quizplus for this Chatper
21 Verified Questions
21 Flashcards
Source URL: https://quizplus.com/quiz/64884
Sample Questions
Q1) The mixed methods researcher collects quantitative data in the first sequence followed by qualitative interviews.The design is most likely
A)convergent.
B)explanatory sequential.
C)exploratory sequential.
D)transformative.
Q2) List three of the criteria for evaluating a mixed methods study.
Q3) The mixed methods researcher gives equal priority to both quantitative and qualitative data.This design is most likely
A)convergent.
B)explanatory sequential.
C)exploratory sequential.
D)transformative.
Q4) What potential ethical issue is most relevant to a study using an experimental design?
A)Participants may be further marginalized during the study.
B)The researcher may minimize the importance of a sample because of its size.
C)Interviews conducted during the intervention may influence outcomes.
D)Potentially disrupting the research sites.
To view all questions and flashcards with answers, click on the resource link above. Page 18
Chapter 17: Action Research Designs
Available Study Resources on Quizplus for this Chatper
20 Verified Questions
20 Flashcards
Source URL: https://quizplus.com/quiz/64885
Sample Questions
Q1) To change a mixed methods research study into an action research study calls for
A)mixing the quantitative and qualitative data less in the study.
B)placing more action into the research plan.
C)focusing the study more on developing a plan to solve a problem.
D)using essentially the same multiple forms of data collection.
Q2) Of the factors listed below,which ones are common between practical action research and participatory action research?
A)The focus on teacher professional development
B)The intent to advocate for individuals in the community
C)The use of action plans to address issues
D)The result in an emancipated researcher
Q3) What is the practical problem that Heil hopes to solve in this action research study?
Q4) The group most responsible for encouraging the use of action research has been
A)teachers who would like to grow and develop as professionals.
B)school principals and superintendent who support education reform.
C)researchers in universities and colleges who support practice.
D)students who seek to improve their skills and enhance their learning.
Q5) In what way does Heil's project illustrate the cyclical nature of action research?
To view all questions and flashcards with answers, click on the resource link above. Page 19