T
INTERNATIONAL DE VELOPMENT IN FOCUS
his book presents the main findings of a study on school learning environments and student outcomes, which the World Bank conducted in 2019 in three regions of the Russian Federation. Using data collected through the OECD School User Survey and the pilot “Trends in Mathematics and Science Study” (TIMSS), the book analyzes how a school’s infrastructure and learning environment may affect the progress and success of students in math and science. It also delves into teaching practices, analyzing their impact on learning and highlighting the important nexus between learning environments and teaching methods. The book concludes by recommending areas in which focused attention by educational authorities could improve educational policy and help maintain high-quality learning environments. The book will be useful for educators, school principals, architects, and policy makers who are involved in school infrastructure projects and are interested in increasing their knowledge of school design planning.
Learning Environments and Learning Achievement in the Russian Federation How School Infrastructure and Climate Affect Student Success Tigran Shmis, Maria Ustinova, and Dmitry Chugunov
ISBN 978-1-4648-1499-0
SKU 211499
9781464814990_Cover.indd All Pages
27/11/19 1:03 PM
INTERNATIONAL DEVELOPMENT IN FOCUS
Learning Environments and Learning Achievement in the Russian Federation How School Infrastructure and Climate Affect Student Success
TIGRAN SHMIS, MARIA USTINOVA, AND DMITRY CHUGUNOV
© 2020 International Bank for Reconstruction and Development /The World Bank 1818 H Street NW, Washington, DC 20433 Telephone: 202-473-1000; Internet: www.worldbank.org Some rights reserved 1 2 3 4 22 21 20 19 Books in this series are published to communicate the results of Bank research, analysis, and operational experience with the least possible delay. The extent of language editing varies from book to book. This work is a product of the staff of The World Bank with external contributions. The findings, interpretations, and conclusions expressed in this work do not necessarily reflect the views of The World Bank, its Board of Executive Directors, or the governments they represent. The World Bank does not guarantee the accuracy of the data included in this work. The boundaries, colors, denominations, and other information shown on any map in this work do not imply any judgment on the part of The World Bank concerning the legal status of any territory or the endorsement or acceptance of such boundaries. Nothing herein shall constitute or be considered to be a limitation upon or waiver of the privileges and immunities of The World Bank, all of which are specifically reserved. Rights and Permissions
This work is available under the Creative Commons Attribution 3.0 IGO license (CC BY 3.0 IGO) http:// creativecommons.org/licenses/by/3.0/igo. Under the Creative Commons Attribution license, you are free to copy, distribute, transmit, and adapt this work, including for commercial purposes, under the following conditions: Attribution—Please cite the work as follows: Shmis, Tigran, Maria Ustinova, and Dmitry Chugunov. 2020. Learning Environments and Learning Achievement in the Russian Federation: How School Infrastructure and Climate Affect Student Success. International Development in Focus. Washington, DC: World Bank. doi:10.1596/978-1-4648-1499-0 License: Creative Commons Attribution CC BY 3.0 IGO Translations—If you create a translation of this work, please add the following disclaimer along with the attribution: This translation was not created by The World Bank and should not be considered an official World Bank translation. The World Bank shall not be liable for any content or error in this translation. Adaptations—If you create an adaptation of this work, please add the following disclaimer along with the attribution: This is an adaptation of an original work by The World Bank. Views and opinions expressed in the adaptation are the sole responsibility of the author or authors of the adaptation and are not endorsed by The World Bank. Third-party content—The World Bank does not necessarily own each component of the content contained within the work. The World Bank therefore does not warrant that the use of any third-party-owned individual component or part contained in the work will not infringe on the rights of those third parties. The risk of claims resulting from such infringement rests solely with you. If you wish to re-use a component of the work, it is your responsibility to determine whether permission is needed for that re-use and to obtain permission from the copyright owner. Examples of components can include, but are not limited to, tables, figures, or images. All queries on rights and licenses should be addressed to World Bank Publications, The World Bank Group, 1818 H Street NW, Washington, DC 20433, USA; e-mail: pubrights@worldbank.org. ISBN: 978-1-4648-1499-0 DOI: 10.1596/978-1-4648-1499-0 Cover photo: © Tigran Shmis, School of Moscow City University. Used with permission; further permission required for reuse. Cover design: Debra Naylor /Naylor Design Inc.
Contents
Acknowledgments v About the Authors vii Executive Summary ix Abbreviations xi
CHAPTER 1 Introduction 1 Background 1 Research questions and methodology of the study 4 Notes 6 References 7
CHAPTER 2 Results and Discussion 9 The physical environment and its use 9 School environment and climate 13 Teaching practices and learning outcomes 21 Discussion 25 Notes 28 References 29
CHAPTER 3 Recommendations and Conclusion 31 Recommendations for policy makers 31 Conclusion 33 Reference 33
Boxes 2.1 2.2
Denmark: School design with the users 26 Australia: Demand for new layouts 27
Figures .1 1 1.2 1.3 2.1 2.2 2.3 2.4 2.5 2.6 2.7
Learning environments for better educational outcomes 4 Structure of the OECD School User Survey questionnaires 5 Data connectivity for the study 6 Frequency of use of spaces by students and teachers in a typical week 10 Teachers’ agreement with statements about moving furniture 11 Frequency of spatial arrangements by teachers 11 Use of external (outside) spaces by students and teachers 12 Availability of technologies and frequency of use 13 The stimulation, individualization, and naturalness model 14 Temperature felt by students and teachers when it is cold outside 14 iii
iv |
Learning Environments and Learning Achievement in the Russian Federation
2.8 2.9 .10 2 2.11 .12 2 2.13 2.14 .15 2 2.16 2.17 2.18 2.19 2.20 .21 2 2.22 2.23 .24 2 2.25 .26 2 2.27
Air quality felt by students and teachers in spaces where lessons or study takes place 15 Perceived visual quality of natural light by students and teachers in the learning spaces when it is daylight outside 15 Perceived auditory quality by students and teacher in learning spaces 15 Perceived temperature, air, visual, and auditory quality and student scores in math and science 16 School leadership and culture 17 Average satisfaction with school spaces 17 Students’ perception of feeling safe in different parts of the school grounds 18 Components of the school environment index, by gender 18 Student scores, by school environment index quintiles 19 Student motivation and test scores 19 Prevalence of bullying, by socioeconomic status and gender of children 20 Bullying and learning outcomes 21 Role of bullying in student performance and its connection to socioeconomic status of students 21 Types of teaching and learning styles 22 Share of teachers who regularly (at least two to four times per week) use teaching practices, by student socioeconomic status 23 Student scores, by student wealth index and socioeconomic status index quintiles 24 Student scores, by teaching styles 24 Student scores in the bottom 40 percent of socioeconomic status, by teaching style 25 A typology of six spatial arrangements found in schools 27 Example of a school in the Russian Federation with an open multifunctional space 28
Tables .1 1 1.2 2.1
Sustainable Development Goal on education 2 Learning environment requirements in the standards for primary and secondary education in the Russian Federation 3 Share of teachers using teaching styles, by frequency 22
Acknowledgments
This report was prepared by a World Bank team led by Tigran Shmis (senior education specialist, Education Global Practice) and includes contributions from Maria Ustinova (education consultant, Education Global Practice) and Dmitry Chugunov (education economist, Education Global Practice). A team of consultants from the Russian Academy of Education, led by Galina Kovaleva, provided immense support to the team by collecting the data and linking the two data sets used in this study. The team is also grateful to Alexander Bunten and Mikhail Elkin for their support in editing the text. This study would not be possible without the contributions from the principals, teachers, and students who replied to the questions and took the tests. The work was carried out under the guidance of Andras Horvai (Russia country director), Dorota Nowak (country program coordinator), and Harry Patrinos (practice manager). The publication benefited from comments and discussions with peer reviewers Enrique Alasino (senior education specialist, Education Global Practice), Quentin Wodon (lead economist, Education Global Practice), Kirill Vasiliev (senior education specialist, Education Global Practice), Pedro Cerdan-Infantes (senior economist, Education Global Practice), and Julie Velissaratou (OECD consultant, Effective Learning Environments Group), who provided valuable advice at different stages of this work. The team is very thankful to the Organisation for Economic Co-operation and Development (OECD) Group of National Experts on Effective Learning Environments and especially to Joanne Caddy, Ria Sandilands, Alastair Blyth, and Julie Velissaratou, who have been excellent partners in this research and beyond it in our work in the Russian Federation and in Europe and Central Asia overall.
v
About the Authors
Tigran Shmis holds a specialist degree (2001) as a school teacher of computer sciences and economics. He also completed postgraduate study in educational ICTs and holds a PhD (candidate of sciences) degree (2004) from the Russian Academy of Education. Later he completed the MEd (2007) program at the Moscow branch of the University of Manchester on management in education and educational policy. Tigran has worked on educational projects in the Russian Federation, Belarus, Kazakhstan, Kyrgyz Republic, Romania, Serbia, and Peru. Among those projects were the Yakutia Early Childhood Development (ECD) Project, Russian Education Aid for Development (READ), Khanty-Mansyisk ECD infrastructure development technical assistance, Kyrgyz ECD Project, Belarus Education Modernization Project, Serbia ECD Project, and technical Assistance on Safer Schools development project in Peru. He delivered several cooperation programs for the OECD Center for Effective Learning Environments (CELE) and Early Childhood Education and Care (ECEC) networks and UNESCO. Areas of research and professional interests are ECD, innovative learning environments, and international assessment work. Tigran leads work on innovative learning environments, ECD quality initiatives, and capacity building of Russia in international development aid in education. Maria Ustinova works as a consultant at the World Bank office in Moscow, where she supports various technical assistance and lending projects in the field of education and social protection. She also serves as an associate researcher at the Urban Health Games Research Group, which is a part of the Architecture Department at the Technical University of Darmstadt, Germany. She contributes to research projects investigating how urban planning and design influence human health and well-being, particularly focusing on school learning environments. Additionally, she teaches a course on “Learning Environments Design Foundations” at Moscow City University. Maria holds a double master’s degree in international cooperation and urban development from Darmstadt University of Technology, Germany, and Tor Vergata University of Rome, Italy. Prior to joining the Bank, she worked as a consultant for the United Nations Economic Commission for Europe as well as for various projects of the Directorate-General for Education and Culture at the European Commission and the Education, Audiovisual and Culture Executive Agency of the European Union. Her areas of research and professional interest include education vii
viii |
Learning Environments and Learning Achievement in the Russian Federation
facilities design, early childhood development, health promoting design, and participatory practices in education facilities design. Dmitry Chugunov is an education economist with over seven years of international experience working at the national and international level on education policy and capacity building projects. He has global work experience with development aid agencies in Africa, Europe, and Central Asia and specialized in education policy analysis, impact evaluation (pre-and post-intervention), cost analysis and projection, mobile data collection, student assessment, and workforce and skills development. He has authored or co-authored over 30 analytical reports, articles, and knowledge products in the above areas and is proficient in large dataset management and economic modeling. Dmitry is dedicated to creating evidence-based policy recommendations through high-quality analysis. Dmitry holds a PhD in economics with a specialization in public economics and a master’s degree in economics with a specialization in public finance from the National Research University Higher School of Economics in Moscow.
Executive Summary
The design of learning environments and its potential impact on the academic outcomes of pupils is gaining momentum in different countries. According to the Sustainable Development Goal on education, building high-quality education facilities contributes to the achievement of inclusive and equitable education for all. Empirical studies in this area could support the development of evidence-based policies, but they remain few in number. In 2015 the Russian Federation initiated several federal investment programs to develop school infrastructure. Finding ways to make these investments as efficient as possible remains relevant not only for Russia but also for other countries that allocate significant funding for the construction of education facilities. To understand the relation between physical settings and the learning process, in 2018 the World Bank initiated a study on school infrastructure in Russia.
RESEARCH QUESTION The World Bank used two instruments to analyze the association between school learning environments and student outcomes: the Organization for Economic Co-operation and Development (OECD) School User Survey (SUS) (OECD 2018) and the Trends in Mathematics and Science Study (TIMSS 2019) pilot in three Russian regions. The study examined the hypothesis that school infrastructure characteristics and the way in which the learning environment is used and arranged might affect learning outcomes as measured by TIMSS. This report discusses the correlations found in the study and identifies the main factors for better education policy.
DATA This research is based on answers collected from 1,550 students in grade 8, 160 teachers, and 32 school principals. The data include information on the use and characteristics of school infrastructure, student scores on math and science, as well as information on the socioeconomic background of students. ix
x |
Learning Environments and Learning Achievement in the Russian Federation
MAIN FINDINGS The results of the study are discussed across three thematic areas: • School infrastructure and its use. Learning environments remain traditional in most of the schools. Most of the learning takes place in classrooms, and teachers do not use other spaces. Teachers report that rearranging the furniture is easy but that they rarely do so. Lastly, diverse technological equipment is available, but its full capacity is not used. • School environment and climate. The temperature, lighting, quality of air, and noise in classrooms influence students and teachers in Russia. Teachers have fewer issues with the physical characteristics of the building than students; they also express a higher level of satisfaction. Another issue is the level of security in schools, especially regarding outdoor spaces within the school grounds. The users’ perception of schools is linked directly with the learning outcomes of students. Teachers and managers agree that better schools help to attract, retain, and keep teachers at work. Lastly, bullying in Russian schools significantly undermines student outcomes, especially among students with low socioeconomic status (SES). • Teaching styles. Diverse teaching styles are in use, as revealed by the questionnaires conducted in Russian schools. Russian teachers do practice team teaching, but rarely. When employed, team teaching and group work have a statistically significant effect on student outcomes, potentially explaining the learning gap of two-thirds of a year as measured by TIMSS. The distribution of teaching methods is an important factor: students with low SES receive less group work and less individual work, even though these methods are effective for students from the bottom 40 percent of SES distribution. The study confirms that the characteristics of school infrastructure and teaching styles have a relation with learning. Extending the sample to other regions of Russia would yield more statistically significant results and provide additional information to strengthen further research on the design and quality of learning environments.
REFERENCES OECD (Organisation for Economic Co-operation and Development). 2018. OECD School User Survey: Improving Learning Space Together. http://www.oecd.org/education/OECD-SchoolUser-Survey-2018.pdf. TIMSS (Trends in Mathematics and Science Study). 2019. Retrieved at: http://www.centeroko.ru/ timss19/timss2019_info.html.
newgenprepdf
Abbreviations
ECD LCD LEEP OECD SACERS SDG SEN SES SUS TIMSS
early childhood development liquid-crystal display Learning Environments Evaluation Programme Organisation for Economic Co-operation and Development School-Age Care Environment Rating Scale Sustainable Development Goal special educational need socioeconomic status School User Survey Trends in Mathematics and Science Study
xi
1
Introduction
Over the last eight years, the World Bank has been researching the topic of learning environments in early childhood development (ECD), school, and university settings. The work was financed through various sources, including investment loan project preparation in the Yakutia region of the Russian Federation as well as several reimbursable advisory services activities in the field of ECD and higher education. During these years, the Bank team sought to understand the physical context in which the learning process, as well as the interaction between students and teachers, occurs. The major question that remained unanswered was the reason why investing in the development of learning environments is important and how to make these investments more efficient and compelling. This report presents a rigorous analysis of the data collected throughout 2018–19 as part of the Organization for Economic Co-operation and Development (OECD) School User Survey (SUS) (OECD 2018) and the Trends in Mathematics and Science Study (TIMSS 2019) piloted in three regions of Russia. This report addresses the findings relevant to national and international researchers and policy makers.
BACKGROUND At a global level, the development of learning environments is an emerging discipline, which still lacks empirical evidence to show how space is used and how it affects student outcomes and teacher productivity (Blackmore et al. 2011). In 2019 the World Bank published a comprehensive review of research on learning environments from an evidence-based perspective, which found that the number of empirical studies is still scarce and focused mostly on high-income countries (Barrett et al. 2019). The lack of empirical studies on what works in learning environments is worrisome, given the amount of funding spent on school infrastructure globally. Recently, the United Nations introduced new Sustainable Development Goals (SDGs) on education, which include a target and indicator related to the quality of learning environments in education facilities (table 1.1). SDG 4.A indicates that stronger attention is being given to the topic of learning environments and that evidence is being gathered to support better schools around the world. Global trends show that school systems are changing and that the major driver of change is the agenda of 21st-century learning. The importance of collaboration, 1
2 |
Learning Environments and Learning Achievement in the Russian Federation
TABLE 1.1 Sustainable
Development Goal on education
GOAL
INDICATOR
SDG 4. A Build and upgrade education facilities that are child, disability, and gender sensitive and provide safe, nonviolent, inclusive, and effective learning environments for all
SDG 4. A.1 Proportion of schools with access to (a) electricity, (b) the Internet for pedagogical purposes, (c) computers for pedagogical purposes, (d) adapted infrastructure and materials for students with disabilities, (e) basic drinking water, (f) single-sex basic sanitation facilities, and (g) basic handwashing facilities (as per the definitions under the water, sanitation, and hygiene indicator)
Source: United Nations, Sustainable Development Goal 4, https://sustainabledevelopment.un.org/sdg4. Note: SDG = Sustainable Development Goals.
critical thinking, problem solving, creativity, and other skills is being reflected in changes to teaching practices and learning environments. The most advanced countries in these areas have been successful in innovating and implementing the adjustments to learning environments at the national scale. A recent World Bank study widely supports the argument that flexible, open, safe, and efficient infrastructure does have an impact on learning (Barrett et al. 2019). Russia has initiated an ambitious infrastructure program to improve learning environments in all schools, provide 6.5 million new places for pupils, and implement a full-time school initiative across the country by 2025 (“Assistance to Create New Places in Public Schools in the Regions of the Russian Federation,” Government Decree no. 2145-р, School 2025). Starting in 2017, the Ministry of Education (Instruction) implemented this federal program in the framework of a priority project, Creating Contemporary Learning Environments for Pupils. In 2017, 83 new schools were built in the Russian regions, including 28 schools in rural areas. One year of program implementation has revealed several challenges: (a) the need to improve the regulatory environment related to school design, planning, construction, and maintenance; (b) the need to improve the financing mechanisms of the program, and (c) the need to address the lack of community involvement in designing schools. Additionally, the Russian government has started to implement a program related to the promotion of digital technologies and online learning in primary and secondary education entitled “Contemporary Digital Learning Environment in the Russian Federation”. Focusing on teaching methods, distance learning, and the promotion of massive online open courses (MOOCs), the program is expected to have an impact on conventional spatial arrangements of classrooms and overall school designs in the future. Understanding this impact requires a thorough evaluation of the needs of pupils and teachers regarding the effectiveness and sufficiency of existing learning environments. The key requirements for school learning environments in Russia are identified in the Federal State Standards of Primary, Basic, and Secondary Education (table 1.2). The standards focus on safety, health, and equal access to education for all pupils. However, the overall characteristics remain very general for all grades. The Russian experts estimate that the quality and usability of spatial organization in Russian schools are at average levels. For example, based on the School-Age Care Environment Rating Scale (SACERS), schools in Moscow have low scores r elated to the quality of the following parameters: space and furnishings, time devoted to physical activity, and special needs (for example, the creation of conditions for students with special educational needs). The experts noted a missing connection between the social and pedagogical demands and current design of schools (Ivanova and Vinogradova 2018). The development of design briefs and the design of new buildings often do not consider the needs of the pedagogical community, students, parents, and the municipality. This lack of consideration hinders the development of
Introduction | 3
TABLE 1.2 Learning environment requirements in the standards for primary and secondary education in the Russian Federation
GOAL
PRIMARY EDUCATION: GRADES 1–4
BASIC EDUCATION: GRADES 5–9
SECONDARY EDUCATION (HIGH SCHOOL): GRADES 10–11
Create a unified educational • Create equal opportunities for environment and access to primary education developing social skills
• Provide access to high-quality basic (general) education
• Create equal opportunities for receiving a high-quality secondary education
Create a comfortable, • Provide high-quality education stimulating learning • Create conditions for individual environment with special child development requirements for the • Provide an opportunity for building, outdoor space, and barrier-free access for children furniture with special educational needs (SENs) • Ensure safety
• Provide high-quality education • Organize lessons and extracurricular activities • Create conditions for individual child development • Create an opportunity for barrier-free access for children with SENs • Ensure safety
• Provide high-quality education • Organize lessons and extracurricular activities • Create conditions for individual child development • Create an opportunity for barrier- free access for children with SENs • Create conditions for group, individual, project, and creative work • Ensure safety
Source: Russian Federal Standards of Primary and Secondary Education.
contemporary learning environments and seriously affects the quality and comfort of modern schools. At the same time, international best practices and the growing pool of scientific evidence suggest that only a holistic approach to school design and planning can guarantee a high quality of education facilities, high quality of education provided, and well-being of pupils and teachers (Barrett et al. 2019). Several key parameters are important to consider at all stages of design, implementation, operation, and supervision of future education infrastructure projects (figure 1.1): • Accessible. The school facility should be accessible to both pupils and teachers. Schools with effective access have the following characteristics: they are locally distributed to maintain reasonable travel distances to school, are relatively small, have relatively small classes and relatively low density of classroom occupancy, are used for a school day of reasonable length, and have optimal scheduling to maximize educational benefits (Leithwood and Jantzi 2009). • Well-built. The physical quality of the built environment should ensure the safety and good health of the users. The school’s buildings should be ready to withstand natural disasters, provide basic services and opportunities for outside play, and have good indoor environmental quality. These factors may contribute positively to pupils attending and remaining healthy in school and help to retain teachers (Barrett et al. 2015; Buckley, Schneider, and Shang 2004; Mendell and Heath 2005; OECD 2017b). • Child-centered. Physical characteristics of the built environment should positively affect and stimulate the educational progress of pupils. The design should take into account the needs of the children and their age as well as local climatic and cultural conditions and should guarantee good “natural” parameters such as lighting, air quality, temperature control, acoustics, and links to nature, color, and visual complexity (Barrett et al. 2015). The learning spaces should be easy to navigate, be well connected, and provide additional learning opportunities. • Synergetic. The built environment should fit with the pedagogy provided by the school and with the daily life and needs of the surrounding community. The main
4 |
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 1.1
Learning environments for better educational outcomes
tical imperative c a r P s al spaces for learn d an
A
centered Child-
Fit wit hc on te xt
Syn e
rg ions for sch etic t a oo ir sp
d lize rea lly Fu
Acc ess ib le
uilt -b ell W
ing
ls
Ava ilab le s cho ol
m Opti
nted me ple im ly ive ct fe Ef
pl ac es
fe Sa
hy alt he
Source: Barrett et al. 2019.
users of the school—especially the school principal—should participate in the design process (OECD 2013; Realdania 2010; Seydel 2017). • Fully realized. Strong attention to these factors may help to improve the efficiency of the resources invested in school infrastructure projects and could lead to more effective cooperation between stakeholders involved in the development and operation of school infrastructure.
RESEARCH QUESTIONS AND METHODOLOGY OF THE STUDY Two instruments were used to analyze the relation between school learning environments and student outcomes: the OECD School User Survey and the Trends in Mathematics and Science Study pilot in Russian regions.
School characteristics and perceptions Globally, only a few research groups are focusing on the connectedness of learning environments and learning outcomes. They include the OECD Group of National Experts on Effective Learning Environments and the Australian Innovative Learning Environments Research Group at the University of Melbourne. While the OECD’s research focuses on teaching and learning interactions, the Australian research focuses on the architectural layout of schools. The Australian research is difficult to apply in Russia because schools with open plans are rare. The suggested instrument covers mostly the well-built, child-centered, and synergetic areas of the proposed framework. The SUS is a survey tool for analyzing school characteristics collected from students, teachers, and school leaders or principals. The questionnaires can be used to collect and triangulate evidence on the actual use of learning spaces as well as to solicit user perspectives. The SUS was developed by the OECD Learning Environments Evaluation Programme (LEEP).1 This study focuses on the broader concept of learning spaces, which includes physical characteristics, use of learning spaces, security, and cultural perspectives.
Introduction | 5
FIGURE 1.2
Structure of the OECD School User Survey questionnaires Student questionnaire
Teacher questionnaire
School questionnaire
Section 1
About you
About you
About you
Section 2
Spaces you use
About your school
The physical environment of the school
Section 3
Comfort
Spaces you see
Technology at the school
Section 4
Safety and well-being
Comfort
Overall satisfaction
Section 5
Overall satisfaction
Technology
Section 6
Arrangement of the space
Section 7
Space for administrative work and class preparation
Section 8
Overall satisfaction
Source: OECD 2017a. Note: Color coding shows the cross-cutting blocks.
It therefore uses the SUS, which captures both physical and nonphysical characteristics of learning environments (see figure 1.2). This report does not use the latest version of the questionnaires; an up-to-date version is available on the Internet.2
Student performance To measure student performance, the World Bank used the pilot trial of TIMSS 2019. The pilot trial tested the TIMMS 2019 questions in order to improve the methodology. It also produced local results for learning outcomes of students in mathematics and science. The outcome results are not weighed and scaled on the international scale, which is usually from 0 to 1,000 points. This does not mean that the results are invalid; it does mean that the TIMSS pilot results in this analysis cannot be used for international comparisons. However, they can be used for analyzing Russian results in three pilot regions. In the pilot sample, the scores are distributed from 0 to 100. The pilot testing took place in three Russian regions and included 1,550 students in grade 8, 160 teachers, and 32 school principals. The analysis includes student performance scores in mathematics and science. Every student completed the full set of tasks in math and science and received a score in each category as well as generalized TIMSS scores.
Data collection and sample Every student who took the TIMSS in the sampled schools filled out the SUS student questionnaire. Teachers of the students who participated in the TIMSS
6 |
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 1.3
Data connectivity for the study
SUS student
SUS teacher
Student identification
Student identification
Student identification
TIMSS Context questionnaire student
TIMSS Math, Science, Overall
Teacher identification SUS school Source: World Bank estimates based on the Trends in Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data. Note: SUS = OECD School User Survey, TIMSS = Trends in Mathematics and Science Study.
testing from the sampled schools and classes filled out the SUS teacher questionnaire. School principals of the sampled schools filled out the SUS school questionnaire (see figure 1.3). The procedure in the schools lasted two days. During the first day, students, teachers, and principals participated in the TIMSS testing, and the next day they completed the SUS forms. The questionnaires were delivered in paper and pencil form. The sample includes mostly urban schools, located in the central and northwest administrative districts of the country in three pilot regions. The sample does not include different types of schools (for example, private, specialized); thus, it does not allow for analyzing the potential disparities between those types of schools and between the regions of Russia. Preliminary hypotheses associated with the School User Survey suggest that school infrastructure characteristics and how the learning environment is used and arranged might affect learning outcomes as measured by TIMSS. The study sought to answer the following questions: 1. How do school users perceive and use the school learning environment in Russia? 2. How does the school learning environment affect student achievements? 3. How does the school learning environment affect the development of 21st- century skills? 4. What factors may be considered for better education policy related to school learning environments?
NOTES 1. For more information about SUS and LEEP see http://www.oecd.org/education/effective -learning-environments/. 2. For more information on the survey see http://www.oecd.org/education/OECD-School-User -Survey-2018.pdf.
Introduction | 7
REFERENCES Barrett, Peter, Fay Davies, Yufan Zhang, and Lucinda Barrett. 2015. “The Impact of Classroom Design on Pupils’ Learning: Final Results of a Holistic, Multi-Level Analysis.” Building and Environment 89 (July): 118–33. Barrett, Peter, Alberto Treves, Tigran Shmis, Diego Ambasz, and Maria Ustinova. 2019. The Impact of School Infrastructure on Learning: A Synthesis of the Evidence. International Development in Focus. Washington, DC: World Bank. https://openknowledge.worldbank.org/handle/10986/ 30920. Blackmore, Joe, Debra Bateman, Joanne O’Mara, and Jill Loughlin. 2011. The Connections between Learning Spaces and Learning Outcomes: People and Learning Places? Victoria: Centre for Research in Educational Futures and Innovation, Faculty of Arts and Education, Deakin University. Buckley, Jack, Mark Schneider, and Yi Shang. 2004. The Effects of School Facility Quality on Teacher Retention in Urban School Districts. Washington, DC: National Clearinghouse for Educational Facilities. Ivanova, Elena, and Irina Vinogradova. 2018. “Scales SACERS: Results of the Study of the Educational Environment of Moscow Schools.” European Journal of Contemporary Education 7 (3): 498–510. doi:10.13187/ejced.2018.3.498. Leithwood, Kenneth, and Doris Jantzi. 2009. “A Review of Empirical Evidence about School Size Effects: A Policy Perspective.” Review of Research in Education 79 (1): 464–90. Mendell, J. Mark, and Garvin A. Heath. 2005. “Do Indoor Pollutants and Thermal Conditions in Schools Influence Student Performance? A Critical Review of the Literature.” Indoor Air 15 (1): 27–52. OECD (Organisation for Economic Co-operation and Development). 2013. Innovative Learning Environments. Educational Research and Innovation. Paris: OECD. ———. 2017a. “LEEP Field Trial Implementation Report.” EDU/EDPC/GNEELE(2017)5, Group of National Experts on Effective Learning Environments, Directorate for Education and Skills, Education Policy Committee, OECD, Paris. http://www.oecd.org/education/LEEP-FIELDTRIAL-IMPLEMENTATION-REPORT.pdf. ——— . 2017b. Protecting Students and Schools From Earthquakes: The Seven OECD Principles For School Seismic Safety. Paris: OECD. ———.2018. OECD School User Survey: Improving Learning Space Together. http://www.oecd.org /education/OECD-School-User-Survey-2018.pdf. Realdania. 2010. “МОДЕЛЬНАЯ ПРОГРАММА ДЛЯ ОБЩЕОБРАЗОВАТЕЛЬНЫХ ШКОЛАгентство [Danish Model Program for Schools].” Realdania, Copenhagen. http:// documents.worldbank.org/curated/en/734251533070308219/pdf/Danish-Modelprogram-for -Schools-RUS.pdf. Seydel, Otto. 2017. “Reflections on the Relationship between Schools and the City.” In Education, Space, and Urban Planning: Education as a Component of the City, edited by Angela Million, Anna J. Heinrich, and Thomas Coelen, 19–29. Cham, Switzerland: Springer International. TIMSS (Trends in Mathematics and Science Study). 2019. Retrieved at: http://www.centeroko.ru/ timss19/timss2019_info.html.
2
Results and Discussion
The results presented in this section are structured based on several criteria derived from the data and design of the questionnaires. The first part analyzes physical environment and its use by looking at the Organisation for Economic Co-operation and Development (OECD) School User Survey (SUS) questionnaires. The second part discusses school environment and climate, presenting perceptions and safety and analyzing bullying in different dimensions, including the impact on learning outcomes. The third part focuses on teaching practices and learning outcomes, analyzing the approaches to teaching and links to the academic performance of students. Although this study uses two linked data sets, the link between learning outcomes and school characteristics is a correlation, not a causality. The forthcoming larger data sets with country-representative sampling will help to make a stronger argument for the causality of the findings.
THE PHYSICAL ENVIRONMENT AND ITS USE Major findings: Learning environments are traditional in most of the reviewed schools, and the majority of learning takes place in classrooms. In most cases, teachers do not use spaces beyond classrooms. Although moving furniture is possible and easy—as reported by teachers—it rarely takes place. Lastly, schools have an array of technological equipment, but technology is reportedly used infrequently. The types of spaces, their spatial organization, their allocation, and the frequency of use by students and teachers provide valuable information about the organization and practices of teaching and learning. This information, in turn, can indicate how the spaces might shape teaching and learning processes, affect health and well- being, and shape learning and social outcomes. The majority of teachers surveyed (70 percent) use only one classroom for teaching. Teachers who use only one classroom are five years older than their colleagues who use multiple places for their classes: 51 years old compared with 46 years old. The difference in age is statistically significant at the 0.05 percent level. All of the teachers surveyed confirmed that there is only one teacher in the classroom during lessons.
9
10 |
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 2.1
Frequency of use of spaces by students and teachers in a typical week a. Use of spaces by students during lesson time over the past week 90
A classroom 43
24
86 86
Space in a corridor outside the classroom
79
Hall or auditorium
81
A workshop space with furniture for woodwork, metalwork, catering, or similar A space with furniture or technology for subjects like art, music, or design
21 21
50
11
School cafeteria
39
100
b. Frequency of use of spaces by teachers in a typical week
3 10 5 5 13
4 4
90
5 4
Library
80
11
14
A classroom with direct access to other rooms (a cluster of rooms)
78
6
12
Science laboratory
0
16 0
20
40
4
91
15
Percent of students
11
7 6 60
80
6 3 13 11 100
Percent of teachers
Never
Once a week
2 to 4 times a week
Every day
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
Regarding the types of spaces and their frequency of use (figure 2.1), both teachers and students reported that in a typical week they only use their classrooms during lesson time. The vast majority (97 percent) of teachers teach in classrooms assigned to them at least two to four times a week, and 90 percent of students use a single classroom during lesson time. Students use the school cafeteria and corridors outside the classroom most frequently for lesson time during a typical week. However, only 13 percent of teachers reported using the school cafeteria for teaching purposes at least two to four times in a typical week, while 43 percent of students reported using the cafeteria during lesson times over the past week. In addition, 21 percent of teachers reported using the space in a corridor outside the classroom in a typical week, compared with 39 percent of students over the past week. Research suggests that flexible spaces can encourage more effective teaching (Anderson-Butcher et al. 2010; Oblinger and Lippincott 2006), team teaching, better planning, use of more diverse pedagogies, and focus on personalized learning. Flexible spaces can also encourage students to be self-reliant learners capable of working in groups (Dekker, Elshout-Mohr, and Wood 2006; Fielding 2006). The physical learning environment in Russian schools may be used to suit a variety of instructional methods and, in some cases, may be conducive particularly to methods relevant for 21st-century teaching and learning, such as group work. Research shows that group work can lead to more active and sustained engagement, connectedness, and higher-order inferential joint reasoning among students (Blatchford et al. 2006). Regarding the flexibility and adjustability of spaces—the ease of arranging and rearranging furniture—the majority (79 percent) of teachers agreed that it is easy to rearrange the furniture (figure 2.2). Only 21 percent of teachers disagreed with this statement. The majority (83 percent) of teachers also agreed that there is enough space to arrange furniture in different ways, and more than half (60 percent) agreed that the furniture can be moved easily during lesson time.
Results and Discussion | 11
FIGURE 2.2
Teachers’ agreement with statements about moving furniture There is enough space to arrange the furniture in different ways
4
14
There is enough time to rearrange the furniture before classes begin
5
13
It is easy to move the furniture
10
The furniture can easily be moved during lesson time
12
30
50
11
32
53
26
28
It is easy to move the technology such as data projectors and white boards to support different furniture arrangements
46
34 0
Strongly disagree
53
Disagree
10
49
20
Agree
14
11
30
40 50 60 70 Percent of teachers Strongly agree
80
6
90
100
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
FIGURE 2.3
Frequency of spatial arrangements by teachers Change the layout of the space for different classes, according to activities you had planned (for example, reconfigure table layout, move sliding partitions)
31
Encourage students to move furniture during class to suit group formation or participation in activities
49
37
Rearrange the layout of a space during a class (for example, tables and chairs get moved into different positions)
27
7
Once a week
20
11
24
9
79 0
1 to 3 times a month
12
63
Rearrange tables, chairs, or other aspects of the space (for example, sliding partitions) prior to the star t of a lesson (because a previous user had them in a different position)
Never or hardly ever
41
51
Encourage students to move around a space during a class
14
11
40 60 Percent of teachers 2 to 4 times a week
80
Every day
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
However, 93 percent of teachers said that it is difficult to move the technology equipment, such as liquid-crystal display (LCD) projectors and whiteboards, to support different furniture arrangements. Only 17 percent reported that they find it easy—49 percent disagreed and 34 percent strongly disagreed. The majority (82 percent) of teachers said that there is enough time to rearrange the furniture before classes begin. For this reason, on average, teachers do not encourage students to move around a space during a class or to move the furniture to suit group work (figure 2.3). Only 4 percent of teachers said that they encourage students to move around a space during a class at least two to four times a week, whereas a little less than a third (27 percent) said that they encourage students to do so one to three times a month. More than a third (41 percent) of teachers also encourage students to move furniture during class one to three times a month to suit group formation or participation in activities, while 12 percent do so at least once a week. Teachers by themselves
6 100
12 |
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 2.4
Use of external (outside) spaces by students and teachers a. Use of external or outside spaces by students during class times over the last week An external (outside) hard ball court, sports court, hard paved area not accessible from a classroom
39
30
25
10 20 30 Percent of students
2
95
1
2
Sports field
94
3
An external (outside) classroom or space, usually with seating and directly accessible from a classroom
94
2
4
4
1
Grassy area (not a sports field) not accessible from a classroom
16 0
b. Use of external or outside spaces by teachers during class times over the last week
40
93 85
1
2
1
90 95 Percent of teachers
100
Never or hardly ever
1 to 3 times a month
2 to 4 times a week
Once a week
Every day Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
move the furniture around less frequently before or during a class. The majority (79 percent) of teachers never have to rearrange tables, chairs, or other elements of the space (for example, sliding partitions) prior to the start of a lesson and 11 percent of teachers only have to do so between one and three times a month. Female teachers more frequently change the spatial arrangements in the classrooms where they teach. Older and more experienced teachers never or hardly ever change them. Students and teachers use external spaces differently. While 39 percent of students claimed that they used common areas for learning during the last week, 95 percent of teachers said that they never do it (figure 2.4). The conclusion is very interesting: while students use diverse school spaces during class time, they do so on their own time, without teachers in most of the cases. Technological equipment in schools is an important dimension of education policy in the Russian Federation. The collected data suggest that the presence of different types of technology is uneven within schools and that the use of technology still lags behind its availability. Still, whiteboards (interactive boards) are not available to teachers, and wireless Internet and tablets are never used in 43 percent and 96 percent of cases, respectively. Projectors are the most commonly used technology (72 percent), compared with 34 percent for laptops and 49 percent for the Internet (figure 2.5). The following summarizes the findings regarding the physical environment of schools and its use: • Diverse use of space by teachers: low • Rearrangement of space and ease of doing so: high • Use of external spaces: low • Diversity of technology: high • Frequency of technology use: low.
Results and Discussion | 13
FIGURE 2.5
Availability of technologies and frequency of use a. Availability of technologies in the spaces where teachers teach 19
10
26
21 9
20
40
9
54
Tablets
60
80
100
In most of the spaces In none of the spaces
35 12
22
12
21
96 0
50
Percent of teachers In all of the spaces In a few of the spaces
11
40
37 47
Desktop computers
87
9
43
The ability to project sound and vision for a group of students (such as a projector or large television with audio) In-school laptops or notebooks (stored in that room)
36
29
2 9 0
7
30
32
13
22
20
16
58
Wireless Internet access
35
26
52 29
Interactive whiteboard
33
39 13
b. Frequency of use of technologies by teachers in the spaces where they teach
100
Percent of teachers Never or hardly ever Once a week Every day
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
SCHOOL ENVIRONMENT AND CLIMATE Major findings: The conditions in Russian schools provide diverse experiences for users. The users’ perceptions of temperature, lighting, quality of air, and noise influence both students and teachers in Russia. Teachers have fewer issues with the physical characteristics of the building than students and have a higher level of satisfaction. The issues with lighting pertain more often to lighting that is too bright rather than to lighting that is too dim. Security is an issue, especially for schools with external amenities. The users’ perception of schools has a direct link with the learning outcomes of students. Teachers and school managers agree that better schools help to attract, retain, and keep teachers at work. Lastly, bullying significantly undermines student outcomes, especially among students with low socioeconomic status (SES). This section addresses the physical and nonphysical characteristics of learning environments in Russian schools. The physical characteristics include the perception of students and teachers regarding temperature, air quality, and lighting in the schools. The nonphysical aspects include the arrangement of spaces, the perception of users regarding the arrangement, and security issues of the schools. Research has shown a positive relationship between the physical condition of a school and student learning that eventually results in better life outcomes for those students (Barrett et al. 2019). A study conducted at the University of Salford in the United Kingdom (Barrett et al. 2015) found that differences in the physical characteristics of classrooms accounted for almost half of 16 percent of variations in learning progress between students over just one year in primary school. The most influential factors were environmental (such as light, temperature, and air quality), followed by classroom design, including flexibility, students’ sense of ownership, and surrounding color (figure 2.6).
1 to 3 times a month 2 to 4 times a week
14 |
Learning Environments and Learning Achievement in the Russian Federation
Physical characteristics Students and teachers perceive temperature differently. While in 15 and 13 percent of cases students said that they feel too cold or too hot, respectively, in most spaces, teachers said that they are comfortable in most spaces (figure 2.7). This is an important factor, and, as research shows, temperature is a strong contributor to academic performance. It is especially important for Russia, which is a cold country in most of the regions. Students and teachers also perceive air quality differently. While students more often said that the air is not comfortable to them, teachers more often said that the air is fresh (figure 2.8). Fresh air is part of the equation for improved learning outcomes, and ensuring that air in classrooms is fresh is an important element related to learning outcomes. As far as lighting is concerned, students said that light FIGURE 2.6 is uncomfortable more often than teachers, and they more The stimulation, individualization, and naturalness often said that the lighting is too bright than that it is too model dark. It is also worrisome that, in several instances, students reported that they cannot see the demonstrations when Color 11 percent teachers use traditional boards, LCD projectors, or other Light 21 percent technology (figure 2.9). While the trinity of physical characteristics (temperature, Complexity air quality, and natural light) has been identified as signifi12 percent cant for the United Kingdom, our study suggests the need to consider other characteristics of learning spaces. Auditory comfort is important for students to be able to learn better Temperature and understand what teachers say. Students said that they 12 percent can hear the teacher and peers well in most cases, but they are more often disturbed by external noise (figure 2.10). Flexibility 17 percent Students who experience visual and auditory difficulties in the classroom said that they feel hot or cold in most places Air quality and score on average one to two test points lower on both 16 percent Ownership 11 percent math and science assessments (figure 2.11). The difference Stimulation Individualization Naturalness may seem minor; however, together with other factors that influence learning (for example, teaching), the relation Source: Barrett et al. 2015. Note: Figure shows the contribution of each classroom measure. between the school environment and learning is substantial. FIGURE 2.7
Temperature felt by students and teachers when it is cold outside
Percent of respondents
100
6 15
21
13
31
26 54
50
46
50
46 75 37
29 0
Students
68
Teachers
I usually feel too cold
In none of the spaces
Students
Teachers
I usually feel too hot
In a few of the spaces
37 22 7 Students
6 Teachers
I usually feel about right (neither too hot nor too cold)
In most of the spaces
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
In all of the spaces
FIGURE 2.8
Air quality felt by students and teachers in spaces where lessons or study takes place 100
3
4 21
Percent of respondents
23 36
64 44
50
53 60 32
20
31
6
0 Students
Teachers
Students
The air is usually fresh
Teachers It is stuffy
In all of the spaces In most of the spaces In a few of the spaces In none of the spaces Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
FIGURE 2.9
Perceived visual quality of natural light by students and teachers in the learning spaces when it is daylight outside 3
2 12
4 21
23
18
3 17
30
29
47
50
3
36 64 44
50
53 60 32
20
31
6
54
ti
s
st
uf
fy
3
:I
:I
he
rs
ts
ac
St
Te
St
ud
en
he r us s: T ua he lly a fre ir i sh s
ac
Te
ud
en t us s: T ua he lly a fre ir i sh s
0
St
33
ti s st uf ud fy w dr en hi aw ts te n : I bo o ca ar r w n w d o rit see ith r te w di ou ch n o h sp S t d alk n at la tu ye de iffi bo the is te (fo d n cu ard le r on ts: lty v sc isio exa th I ca re n m e n en s p di se ) w cre le, sp e ith en LCD lay wh ou ; pr s scr at t d oj cre ee is te if ec en n fo ach S ficu tion ; r a e tu lty r se de is den e m us ts th on in : g W e w de stra ap he ith m t p n ou o ion ar th t d nst , I atu e iffi rat can s cu ion lty
Percent of respondents
100
In all of the spaces
In most of the spaces
In a few of the spaces
In none of the spaces
Not applicable
Source: World Bank estimates based on OECD Student User Survey (SUS) (OECD 2018) data. Note: LCD = liquid-crystal display.
FIGURE 2.10
Perceived auditory quality by students and teacher in learning spaces
Percent of respondents
100 13
11 26
28
52 76 92
50
89 69
55
98
34 8
22
0
8
Students: I can Teachers: I can Students: I can Students: I am Teachers: I am Teachers: I am Teachers: Sound disturbed by disturbed by disturbed by hear the hear the hear other echoes too sounds inside much in the noise from noise from teacher's voice students students clearly the space (such outside the outside the clearly clearly when when they are classroom as airspace space they speak talking to the conditioning) class In all of the spaces
In most of the spaces
In a few of the spaces
In none of the spaces
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 2.11
Perceived temperature, air, visual, and auditory quality and student scores in math and science b. Science .9 57 .0 55 .8 57 .0 56 .8 56 .9 55 .8 57 .1 54 .5 57 .0 54 .9 57 .1
70
25
0
55
41
.9 42 .8 41 .5 42 .8 42 .3 43 .8 41 .1 43 .0 40 .1 42 .8 40 .7 42 .9
a. Math 50 Percent of respondents
16 |
35
Yes No Yes No Yes No Yes No Yes No Yes No It's too cold
It's too hot
Air is stuffy
It's too bright
It's too It's noisy dark
0
Yes No Yes No Yes No Yes No Yes No Yes No It's too cold
It's too hot
Air is stuffy
It's too bright
It's too dark
It's noisy
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
School culture and user perceptions The findings show that both the physical learning environment and supportive school culture are key drivers of success. Both school leadership and teachers agreed that the design of school buildings and learning spaces encourages collaboration between teachers, with 93 percent of school administrators and 86 percent of teachers agreeing or strongly agreeing with this statement (figure 2.12). In addition, 69 percent of school administrators strongly agreed that the school buildings and learning spaces suit teachers’ preferred teaching practice, while 63 percent of teachers also strongly agreed with this statement. At the same time, 70 percent of school principals strongly agreed that the design of the school buildings and learning spaces encourages the use of a variety of teaching practices; 53 percent of teachers agreed with this statement too. Both school leadership and teachers agreed that teachers have sufficient time to plan collaboratively with other teachers, with 35 percent of teachers strongly agreeing with this statement; however, 17 percent of teachers disagreed with it. School leadership and teachers agreed that teachers are provided with time to plan how best to use the school learning spaces, with 46 percent of teachers strongly agreeing with this statement; however, 10 percent either disagreed or strongly disagreed with it. The majority of school leaders and teachers (86 percent and 82 percent, respectively) agreed or agreed strongly that school leaders encourage teachers to experiment with different ways of using the learning spaces. However, 15 percent of teachers and 14 percent of school administrators disagreed with it. School leadership and teachers also agreed (90 percent and 92 percent, respectively) that the school schedule enables teachers to make the most of the learning spaces, with 42 percent of teachers strongly agreeing with this statement. However, 7 percent of teachers disagreed with it. The teachers and school leaders also agreed strongly with the statements related to teacher attraction and retention. Both groups said that school buildings help to attract teachers to the schools, keep them in their jobs, and stimulate them to stay longer on the school premises. They also agreed that the school building attracts parents looking to place their children in school. The last statement is important given the level of school financing per capita and some competition among schools for students. Overall, the majority of school users are satisfied with the available school spaces: 87 percent of teachers, 78 percent of students, and 75 percent of school leadership (figure 2.13). However, the difference in satisfaction between teachers and
Results and Discussion | 17
FIGURE 2.12
School leadership and culture a. The extent to which schools administators agree or disagree with the following statements about their school’s leadership and learning environment
b. The extent to which teachers agree or disagree with the following statements about their school’s leadership and learning environment
70
30
The design of the school buildings and learning spaces encourages the use of a variety of teaching practices
69
31
The school buildings and learning spaces suit my preferred teaching practice
38
41
37
7
Teachers are provided with time to plan how best to use the school learning spaces
34
52
14
School leaders encourage teachers to experiment with different ways of using the learning spaces we have
34
59
7
31
59
10
31
59
10
0
50
Our school timetabling enables us to make the most of the learning spaces we have.
57
0
10
50
33
Agree
Disagree
Strongly disagree
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data. a. School leaders include the school principal, deputy principal, and heads of department.
FIGURE 2.13
Average satisfaction with school spaces 100
87
78
75
50
0 Teachers
School leaders
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
students is almost 10 percent. Overall, the analysis shows that students more often feel discomfort about lighting, temperature, and noise. This discomfort may explain why their overall satisfaction is lower than that of teachers. The study does not go into the classrooms per se; however, it is possible that the difference in hearing and visual comfort can be explained partly by the classroom seating arrangements. While teachers usually benefit from central positioning, some students sit in areas with less light or more noise than other areas of the room.
School environment index The school environment index is constructed employing principal component analysis on five variables. The index components are student responses on a scale from 1 (“disagree a lot”) to 4 (“agree a lot”) to the following statements: (a) “I like being
9
15
52 50 Percent of respondents
Strongly agree
Percent of respondents
55
42
2
17
44
29
Percent of respondents
Students
48
46
27
5
34
35
The design of the school buildings and learning spaces encourages collaboration with other teachers School leaders and teachers have a shared vision about how best to use the school buildings and learning spaces
100
41
63
I am provided with time to plan collaboratively with other teachers
21
53
53
7
14 100
Learning Environments and Learning Achievement in the Russian Federation
in school,” (b) “I feel safe in school,” (c) “I feel that I belong to this school,” (d) “My teachers are fair to me,” and (e) “I am proud to study in my school” (figure 2.14). The school environment index shows the composite of different inputs. The review also identifies the gender-based differences in school perception. Boys and girls have significantly different perceptions of the sense of belonging and the joy of being in school. Boys said that they feel less belonging and joy than girls. A smaller difference but still statistically significant is the sense of safety felt by boys and girls; again, boys said that they feel less safe on school premises than girls (figure 2.15). An area of similarity is in the fairness of teachers to students and pride in their schools. The difference in the school environment index between girls and boys is statistically significant at the 0.01 percent confidence level. School perception and learning outcomes are related. This is the case in both subjects of the Trends in International Mathematics and Science Study (TIMSS). Student test scores in math and science are higher in schools where students have a positive perception of the school environment. The difference in test scores between schools in the top and bottom 20 percent of the school environment index is 3.5 points in math and 2.1 points in science, which is equivalent to a gap of
FIGURE 2.14
Students’ perception of feeling safe in different parts of the school grounds 100 Percent of students
18 |
2
7
4
5 34
35
49
52
48 17
50
25
12 30
30
14
30
10 5
11 6
23
11 6
I feel safe in the learning spaces in the school
I feel safe in other parts of the school buildings
I feel safe when using the toilet facilities outside the school buildings but on the school grounds
I feel safe on other parts of the school grounds
21 11
0
I feel safe when using the toilet facilities inside school buildings
Never
Rarely
Often
Always
Not applicable
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
FIGURE 2.15
Components of the school environment index, by gender Teachers are fair to me I’m proud studying in my school I feel safe in school I belong to my school I like being in school 0
10
20
30
40
50
60
70
80
Percent of students Boys
Girls
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
90
100
Results and Discussion | 19
FIGURE 2.16
Student scores, by school environment index quintiles 70
Student test scores
60
57.4
55.3
50
43.3
39.8
40 30 20 10 0
Science*
Math** Bottom 20 percent
Top 20 percent
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data. ** Statistically significant at 0.05 percent confidence level; * Statistically significant at 0.1 percent confidence level.
FIGURE 2.17
Student motivation and test scores b. I like math
70
70
60
60 Student test scores
Student test scores
a. Math is boring
50 40 30 20
40 30 20 10
10 0
50
Math
Science
0
Total
Math
70
70
60
60
50 40 30 20 10 0
Math
Science
Total
d. Math is my favorite subject
Student test scores
Student test scores
c. I like numbers
Science
Total
50 40 30 20 10 0 Math
Agree a lot
Agree a little
Disagree a little
Disagree a lot
Science
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
two-thirds of a year of schooling (figure 2.16).1 This significant gap can be addressed by several measures, including better learning environments. Student motivation is another area affecting performance. As confirmed in the Programme for International Student Assessment (PISA) 2015 data (World Bank 2018), motivated students can overcome income inequality and highly motivated students
Total
20 |
Learning Environments and Learning Achievement in the Russian Federation
from the bottom quintile of the income distribution can achieve the performance on PISA of poorly motivated students from the top quintile. The TIMSS data support this claim. Students saying that they like math and numbers—saying that math is not boring—score significantly higher than students who do not like math (figure 2.17). School perception and motivation of students can improve learning outcomes and create significant gains in student learning. Other characteristics of school buildings and learning environments can also play a role, including bullying and teaching styles.
Bullying index Similar to the school environment index, a bullying index was created using principal component analysis. The index has nine components—student responses on a scale from 1 to 3 (3 = at least once a week; 2 = 1–2 times per month; 1 = several times per year; 0 = never)—responding to the statement, “Other students did the following to me”: (a) made fun of my clothes; (b) said mean things about me; (c) shared my secrets with others; (d) refused to talk with me; (e) spread embarrassing information about me (including photos), (f ) threatened me; (g) hurt me; (h) excluded me from groups including online; or (i) damaged my belongings on purpose. According to the results of the analysis, more bullying occurs between boys than girls, including violent acts and verbal abuse, and the difference is statistically significant. Girls more often share each other’s secrets or refuse to talk than boys, and the difference is statistically significant. The difference in the bullying index between girls and boys is not statistically significant (figure 2.18). Bullying has a significant effect on student performance (figure 2.19). Students who are frequently bullied are significantly behind their peers who are not bullied. The difference in scores for students who are frequently bullied and those who are not bullied is 6 points. More bullying occurs (higher index) in schools with students with low socioeconomic status or background.2 The problem of bullying is important. For a long time, bullying was thought to be only an issue of security and safety in schools. This study shows that the issue of learning outcomes is more important than either safety or security. Bullying holds students back and impairs their ability to learn. The SES of students has a role in the frequency of bullying as well. The distribution between FIGURE 2.18
Prevalence of bullying, by socioeconomic status and gender of children b. By gender
a. By socioeconomic status Spread lies about me Shared my secrets to others Said mean things Refused to talk Shared embarrasing info about me Sent mean messages Made fun of me Insulted family Forced to do something Hurt me Banned (including online) Stole something from me Damaged property Threatened
Spread lies about me Refused to talk Shared my secrets to others Said mean things Shared embarrasing info about me Sent mean messages Made fun of me Banned (including online) Forced to do something Hurt me Stole something from me Insulted family Damaged property Threatened 0
20
40
60
80
100
Percent of students Top 20 percent
Bottom 20 percent
0
10
20
30
40
50
Percent of students Boys
Girls
Source: World Bank estimates based on Trends in International Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data.
60
70
Results and Discussion | 21
FIGURE 2.19
Bullying and learning outcomes
10 0
Math
Science
Total At least once a week A few times a year
.0 45
.5
51
.7
57
42
.4
40
.6
50
51
.0
60
35
44
51
.8
.6
56
.9 52 42 .3
20
Student test scores
30
.6
50
31
Student test scores
60
40
b. Pupils hurt me
.9
a. Pupils made fun of me
30 20 10 0
Math
Science
Total
Once or twice a month Never
Source: World Bank estimates based on Trends in International Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data.
FIGURE 2.20
Role of bullying in student performance and its connection to socioeconomic status of students a. Test scores for bottom 20 percent who are not bullied and top 20 percent who are bullied
Student test scores
40
Bullying index
56.2 54.9
60 50
41.5 39.9
30 20 10 0
b. Bullying index, by SES quintile
Math***
Science***
Bottom 20 percent (not bullied) Top 20 percent (bullied)
0.15 0.1 0.05 0 –0.05 –0.1 –0.15 –0.2 –0.25 –0.3 Bottom Second 20 percent (poor)
Third
Forth
Top 20 percent (rich)
Source: World Bank estimates based on Trends in International Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data. Note: SES = socioeconomic status. *** Key areas of school curricula for TIMSS assessment.
quintiles shows that the maximum amount of bullying happens in the bottom 20 percent of the SES distribution (figure 2.20). The findings of this section have several policy implications. The issue of bullying is a multidimensional problem related to safety and security, learning outcomes, and equity. Tackling it can help to solve many educational problems, and targeting the effort toward students in the bottom 20 percent of SES is crucially important.
TEACHING PRACTICES AND LEARNING OUTCOMES Major findings: The way in which teaching and learning happens is important. The diversity of layouts used, as reported in responses to the SUS questionnaire administered in Russian schools, is surprising. Teachers team teach, though rarely. The teaching approaches used affect student learning outcomes. Team teaching and group work have a statistically significant effect on student outcomes, potentially explaining the two-thirds of a year learning gap reported in TIMSS. The equity in the distribution of teaching methods is also important. While teachers provide group and individual work
22 |
Learning Environments and Learning Achievement in the Russian Federation
less often to students of low SES, these methods are found to be effective for students from the bottom 40 percent of SES distribution. This report analyzes how learning practices and spatial arrangements affect student outcomes. The OECD’s School User Survey suggests four types of learning styles and related learning spaces: (a) the traditional transmission of knowledge and direct instruction; (b) group work, which is the arrangement of students into smaller groups for discussions and joint work; (c) individual work, which is more self-paced learning; and (d) team teaching, in which a team of teachers works with a large group of students. Teaching styles require different spaces (figure 2.21, panel a–d). Traditional direct instruction is possible within classrooms. Group work is still possible in classrooms but is harder to implement, while individual assignments can be done anywhere. Team teaching requires significantly different spaces. All of these activities are possible in flexible learning spaces. The stronger the effect of types of innovative teaching and learning, the stronger the argument for implementation support. The traditional form of teaching prevails in Russian schools. In the schools sampled for this study, 95 percent of teachers said that they use direct instruction every day or at least two to four times per week (table 2.1). Individual work is also common. Team teaching is a rare phenomenon in Russian schools, with 68 percent of teachers saying that it never happens. However, teachers reported that team
FIGURE 2.21
Types of teaching and learning styles a. Presentation
b. Group
Layouts that support explict instruction or presentation to the whole group
c. Individual
Layouts that support approaches where students are required to collaborate and work in small groups to share ideas and help each other
d. Team teaching
Layouts that support approaches where students work independently to write, read, research, think, and reflect
Teacher
Layouts that support approaches where two or more teachers work collaboratively with groups of students sharing the same space
Pupils
Source: Based on OECD School User Survey (SUS) (OECD 2018) data.
TABLE 2.1 Share
of teachers using teaching styles, by frequency NEVER
1–3 TIMES PER MONTH
1 PER WEEK
Direct instruction (presentation)
TEACHING STYLE
0.65
1.95
2.6
Small group instruction
2.6
31.17
28.57
27.92
6.49
3.25
Individual
3.9
14.29
20.13
24.68
36.36
0.65
68.18
16.88
2.6
1.95
5.19
5.19
Team teaching
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data.
2–4 PER WEEK
20.78
EVERY DAY
73.38
MISSING
0.65
Results and Discussion | 23
teaching occurs between one and three times a month in almost 17 percent of cases and every day in 5 percent of cases. These data suggest that the practices exist, and deeper analysis of those practices may reveal more information about how teachers collaborate and how they use learning spaces. Group work is another rarely used practice. Group work takes place at different levels of intensity, but not every day. The analysis also shows that more experienced and senior teachers use small group instruction and individual learning approaches more often than inexperienced teachers. Results of a regression analysis suggest that direct instruction is used more often by full-time teachers and in schools that enroll a higher number of students and have a higher teacher workload, that is, more instructional time. While controlling for the type of settlement (city, big or small town, village), the analysis shows no relationship between the frequency of using a direct instruction style and teachers’ age, gender, and teaching experience (seniority). Regarding the equitable distribution of learning styles, our analysis shows that teaching and learning styles are more diverse in schools with students with higher SES, but less diverse in schools with students with lower SES (figure 2.22). The difference for group work and individual work is significant, while direct instruction and team teaching show little difference with regard to student SES. The student wealth index and student SES show a significant difference in learning outcomes. The difference is equivalent to three-quarters of a standard deviation or three years of schooling (figure 2.23). The gap is significant, and further analysis on larger samples is warranted. The major finding of this study supports the argument that innovative teaching styles positively affect student learning outcomes. Team teaching and group work are positively correlated with the learning outcomes of students (figure 2.24). At the same time, the use of direct instruction and individual work shows no difference in TIMSS scores. The magnitude of the effect on learning outcomes is significant: (a) the use of team teaching adds four points to the TIMMS score, which accounts for around 10 months of learning, and (b) the use of group work adds three points to the TIMSS score, which accounts around 7 months of learning. While the findings show significant gains from the use of diverse teaching styles, the question of equity remains important. Therefore, the team ran the same
FIGURE 2.22
Share of teachers who regularly (at least two to four times per week) use teaching practices, by student socioeconomic status
Percent of teachers
80
40
0
73
74
70
66
44
41 30
29
Group work* Low SES
Individual work* High SES
Source: World Bank estimates based on OECD School User Survey (SUS) (OECD 2018) data. Note: SES = socioeconomic status. * Statistically significant at 0.1 percent confidence level.
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 2.23
Student scores, by student wealth index and socioeconomic status index quintiles
Student test scores
60 50 40
55.8 40.4
b. Student SES index Student test scores
a. Student wealth index 70
60.0
46.2
30 20 10 0
Math***
70
62.2
60
51.1
50.0
50 40
36.1
30 20 10 0
Science***
Math***
Science***
Bottom 20 percent (low SES) Top 20 percent (high SES)
Bottom 20 percent (poor) Top 20 percent (rich)
Source: World Bank estimates based on Trends in International Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data. Note: SES = socioeconomic status. *** Statistically significant at 0.01 percent confidence level.
FIGURE 2.24
Student scores, by teaching styles a. Direct instruction
30 20 10 Math
Science
40
0
Total
Math**
30 20 10 Science
40
.7 50
Total***
30 20 10 0
Total Yes
58 .6 55 .1
50
45 .3 40 .2
51 .2 51 .7
56 .6
42
.6 42
Student test scores
60
.3 57 .1
70
Math
Science*** d. Team teaching
60
0
53 .6
10
70
40
.0
0
20
c. Individual work
50
56
59 . .5
30
53 .7 49 .5
0
50
41 .9
40
60
44
Student test scores
51 .7 51 .3
.7
.9
70
.2
56
56
b. Group work
42
50
.9
60
42
Student test scores
70
Student test scores
24 |
Math***
Science***
Total***
No
Source: World Bank estimates based on Trends in International Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data. Note: A teacher using styles every day or at least two to four times per week. ** Statistically significant at 0.05 percent confidence level; *** Statistically significant at 0.01 percent confidence level.
Results and Discussion | 25
FIGURE 2.25
.0
.6
55 .4 37
41
.0
53
.0
.6
.0 .4 37
41
.0 .3 38
41
53
55
.4 53
53 .5 39 .3
38
Student test scores
50 40
57
.7 54 .8
60
.1
Student scores in the bottom 40 percent of socioeconomic status, by teaching style
30 20 10 0 Math
Science
Direct instruction (presentation)
Math
Science*
Group work
Every day or 2–4 times per week
Math**
Science
Individual work
Math*
Science
Team teaching
One time per week or less often
Source: World Bank estimates based on Trends in International Mathematics and Science Study (TIMSS 2019) and OECD School User Survey (SUS) (OECD 2018) data. * Statistically significant at 0.10 confidence level; ** Statistically significant at 0.05 confidence level.
calculations on the bottom 40 percent of the distribution by SES. The bottom 40 percent was chosen to keep the significance of the observations, as the bottom 20 percent would not provide enough discriminative power due to the sample size. The data suggest that the strength of the effect of the learning environment fades out but persists for team teaching and group work. Individual work is a significant factor for math performance, specifically for the group of students with lower SES (figure 2.25).
DISCUSSION This study shows that providing a more diverse education leads to better learning outcomes. Teachers support these diverse practices, and the school learning environment may support (and stimulate) such approaches. The study does not promote any particular teaching style. However, it suggests that diversity in teaching styles may enhance learning outcomes. Ensuring a conducive environment for group work and team teaching in Russian schools may require different spatial arrangements of school settings. Some international examples of taking a unified government approach to innovations in schools are noteworthy (box 2.1). Several products from Denmark’s education reform are publicly available and have been translated into Russian. Drawing from international lessons and research, the following organization of spaces and furniture may support these teaching styles, while its absence could hinder the learning process.
Effective seating arrangements Group work and team teaching involve more collaboration between students, as well as teachers and students, which leads to intensive communication activities. How the seating is arranged may help to make this communication more effective. The organization of group work can be done in rows, U-shaped seating layouts, circles, or clusters. A cluster is the arrangement of student desks that allows the teacher to
26 |
Learning Environments and Learning Achievement in the Russian Federation
BOX 2.1
Denmark: School design with the users In 2005 and 2014, Denmark changed the requirements for secondary and primary school environments. These requirements reflected changes in the curricula and teaching methods and extended the length of the school day to accommodate a minimum of 45 minutes of physical activity per day. Danish municipalities started hiring architects to develop new designs for such schools. The main features of these new designs were open and connected spaces, flexibility of spaces and furniture, availability of areas for group, individual activity, and recess (for example, nooks), and transformation of corridors and stairs into active learning environments (Hallström 2014). From 2009 to 2018, the Danish Government’s Quality Foundation allocated DKr 22 billion for state cofinancing of municipal projects, including the construction of schools. The main emphasis was on involving users (pupils, teachers, administrators, parents,
residents) at the initial stage of new school design (Realdania 2010). In 2010, the National Association of Danish Municipalities and the Danish investment agency Realdania prepared and published a model program on school design. The model curriculum for schools was based on the case studies of various school construction projects and current knowledge accumulated in this field. It highlighted the current and future needs of children, adolescents, and employees in the physical framework of a sustainable school setting. In the model program, particular attention was paid to how different principles of school physical environment can better support important needs for the school’s activities. A model program is a catalog of inspiration that can be used actively in planning, programming, construction, design, and daily operation, when the client and users both want to achieve good results (Realdania 2010).
place children either in groups or in pairs. Together with U-shaped seating, it is considered a suitable arrangement of students for cooperative learning (Ridling 1994). According to the research findings, students sitting in circles can engage significantly more during the lesson than students sitting in rows. At the same time, students sitting in cluster settings are more active than students sitting in rows, but less active than those sitting in circles (Rosenfield, Lambert, and Black 1985).
Acoustical arrangements Intensive communication, which occurs during team teaching and group work, requires special acoustical conditions for speaking and listening. Teachers and students should be able to hear each other clearly over short distances within the class zone, while the zone beyond the class should be free of noise. It is important to maintain an acoustical balance between different learning activity zones, including areas for private communication (Vugts et al. 2017).
Open-plan arrangements A diversity of activities during group work and team teaching requires the possibility of eliminating spatial barriers within the learning environments and evolving into more open areas. A study on teacher practices and learning environments in Australia and New Zealand reveals that different open-plan arrangements correlate with better scores on deep learning of students and are associated with fewer teacher-centered practices (box 2.2; Imms et al. 2017).
Results and Discussion | 27
BOX 2.2
Australia: Demand for new layouts Australia is experiencing a boom in school constructo other users such as elderly populations and adults, tion due to the growing number of school-age children which guarantees optimal use of the building (17 percent increase by 2026). Land prices, urban den • Sharing of some functional spaces with the city (for sity, and need for cost efficiency have created a new example, a public library) trend in school design in Australia—“vertical” (high- rise) schools. The physical environment of this type of • Openness and flexibility of school spaces, both school has the following characteristics: indoor and outdoor (Ernst & Young 2018) • High-rise buildings • Multifunctionality of a facility (school usually includes a preschool, primary, and secondary school under one roof ) • Connection to the local community (some parts of the facility are designed to be open in evening hours
However, the analysis of the Innovative Learning Environments and Teacher Change study found that conventional or traditional classrooms account for about 75 percent of all spaces in Australian and New Zealand schools. Teachers in these environments still use a direct instruction approach to deliver education, and students are less involved in deep learning (Imms et al. 2017).
FIGURE 2.26
A typology of six spatial arrangements found in schools a. Classrooms along corridors
b. Classrooms with a breakout space
c. Classrooms with flexible walls
d. Classrooms with flexible walls and breakout space
e. Open plan with the possibility of creating classrooms
f. Open plan
Source: OECD 2019.
28 |
Learning Environments and Learning Achievement in the Russian Federation
FIGURE 2.27
Example of a school in the Russian Federation with an open multifunctional space
Source: © Governor of Yamalo/Nenetsk autonomus Okrug, Russian Federation. Used with the permission of the Governor of Yamalo/Nenetsk autonomus Okrug, Russian Federation. Further permission required for reuse.
The typology of the most common school learning environment arrangements is suggested by the studies of Imms et al. (2017) and the OECD (2019) (figure 2.26, panels a–f ). These typologies share a common vision related to the flexibility of different levels between fixed and completely open-plan schools. Few schools in Russia support these new types of learning. The World Bank team has been working with some of these schools recently. One example is the shiny Horoshkola,3 and another example is the school in Muravlenko City of the Yamalo-Nenetskiy region of Russia (figure 2.27). The simple solution for the school in Muravlenko was to include an internal courtyard and open the space for diverse teaching and learning experiences. There is more anecdotal evidence, with schools reporting innovative practices and spacial arrangements. This practical implementation requires additional review and collection of case studies.
NOTES 1. Based on the evidence from international large-scale assessments, the learning gains on most national and international tests during one year are equal to between one-quarter and one-third of a standard deviation (Woessmann 2016). Thus, in the TIMSS 2019 pilot the difference of five test scores is equivalent to a learning gap of one year of schooling.
Results and Discussion | 29
2. SES index components include (a) home ownership of assets and (b) parents’ education. Home ownership includes availability of books available at home, availability of a personal computer or tablet, desk a for learning, a separate room, Internet access, a mobile phone, musical instruments (for example, violin, piano), an automobile (one or more), an apartment with four or more rooms, and a dishwasher. 3. For information on Horoshkola, see https://horoshkola.ru/.
REFERENCES Anderson-Butcher, Dawn, Hal A. Lawson, Aidyn Iachini, Gerald Bean, Paul D. Flaspohler, and Keith Zullig. 2010. “Capacity-Related Innovations Resulting from the Implementation of a Community Collaboration Model for School Improvement.” Journal of Educational and Psychological Consultation 20 (4): 257–87. Barrett, Peter, Fay Davies, Yufan Zhang, and Lucinda Barrett. 2015. “The Impact of Classroom Design on Pupils’ Learning: Final Results of a Holistic, Multi-Level Analysis.” Building and Environment 89 (July): 118–33. Barrett, Peter, Alberto Treves, Tigran Shmis, Diego Ambasz, and Maria Ustinova. 2019. The Impact of School Infrastructure on Learning: A Synthesis of the Evidence. International Development in Focus. Washington, DC: World Bank. https://openknowledge.worldbank.org/handle/10986/ 30920. Blatchford, Peter, Ed Baines, Christine Rubie-Davies, Paul Bassett, and Anne Chowne. 2006. “The Effect of a New Approach to Group-Work on Pupil-Pupil and Teacher-Pupil Interaction.” Journal of Educational Psychology 98 (4): 750–65. Dekker, Rijkje, Marianne Elshout-Mohr, and Terry Wood. 2006. “How Children Regulate Their Own Collaborative Learning.” Educational Studies in Mathematics 62 (1): 57–79. Ernst & Young. 2018. “Revolutionizing Education from the Ground up: How Will Vertical Schools Change the Nature of Education?” https://www.ey.com/Publication/vwLUAssets /ey-revolutionising-education-from-ground-up/$FILE/ey-revolutionising-education-from -ground-up-how-will-vertical-schools-change-the-nature-of-education.pdf. Fielding, Michael. 2006. “Leadership, Radical Collegiality, and the Necessity of Person-Centered Education.” Paper presented at the ESRC Teaching and Learning Research Programme (TLRP) Thematic Seminar Series, “Contexts, Communities, Networks: Mobilising Learners’ Resources and Relationships in Different Domains,” Seminar Four, “Cultures, Values, Identities, and Power,” University of Exeter, February 22. Hallström, Sofia. 2014. “Danish Lessons.” FORM (Nordic magazine on architecture and design) 5: 84–86. Imms, Wesley, Marian Mahat, Terry Byers, and Dan Murphy. 2017. Type and Use of Innovative Learning Environments in Australasian Schools. ILETC Survey No. 1. Melbourne: LEaRN, University of Melbourne. http:// w ww.iletc.com.au/ w p- c ontent/ u ploads/ 2 017/ 0 7/ TechnicalReport_Web.pdf. Oblinger, Diana, and Joan K. Lippincott. 2006. “Learning Spaces.” Brockport Bookshelf 78, College at Brockport, State University of New York. https://digitalcommons.brockport.edu/bookshelf /78. OECD (Organisation for Economic Co-operation and Development). 2018. OECD School User Survey: Improving Learning Space Together. http://www.oecd.org/education/OECD-SchoolUser-Survey-2018.pdf. ———. 2019. “Analytical Framework for Case Study Collection: Effective Learning Environments.” EDU/EDPC/GNEELE(2018)3/REV1, Group of National Experts on Effective Learning Environments, Directorate for Education and Skills, Education Policy Committee, OECD, Paris. https://bit.ly/2MLS9I6. Realdania. 2010. “МОДЕЛЬНАЯ ПРОГРАММА ДЛЯ ОБЩЕОБРАЗОВАТЕЛЬНЫХ ШКОЛАгентство [Danish Model Program for Schools].” Realdania, Copenhagen. http:// documents.worldbank.org/curated/en/734251533070308219/pdf/Danish-Modelprogram-for -Schools-RUS.pdf.
30 |
Learning Environments and Learning Achievement in the Russian Federation
Ridling, Zaine. 1994. “The Effects of Three Seating Arrangements on Teachers’ Use of Selective Interactive Verbal Behaviors.” Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA, April 4–8. Rosenfield, Peter, Nadine M. Lambert, and Allen Black. 1985. “Desk Arrangement Effects on Pupil Classroom Behavior.” Journal of Educational Psychology 77 (1): 101–08. http://dx.doi.org/10.1037 /0022-0663.77.1.101. TIMSS (Trends in Mathematics and Science Study). 2019. Retrieved at: http://www.centeroko.ru/ timss19/timss2019_info.html. Vugts, Jeroen, Esther van Oorschot-Slaat, Collin Campbell, and Holger Brokmann. 2017. “Effective Open Learning Landscapes and the Well-Being of Teachers and Students.” Paper prepared for the 12th ICBEN (International Commission on Biological Effects of Noise) Congress on Noise as a Public Health Problem, Zurich, June 18–22. Woessmann, Ludger. 2016. “The Importance of School Systems: Evidence from International Differences in Student Achievement.” Journal of Economic Perspectives 30 (3): 3–31. World Bank. 2018. “Education Equity in the Russian Federation: Summary Report.” Working Paper 127743, World Bank, Washington, DC. http://documents.worldbank.org/curated/en/ 139291530189329351 /Education-Equity-in-the-Russian-Federation-Summary-Report.
3
Recommendations and Conclusion
RECOMMENDATIONS FOR POLICY MAKERS This report has examined the situation in Russian schools and education approaches used in classrooms. The main findings confirm the prevalence of traditional practices in Russian schools and the lack of diverse approaches to teaching and learning. Where they exist, diverse practices help to improve student outcomes. In terms of the framework, the study shows that the basic needs of Russian education are covered, apart from security and bullying. The spaces in schools are not always optimal for learning, and there are areas for policy attention to improve schools further for teachers and students. The fit for purpose is not matched for those schools that try to innovate with learning. Thus, to improve learning environments and learning outcomes, significant upgrades will need to be made. The research suggests three pillars for policy makers to consider.
Pillar 1. Nationwide school infrastructure analysis and development • The existing stock of school buildings needs to be reviewed and documented. The characteristics to be documented include the current conditions, types of designs, cost of maintenance, and need for rehabilitation. • The majority of Russian schools feature traditional corridors that are not conducive to flexible educational approaches. Teachers in Russian schools have the ability to change layouts and arrangements within classrooms. However, the design of corridors and classrooms and lack of larger common spaces in most schools limit the use of team teaching. The organization of small group work in breakout rooms may also be limited. The study suggests that school learning spaces are not limited to the classroom and that all school spaces should be used for learning. Simple solutions informed by the best practices and modern architecture may be applied at scale in the Russian Federation (boxes 2.1 and 2.2).
31
32 |
Learning Environments and Learning Achievement in the Russian Federation
Pillar 2. School leadership • Targeted efforts are needed. The study shows that advanced teaching styles are frequently used in schools with a large concentration of students with higher socioeconomic status. These teaching practices work well regardless of the student’s socioeconomic status (SES). It is thus recommended to build policies that encourage schools to use these approaches. Specifically, the analysis shows that the arrangements for individual learning can improve the learning outcomes of students with lower SES. • Bullying is a problem in Russian schools, and it is both an issue of safety and an issue of learning outcomes. The study clearly shows that bullying by itself is a complicated phenomenon with several dimensions related both to gender and to equity. Most important, a higher frequency of bullying is negatively correlated with lower academic achievement. Bullying more often occurs in schools with a concentration of students with low SES and, at the same time, is associated with lower Trends in Mathematics and Science Study (TIMSS) results. Conducting more research in this area and devising measures to combat bullying—both by developing psychological resilience and by creating safer learning spaces—should be considered. Transparency in schools and open areas may help to reduce bullying (passive measures). Creating spaces that could limit the possibility of bullying is a new area of research and experimentation that could be promoted in Russia. • School satisfaction has a direct link to academic achievements and teacher job satisfaction. Better learning spaces in schools lead to better satisfaction of teachers with their job and their workplace. This is an area of agreement between teachers and principals. The satisfaction of students with schools has a positive connection with their academic achievement. Thus, creating better schools leads to better teaching and better learning. The government may consider several suggestions offered here for designing policy documents and functional requirements for new and existing schools in Russia.
Pillar 3. Analysis and improvement of classroom practices • An understanding of teaching and learning in classroom settings in Russia needs to be expanded. Similar to the findings of the World Bank equity study in 2018, this review sheds light on the emerging practices (World Bank 2018). For example, while schools and teachers in Russia claim that they use team teaching and other best practices, they do so rarely. While teachers in Norway say that they use layouts supporting team teaching either every day in 50 percent of the cases or at least once a week in all other cases, Russian teachers say that they never arrange such activities in 68 percent of the cases. The research and identification of these practices in Russian schools may yield valuable lessons for other schools and the system overall. • A strong relationship exists between the academic achievement of students and teaching styles. The most advantageous teaching styles for learning outcomes are those where teachers organize group work for the students and where teachers work in team-teaching arrangements. As reflected in the TIMSS results, there is a difference of roughly one year of learning between those students who are exposed to such approaches and those who are not. This finding should lead policy makers to pay more attention to teacher training and preservice and in-service institutions to incorporate the practice of team teaching into their training.
Recommendations and Conclusion | 33
CONCLUSION This study is the first of its kind to suggest a connection between learning environments and learning outcomes as measured by TIMSS. The study sheds more light on the initial research questions and, for the sampled schools, shows that how teaching and learning are delivered matters. When teachers arrange group work in the classroom and work collaboratively with large groups of students, they achieve learning gains for all income groups. The perception of schools by students, their feeling of security, and the frequency of bullying have a direct connection with learning outcomes. Better conditions in schools and rare to no bullying have a strong link with positive learning outcomes. The study shows that solving some of the problems (like severe bullying) could help to close a one-year learning gap. Therefore, smart investments in learning environments and teacher preparation can help to improve national education and competitiveness. This study has potential limitations. The sample size includes mostly urban schools from three Russian regions, located in the central and northwest administrative districts of the country. A larger sample, consisting of all regions, would yield statistically more significant results. Additionally, it would be essential to include more rural schools as well as different types of schools (for example, private, specialized) and to analyze potential disparities between the territorial areas and the regions themselves. The lack of empirical research on learning environments in Russia requires more in-depth studies on the practices of teachers and students in existing learning environments. Case studies, focus groups, and interviews with survey respondents could bring additional qualitative information to the research findings. It is especially important to expand the knowledge base on the practice of team teaching, which seems to be a promising approach to the delivery of learning. Lastly, further study should include several measures of socioemotional skills or collaborative problem-solving skills, the 21st-century skills that seem to be better developed in innovative settings.
REFERENCE World Bank. 2018. “Education Equity in the Russian Federation: Summary Report.” Working Paper 127743, World Bank, Washington, DC. http://documents.worldbank.org/curated/ en/139291530189329351/Education-Equity-in-the-Russian-Federation-Summary-report.
ECO-AUDIT
Environmental Benefits Statement The World Bank Group is committed to reducing its environmental footprint. In support of this commitment, we leverage electronic publishing options and print-on-demand technology, which is located in regional hubs worldwide. Together, these initiatives enable print runs to be lowered and shipping distances decreased, resulting in reduced paper consumption, chemical use, greenhouse gas emissions, and waste. We follow the recommended standards for paper use set by the Green Press Initiative. The majority of our books are printed on Forest Stewardship Council (FSC)–certified paper, with nearly all containing 50–100 percent recycled content. The recycled fiber in our book paper is either unbleached or bleached using totally chlorine-free (TCF), processed chlorine–free (PCF), or enhanced elemental chlorine–free (EECF) processes. More information about the Bank’s environmental philosophy can be found at http://www.worldbank.org/corporateresponsibility.
T
INTERNATIONAL DE VELOPMENT IN FOCUS
his book presents the main findings of a study on school learning environments and student outcomes, which the World Bank conducted in 2019 in three regions of the Russian Federation. Using data collected through the OECD School User Survey and the pilot “Trends in Mathematics and Science Study” (TIMSS), the book analyzes how a school’s infrastructure and learning environment may affect the progress and success of students in math and science. It also delves into teaching practices, analyzing their impact on learning and highlighting the important nexus between learning environments and teaching methods. The book concludes by recommending areas in which focused attention by educational authorities could improve educational policy and help maintain high-quality learning environments. The book will be useful for educators, school principals, architects, and policy makers who are involved in school infrastructure projects and are interested in increasing their knowledge of school design planning.
Learning Environments and Learning Achievement in the Russian Federation How School Infrastructure and Climate Affect Student Success Tigran Shmis, Maria Ustinova, and Dmitry Chugunov
ISBN 978-1-4648-1499-0
SKU 211499
9781464814990_Cover.indd All Pages
05/12/19 6:37 PM