Skip to main content Accessibility help
×
Hostname: page-component-6bb9c88b65-t28k2 Total loading time: 0 Render date: 2025-07-25T05:26:34.437Z Has data issue: false hasContentIssue false

1 - Mathematics and Science Learning in Primary and Secondary School EMI Classrooms

Evidence from PISA and TIMSS

from Part I - Theoretical Chapters

Published online by Cambridge University Press:  14 December 2024

Samantha M. Curle
Affiliation:
University of Bath
Jack Pun
Affiliation:
City University of Hong Kong

Summary

To develop human capital in the globalized world, governments have implemented policies that require the teaching of some or all school subjects in English. However, the implementation of this policy has faced criticism and challenges in some countries where linguistic and cultural diversity is prevalent. These challenges include school segregation based on the medium of instruction, inadequate English proficiency of teachers and students and less interaction in English Medium of Instruction classrooms. Some researchers have investigated these challenges through international assessments such as the Programme for International Student Assessment and Trends in International Mathematics and Science Study. Others have examined EMI mathematics and science classrooms qualitatively through observations and interviews. These studies showed that teachers and students are more comfortable, and the classroom environment is more interactive when they use their mother tongue. In general, the findings favoured the mother tongue education for both cognitive and noncognitive variables. Researchers recommend either switching to EMI after achieving a certain level of English proficiency or providing language support for students who are already in EMI systems. Finally, a case study from Wales suggested that providing questions in both the mother tongue and English might mitigate unfair linguistic advantages in international assessments.

Information

Type
Chapter
Information
Researching English Medium Instruction
Quantitative Methods for Students and Researchers
, pp. 11 - 26
Publisher: Cambridge University Press
Print publication year: 2024

1 Mathematics and Science Learning in Primary and Secondary School EMI Classrooms Evidence from PISA and TIMSS

Mathematics Learning in EMI Classrooms

Traditionally, mathematics is believed to be a subject that does not require strong language skills. However, researchers highlight the importance of a good command of language to be successful in mathematical reasoning and problem-solving (Bernardo, Reference Bernardo2005). Especially, word problems in mathematics require students to read and understand the problem to solve them. In English Medium Instruction (EMI) classrooms, if students have not yet mastered English, they might struggle to understand and solve word problems even though they do not have mathematical difficulties.

In some countries such as the Philippines, EMI in mathematics used to start as early as prekindergarten. In a quasi-experimental study, Ricablanca (Reference Ricablanca2014) compared the mathematics achievement of first-grade students in EMI and mother tongue instruction classrooms. The participants were sixty-three first-grade students (thirty-one mother tongue, thirty-two EMI) from the same school in the Philippines. During this period, the students were taught the same lessons by the same teacher and exposed to the same activities and homework in two different media of instruction. Students took the same achievement test as the pretest, posttest, and retention test, but the mother tongue classroom took the test in their mother tongue whereas the EMI classroom took it in English. Paired samples t-test and analysis of covariance (ANCOVA) were used to analyze the data. Students in the mother tongue classroom received significantly higher scores on the mathematics achievement test compared to their peers in the EMI classroom both in the posttest and in the retention test. The researcher recommends that the school systems should consider using the mother tongue for mathematics instruction in the early years since important mathematical concepts are easier to grasp in the mother tongue. When students try to learn a subject such as mathematics in a language they have not yet mastered, they take on a cognitive load alongside learning the concepts, which affects their academic performance negatively. In 2013, the Philippines government institutionalized the use of the mother tongue in all subjects from preschool to third grade as part of a new educational law. This decision has not been welcomed by parents and students due to the perceived high value of English in society (Tupas, Reference Tupas2015). However, recent studies point out the academic advantage of mother tongue instruction in the Philippines (Perez & Alieto, Reference Perez and Alieto2018).

Hong Kong is another country where EMI in mathematics and science teaching has been debated. In a meta-analysis, Lo and Lo (Reference Lo and Lo2014) systematically analyzed twenty-four studies on EMI education in Hong Kong. Most of the studies were cross-sectional and correlational, so the authors cautioned against making strong claims. Effect size estimation and z-statistics were used to determine the statistical significance of the results. Effect sizes between 0.2 and 0.5 were considered to be low, between 0.5 and 0.8 were moderate, and 0.8 and above were considered high. According to the findings, EMI schools were better in terms of English proficiency, but they fell behind Chinese-medium instruction (CMI) schools in science. There was not a sizable difference in mathematics. The authors highlighted the significance of the type of outcome measure such that EMI students scored better than their CMI peers when standardized tests were used; however, they scored worse when self-designed tests were used. In terms of affective learning outcomes, EMI students showed higher levels of self-concept, interest, and motivation toward learning in mathematics but not in science. They had lower self-concept and less interest in learning science compared to CMI students.

Some researchers recommend the use of learners’ mother tongue as a supplement to EMI when teaching mathematics. For example, in a pretest–posttest experimental design, Launio (Reference Launio2015) compared the mathematics achievement between EMI only and EMI supplemented with the Hiligaynon language in a Filipino high school. The author conducted independent samples t-test analyses in the Statistical Package for Social Sciences (SPSS) to examine differences in mathematics achievement between the two groups. Results showed that there was no significant difference in the pretest but in the posttest the bilingual group scored significantly higher than the English-only group at a 0.05 significance level. The author recommends that teachers should be able to explain concepts in learners’ mother tongue in EMI mathematics classrooms when difficulties in understanding arise.

Recent research in EMI mathematics learning recommends the use of translanguaging in classrooms. The primary objective of translanguaging is content learning. During translanguaging, students are allowed and encouraged to use both their first and second languages to make sense of scientific content and to facilitate their understanding (Karlsson et al., Reference Karlsson, Nygård Larsson and Jakobsson2019). Since students are allowed to use their full linguistic potential, a more equitable learning environment can be provided for all students regardless of their English language proficiency. During translanguaging, teachers can act as a learner rather than as the sole provider of knowledge. Through colearning opportunities, teachers and students learn from each other and coconstruct knowledge. Through comfortable dialogues, teachers can increase student motivation and self-confidence, create enjoyable classroom contexts, and conform to the EMI policy. Therefore, translanguaging in EMI classrooms can help achieve a range of pedagogical objectives for promoting student learning (Tai & Wei, Reference Tai and Wei2021a). Translanguaging may also help EMI teachers who are not confident in their English usage in classrooms since it allows the colearning of linguistic aspects such as pronunciation and the meaning of vocabulary.

Tai and Wei (Reference Tai and Wei2021b) introduced playful talk as a form of translanguaging in a middle school mathematics classroom. The playful talk involves the use of rhyming words, drawings, mnemonics, switching intonations, and personal experiences to promote meaningful communication between the teacher and students. In typical EMI mathematics classrooms, students have limited opportunities to interact with the teacher. However, playful talk in EMI classrooms creates a dynamic environment and facilitates students’ participation. The authors suggest that the longitudinal implementation of translanguaging through playful talk could provide further evidence of the effectiveness of this method for content acquisition in EMI classrooms.

Science Learning in EMI Classrooms

Language plays an important role in gaining scientific literacy (Gee, Reference Gee, Kamil, Mosenthal, Pearson and Barr2000; Yore et al., Reference Yore, Bisanz and Hand2003). Norris and Phillips (Reference Norris and Phillips2003) emphasize that scientific literacy involves reading, writing, and oral communication in science. These practices improve scientific reasoning and understanding. According to the definition of the Organisation for Economic Co-operation and Development (OECD), scientific literacy is the ability to engage with science-related issues and the ideas of science as a reflective citizen. This ability includes explaining natural and technological phenomena scientifically, designing scientific investigations, interpreting data, and drawing conclusions (OECD, 2017). El Masri et al. (Reference El Masri, Baird and Graesser2016) highlight that even though the OECD’s description of scientific literacy does not mention language or linguistic proficiency, one can only assume that high language proficiency is needed to acquire the set of abilities stated there. According to Cummins (Reference Cummins, Street and Hornberger2008), two sets of skills are needed for language learning. One of them is used for everyday communication and described as “basic interpersonal communicative skills.” The other one is called “cognitive academic language proficiency.” Learning a scientific language requires a second set of skills that can be complex and demanding (van Laere et al., Reference van Laere, Aesaert and van Braak2014). Cummins (Reference Cummins2000) points out that all learners need to develop academic language proficiency to engage with the more abstract ways of thinking and communicating required for academic learning. The requisite academic language proficiency takes much longer to develop compared to communicative proficiency. Therefore, students might appear to be orally proficient in English yet not perform well academically in EMI classrooms.

Yip et al. (Reference Yip, Tsang and Cheung2003) compared the science achievement of secondary students in EMI and CMI schools in Hong Kong through an achievement test made up of multiple-choice and open-ended questions. They used a multilevel regression model to explain the variance in students’ science achievement. They used aptitude, socioeconomic status, and gender at the student level and school-mean aptitude, school-mean socioeconomic status, and medium of instruction at the school level. Findings showed that EMI students performed worse than their peers in CMI. They performed especially poorly on items in which mastery of scientific terminology, abstract concepts, and application of scientific knowledge to real-life problems were tested. EMI students scored better only on multiple-choice items with low cognitive demand. These findings indicate that when students learn science in a language without mastering it, they are at a clear disadvantage compared to those who learn it in their mother tongue.

Another important concept in science learning is science process skills, which are the skills that scientists use to solve problems and construct knowledge. Science process skills include basic skills such as observing, inferring, predicting, measuring, classifying, and communicating; higher-level skills include defining operationally, hypothesizing, controlling variables, experimenting, and interpreting data. Students need these skills to carry out scientific investigations and to make sense of natural phenomena (Carin et al., Reference Carin, Bass and Contant2005; Harlen, Reference Harlen1999). Science process skills incite creativity, reflective thinking, and problem-solving in students, which are critical for the scientific and technological development of nations (Olufunminiyi & Afolabi, Reference Olufunminiyi and Afolabi2010). Therefore, science teachers in EMI classrooms should emphasize these skills in their teaching methodology (Tilakaratne & Ekanayake, Reference Tilakaratne and Ekanayake2017).

In a large-scale correlational study, Tilakaratne and Ekanayake (Reference Tilakaratne and Ekanayake2017) examined the science process skills of more than 6,000 secondary school students in Sri Lanka in terms of some variables, including the medium of instruction. Schools that participated in the study used three different languages as the medium of instruction: Sinhala (the primarily spoken language in Sri Lanka), Tamil, and English. Students took a science process skills test that measured their ability to observe, measure, classify, identify variables, infer, hypothesize, and experiment. Data were analyzed in SPSS through one-way analysis of variance (ANOVA), with the medium of instruction as the factor and the level of understanding of students’ science process skills as the dependent variable. The researchers used the Tukey post hoc test to compare pairwise means of the three groups, Sinhala, Tamil, and English. Results showed that students who studied science in Sinhala medium performed better in their understanding of science process skills compared to the students in Tamil and English medium. The general perception about the medium of instruction in Sri Lanka is that students who attend EMI schools perform better than students who attend Sinhala or Tamil medium of instruction schools. However, the findings of this study showed that in terms of science process skills, EMI students performed worse than students in the other two mediums.

In addition to cognitive learning outcomes, EMI may also negatively influence students’ affective learning outcomes in science. Yip and Tsang (Reference Yip and Tsang2007) investigated the self-concept of around 16,000 students attending Hong Kong’s EMI and CMI schools in Chinese, English, mathematics, and science subjects. Student achievement was measured through a written test near the end of the school year, and self-concept was measured by a student questionnaire given at the same time as the written tests. Student scores were compared through ANOVA in SPSS. In Chinese, English, and mathematics, EMI students showed a higher self-concept compared to CMI students. However, they showed a lower self-concept in science. Researchers claim that due to the reliance on abstract thinking and language proficiency, EMI students might experience learning difficulties in science classrooms, and therefore caution against the negative effects of EMI on science learning. This finding is especially concerning since EMI schools in Hong Kong recruit the top-performing students in terms of academic achievement (Yip & Tsang, Reference Yip and Tsang2007).

Science teachers often resort to mother tongue instruction in EMI classrooms to help their students understand complex science topics. Pun and Macaro (Reference Pun and Macaro2019) examined the types of teacher questions asked in the mother tongue and English in Hong Kong’s EMI high schools during science lessons. A total of thirty-three science lessons were observed, and observations were coded. Interrater coding reliability of Cohen’s kappa was found to be greater than 0.8, which indicates a reliable coding process. The teacher questions were classified as “lower order” and “higher order.” Questions that ask for factual recall information were coded as lower order, and questions that require students to explain a phenomenon, analyze, evaluate, and synthesize were coded as higher order. Findings showed that when teachers used English in EMI classrooms, they asked more lower-order questions, whereas when they switched to Cantonese, they asked more higher-order questions and the lesson was more interactive. Researchers emphasize that mother tongue use in EMI classrooms may promote higher-order thinking and meaningful science learning but it may also inhibit the acquisition of academic English. Pedagogical support programs for content subject teachers are recommended to improve their skills in integrating content and language. During these programs, case studies of the effective implementation of EMI in science classrooms can be provided.

Science teachers in EMI classrooms consider EMI as a tool for transmitting knowledge, not for learning a second language (Block & Moncada-Comas, Reference Block and Moncada-Comas2022; Pun & Tai, Reference Pun and Tai2021; Pun et al., Reference Pun, Thomas and Bowen2022). Even though most science teachers desire a flexible EMI policy where they can use their mother tongue for different purposes, excessive and incautious use of the mother tongue can be detrimental to the quality of EMI (Pun et al., Reference Pun, Thomas and Bowen2022). According to Williams (Reference Williams2002), in translanguaging, the alternation between languages should not be spontaneous but rather strategic to help students understand the content and scaffold their language learning. Recent studies showcase how translanguaging can be used in EMI classrooms to create an interactive and enjoyable science learning environment (Lin, Reference Lin2019; Pun & Tai, Reference Pun and Tai2021). In their study, Pun and Tai (Reference Pun and Tai2021) observed grade 10 biology and chemistry laboratory sessions in Hong Kong and analyzed how science teachers and students utilize translanguaging practices. They observed that even though teachers delivered instructions in English, students chose to communicate in Cantonese (their mother tongue) among themselves. They also used a wide range of modalities such as speaking, text, diagrams, and hands-on experiments. Researchers emphasized that not restraining students with English allowed them to engage in active scientific inquiry and argumentation. Translanguaging, especially, gives voice to those students with limited English proficiency, who are generally passive learners in monolingual EMI classrooms. As in EMI mathematics classrooms (Tai & Wei, Reference Tai and Wei2021a, Reference Tai and Wei2021b), translanguaging in EMI science classrooms reduces hierarchical relationships between the teacher and students and creates a safe space for colearning.

Evidence from PISA and TIMSS

Periodically conducted every three and four years, the Programme for International Student Assessment (PISA) and Trends in International Mathematics and Science Study (TIMSS) measure students’ performance in mathematics and science at the international level. PISA collects data from fifteen-year-old students across countries and partner economies every three years (OECD, 2019), while TIMSS monitors trends in mathematics and science achievement in the fourth and eighth grades every four years (Mullis & Martin, Reference Mullis and Martin2017). Based on the results of these comparative assessments, important policy decisions are taken in several countries regarding education systems (Anderson et al., Reference Anderson, Lin, Treagust, Ross and Yore2007). For example, due to the declining trend in mathematics and science performance in TIMSS, the Malaysian government changed the medium of instruction from English to Malay, the official language of the country spoken by the majority of the population, in 2012 (Thien & Ong, Reference Thien and Ong2015).

Besides measuring student performance, these assessments collect rich contextual information at the student, classroom, school, and national levels, and both datasets are publicly available on their related websites. Researchers can conduct secondary data analysis on the released datasets regarding their research interests. For instance, factors affecting cognitive and noncognitive outcomes within and across nations can be investigated.

PISA and TIMSS have similarities as well as differences. Both assessments collect rich contextual information through school, teacher, student, and home questionnaires. They do not use exact student achievement scores because students take only a portion of the test due to time constraints. Therefore, PISA and TIMSS offer plausible values as the measure of student achievement, each plausible value describing a random value of a student’s scores. The final scale is reported with an average of 500 and a standard deviation of 100 in all countries (Martin et al., Reference Martin, Mullis and Hooper2016; OECD, 2020). Both assessments use a probability proportional to size sampling procedure where the probability of selecting a sample depends on its size. However, in PISA, only a number of fifteen-year-old students are assessed from the selected schools, whereas in TIMSS, intact classrooms within the sampled schools participate in the assessment. Therefore, TIMSS contains classroom-level information since teachers who teach in these classrooms complete a questionnaire, but PISA does not have this information. Although a Teacher Questionnaire was implemented for the first time in PISA 2015, student-level data are usually aggregated into school-level variables. Another distinct difference between the two assessments is their testing objectives. PISA assesses the degree to which students apply their knowledge and skills to real-world problems (OECD, 2017), while TIMSS measures the mathematics and science achievement of fourth and eighth graders aligned with the national curricula (Mullis et al., Reference Mullis, Martin, Ruddock, O’Sullivan, Arora and Erberber2005).

In terms of the test language, the OECD advises that it should be consistent with the participating countries’ medium of instruction. Since several countries use more than one language of instruction in their education systems, the instruments have been translated into multiple languages. Tables 1.1 and 1.2 show the countries that used other test languages in addition to English. Countries use more than one medium of instruction for different reasons. For example, in Canada, the geographic region determines the educational language, and students’ home language is usually the same as the educational language. On the other hand, in Hong Kong, even though an overwhelming majority of students speak Cantonese at home, it is the government’s policy to implement EMI in schools. EMI schools in a country are usually tested in English in PISA and TIMSS. However, the final approval of the test language is up to the decision-makers in the countries (Ho, Reference Ho2007). In some countries with high levels of linguistic diversity, such as South Africa, the majority of students do not use either of the test languages (English and Afrikaans) at home (Prinsloo & Harvey, Reference Prinsloo and Harvey2020).

Table 1.1 PISA languages used for the assessment.

Country
CanadaEnglishFrench
CyprusEnglishGreek
Hong Kong (China)EnglishChinese
IrelandEnglishIrish
LebanonEnglishFrench
LuxemburgEnglishGerman
Macao (China)EnglishChinese
MalaysiaEnglishMalay
MaltaEnglishMaltese
PanamaEnglishSpanish
QatarEnglishArabic
SwedenEnglishSwedish
United Arab EmiratesEnglishArabic
Wales (UK)EnglishWelsh
Source: OECD (2020)

Table 1.2 TIMSS languages used for the assessment.

Country
BahrainEnglishArabic
CanadaEnglishFrench
CyprusEnglishGreek
EgyptEnglishArabic
Hong Kong SAREnglishChinese
GeorgiaEnglishGeorgian
IrelandEnglishIrish
JordanEnglishArabic
KuwaitEnglishArabic
LebanonEnglishFrench
MalaysiaEnglishMalay
MaltaEnglishMaltese
OmanEnglishArabic
PakistanEnglishUrduSindhi
QatarEnglishArabic
Saudi ArabiaEnglishArabic
South AfricaEnglishAfrikaans
United Arab EmiratesEnglishArabic

Hong Kong

Hong Kong is a country where schools with EMI are considered to be more prestigious compared to schools with CMI (Ho & Man, Reference Ho and Man2007; Tsiu, Reference Tsui2008). To examine the differences in student performance in Chinese and English, the PISA 2000 study conducted the test in both languages in Hong Kong. In their report, Ho and Man (Reference Ho and Man2007) focused on twenty-eight EMI schools tested in both Chinese and English. They compared the average scores for reading, science, and mathematics. Findings showed that reading and science scores were significantly higher with the Chinese version of the test compared to the English version of the test in EMI schools. The differences in mathematics were relatively smaller, with only five schools where students who took the test in Chinese scoring better. The authors emphasize that students in EMI schools have a better command of their mother tongue, which is Chinese in the case of Hong Kong, in terms of understanding and interpreting information in PISA. In another report, Ho (Reference Ho2007) compared the scientific literacy scores of students who took the PISA 2006 test in Chinese versus English from thirty-four EMI schools from grade 7 to grade 10. Students who were given the scientific literacy test in Chinese scored significantly higher than their peers who took the same tests in English, at all four grade levels.

Studies conducted with Hong Kong samples showed that EMI benefits only high-ability students. For the majority of students in EMI classrooms, using English is difficult; therefore, teachers often allow the use of students’ mother tongue. Despite the evidence that instruction in the native language is superior in terms of overall student achievement, parents prefer EMI schools due to their advantages in career prospects (Tsiu, Reference Tsui2008). However, Ho and Man (Reference Ho and Man2007) point out that unlike in Singapore and Malaysia where English is commonly used by different cultural groups, in Hong Kong, English-speaking and Chinese-speaking communities have distinct characteristics. Therefore, EMI and CMI schools can sometimes have wide economic and cultural disparities.

Malaysia

Malaysia has been indecisive regarding the medium of instruction issue. In 2002, as part of the country’s efforts to prepare its human capital for the globalized world, the government changed the medium of instruction for mathematics and science from Malay to English. However, there was a decline in both the mathematics and science performance of Malaysian students in TIMSS assessments after 2002. As a result, the government reverted to using Malay as the medium of instruction for mathematics and science in 2012 (Thien & Ong, Reference Thien and Ong2015).

Ismail and Awang (Reference Ismail and Awang2012) investigated the relationship between student background variables and TIMSS 2007 mathematics achievement in Malaysia through multiple regression analysis. They found that students who did not speak the language of the test, which was Malay, at home scored significantly higher than those who did. They also conducted ANOVA where the frequency of speaking the test language at home was the factor. Findings suggested that students who speak the test language at home most frequently had lower mathematics achievement than other groups. These findings were consistent with the results of TIMSS 1999 and 2003. However, the medium of instruction was Malay in both 1999 and 2003, while it was English in 2007. The authors concluded that the medium of instruction did not significantly affect Malaysian students’ mathematics performance.

Singapore

The medium of instruction in Singapore has been English since the 1970s. Singapore has always been very successful in TIMSS and PISA assessments and has been among the High-Performing Education Systems alongside Hong Kong, South Korea, and Finland. Although Singapore’s success in using English as a medium of instruction is impressive, other political decisions have also contributed to its success, such as promoting English as an official language, emphasizing math and science education, and establishing high standards, academic merit, and high-stakes exams in education (Deng & Gopinathan, Reference Deng and Gopinathan2016).

Thien and Ong (Reference Thien and Ong2015) examined the influence of the affective characteristics of Singaporean and Malaysian students on their PISA 2012 mathematics achievement. They conducted two-level (student and school) hierarchical linear modeling (HLM) analyses for both countries. They reported that in both countries mathematics-related self-efficacy and anxiety have significant effects on mathematics performance at the student level. However, Malaysian students showed high levels of anxiety and low levels of self-efficacy compared to Singaporean students. The authors have not used language-related variables but they speculated that the high levels of mathematics anxiety in Malaysia could be due to the use of English as a medium of instruction in mathematics classrooms. The declining trend in TIMSS assessments after switching to EMI in mathematics classrooms could also be due to increased levels of anxiety among Malaysian students.

South Africa

In South Africa, despite the recent reformation toward multilingual education through constitutional changes and government policies, EMI is still considered to be superior among the public (Cummins Reference Cummins2015; Prinsloo & Harvey, Reference Prinsloo and Harvey2020). Prinsloo and Harvey (Reference Prinsloo and Harvey2020) investigated the effect of nonequivalence between home language and instructional language on science and mathematics achievement by using South African grade 9 TIMSS 2015 country data. They used three-stage modeling of multiple regression analysis with student-level variables in the first model, school-level variables in the second model, and teacher/classroom-level variables in the third model. They included variables related to language in modeling at the learner, teacher, and school levels. At the student level, nearly 80 percent of students’ home and school (test) languages were not equivalent. The influence of language equivalence was higher for science than mathematics. Students whose home and test languages were not the same scored fifty-one points lower in science compared to thirty-four points in mathematics. Researchers indicate that the inability to understand scientific language creates a barrier to science learning. They also speculate that language nonequivalence limits the attainment of a range of skills taught in science lessons such as critical thinking and problem-solving. These skills are not only critical for science learning but also necessary for the socioeconomic development of nations. According to Prinsloo and Harvey (Reference Prinsloo and Harvey2020), African home language learners are immersed in EMI too early in schooling, which causes poor development of both home language and instructional language. Igboanusi (Reference Igboanusi2008) states that the sudden and early transition from mother tongue instruction to EMI interrupts students’ cognitive development and causes poor academic achievement in science. Identically, African students exposed to a language of instruction that is not their mother tongue have relatively low academic achievement, especially students who have had rare exposure to English (Graham, Reference Graham2010).

Wales

The status of EMI in Wales is somewhat different compared to the countries mentioned earlier. Welsh-medium instruction (WMI) schools are considered to be better due to their high level of achievement and positive reputation compared to EMI schools; therefore, they attract affluent families from middle- and upper-class backgrounds (Jones, Reference Jones2017; Van den Brande et al., Reference Van den Brande, Hillary and Cullinane2019). However, average PISA scores are lower among students attending WMI schools than among students attending EMI schools over time (Jerrim et al., Reference Jerrim, Lopez‐Agudo and Marcenaro‐Gutierrez2022). Using five rounds of PISA data and an instrumental variable (language spoken at home) approach, Jerrim et al. (Reference Jerrim, Lopez‐Agudo and Marcenaro‐Gutierrez2022) conducted ordinary least squares and two-stage least squares regression analyses. They found that students who took the test in Welsh performed 26 points lower in mathematics and 33 points lower in science, compared with their peers who took the test in English. According to OECD (2019) 25–30 points in the PISA scale is equivalent to one year of schooling. The researchers state that this may be due to translation issues and the disparity between spoken and literary Welsh. They argue that unless an optimum solution is offered, such as providing students with test questions in both English and Welsh, the academic performance of teenagers in Wales will be underestimated in PISA.

Conclusion

In general, the findings of the studies reviewed in this chapter favored the instruction in the mother tongue for both cognitive and affective variables in mathematics and science at the primary and secondary school levels. EMI instruction seems to benefit only students with high English proficiency. Despite evidence that native-language instruction is superior in terms of overall student achievement, parents prefer EMI schools due to their advantages in the global economy, except in the case of Welsh education. Some of the challenges of EMI in terms of mathematics and science learning include inadequate English proficiency of teachers, low self-esteem of students, lower-order teacher questions, and less interaction in the classroom. Switching to EMI after attaining certain levels of English proficiency and providing language support for students who are already in EMI systems are recommended. Researchers also propose the use of translanguaging during content teaching in EMI classrooms, where students can use a wide range of modalities. As global economies are becoming more mathematics- and science-oriented, it is important to determine factors that benefit students’ content learning in EMI classrooms. Longitudinal studies investigating how to maximize the efficiency of EMI mathematics and science teaching and how government policies regarding EMI influence students’ performance in international assessments are recommended. It is important to take into account sociocultural, political, and linguistic contexts when examining TIMSS and PISA achievement, as they greatly influence the status of EMI within countries.

In recent years, researchers have increasingly utilized PISA and TIMSS datasets in various fields of education. It was reported that about two-thirds of the studies that used PISA and TIMSS datasets adopted basic and intermediate statistical analysis techniques, such as descriptives, independent samples t-test, ANOVA, and multiple regression, while one-third of the studies utilized advanced statistical techniques such as structural equation modeling, HLM, factor analysis, and item response theory (Liou & Hung, Reference Liou and Hung2015). As advanced statistics become more accessible to researchers, the number of studies using them is likely to increase in the coming years. Specific to EMI research, the studies in this review relied mainly on comparative t-test and ANOVA to compare instructional language-related differences, as well as regression to determine the effect of language-related variables on achievement. Among the advanced methods, HLM can be useful in investigating EMI alongside other contextual and background variables at the student level and classroom/school level. Item response theory might shed light on question discrimination and difficulty in different mediums of instruction and might reveal issues such as translation. As TIMSS and PISA contain complex datasets, using advanced statistics is recommended to gain a deeper understanding of student achievement and to render robust findings.

References

Anderson, J. O., Lin, H.-S., Treagust, D. F., Ross, S. P., & Yore, L. D. (2007). Using large-scale assessment datasets for research in science and mathematics education: Programme for International Student Assessment (PISA). International Journal of Science and Mathematics Education, 5, 591614. https://doi.org/10.1007/s10763-007-9090-yCrossRefGoogle Scholar
Bernardo, A. I. (2005). Language and modeling word problems in mathematics among bilinguals. The Journal of Psychology, 139(5), 413425. https://doi.org/10.3200/JRLP.139.5.413-425CrossRefGoogle ScholarPubMed
Block, D., & Moncada-Comas, B. (2022). English-medium instruction in higher education and the ELT gaze: STEM lecturers’ self-positioning as NOT English language teachers. International Journal of Bilingual Education and Bilingualism, 25(2), 401417. https://doi.org/10.1080/13670050.2019.1689917CrossRefGoogle Scholar
Carin, A. A., Bass, J. E., & Contant, T. L. (2005). Methods for teaching science as inquiry. Upper Saddle River, NJ: Pearson Education, Inc.Google Scholar
Cummins, J. (2000). Language, power, and pedagogy: Bilingual children in the crossfire. Clevedon, England: Multilingual Matters.CrossRefGoogle Scholar
Cummins, J. (2008). BICS and CALP: Empirical and theoretical status of the distinction. In Street, B. & Hornberger, N. H. (Eds.), Encyclopedia of language and education (2nd ed., volume 2: Literacy, pp. 7183). New York: Springer Science + Business Media LLC.Google Scholar
Cummins, J. (2015). How to reverse a legacy of exclusion? Identifying high-impact educational responses. Language and Education, 29(3), 272279. https://doi.org/10.1080/09500782.2014.994528CrossRefGoogle Scholar
Deng, Z., & Gopinathan, S. (2016). PISA and high-performing education systems: Explaining Singapore’s education success. Comparative Education, 52(4), 449472. https://doi.org/10.1080/03050068.2016.1219535CrossRefGoogle Scholar
El Masri, Y. H., Baird, J. A., & Graesser, A. (2016). Language effects in international testing: The case of PISA 2006 science items. Assessment in Education: Principles, Policy & Practice, 23(4), 427455. https://doi.org/10.1080/0969594X.2016.1218323Google Scholar
Gee, J. P. (2000). Discourse and sociocultural studies in reading. In Kamil, M. L., Mosenthal, P., Pearson, P. D., & Barr, R. (Eds.), Handbook of reading research (Vol. 3, pp. 195207). Mahwah, NJ: Erlbaum.Google Scholar
Graham, B. E. (2010). Mother tongue education: Necessary? Possible? Sustainable? Language and Education, 24(4), 309321. https://doi.org/10.1080/09500781003678696CrossRefGoogle Scholar
Harlen, W. (1999). Purposes and procedures for assessing science process skills. Assessment in Education: Principles, Policy & Practice, 6(1), 129144. https://doi.org/10.1080/09695949993044Google Scholar
Ho, E. S. C. (2007). Overview of accomplishment & challenges of Hong Kong basic education: From PISA 2000+ to PISA 2006. www.fed.cuhk.edu.hk/~hkpisa/events/2006/events2006_20071210.htmGoogle Scholar
Ho, E. S. C., & Man, E. Y. F. (2007). Student performance in Chinese medium-of-instruction (CMI) and English medium-of-instruction (EMI) schools: What we learned from the PISA study. Hong Kong: Faculty of Education, Hong Kong Institute of Educational Research, The Chinese University of Hong Kong.Google Scholar
Igboanusi, H. (2008). Mother tongue-based bilingual education in Nigeria: Attitudes and practice. International Journal of Bilingual Education and Bilingualism, 11(6), 721734. http://doi.org/10.1080/13670050802149291CrossRefGoogle Scholar
Ismail, N. A., & Awang, H. (2012). Student factors and mathematics achievement: Evidence from TIMSS 2007. Eurasia Journal of Mathematics, Science and Technology Education, 8(4), 249255. http://dx.doi.org/10.12973/eurasia.2012.843aGoogle Scholar
Jerrim, J., Lopez‐Agudo, L. A., & Marcenaro‐Gutierrez, O. D. (2022). The impact of test language on PISA scores. New evidence from Wales. British Educational Research Journal, 48(3), 420445. https://doi.org/10.1002/berj.3774CrossRefGoogle Scholar
Jones, S. L. (2017). What do we know and not know about choice of medium of education in South-East Wales? Wales Journal of Education, 19(2), 143162. https://doi.org/10.16922/wje.19.2.8CrossRefGoogle Scholar
Karlsson, A., Nygård Larsson, P., & Jakobsson, A. (2019). Multilingual students’ use of translanguaging in science classrooms. International Journal of Science Education, 41(15), 20492069. https://doi.org/10.1080/09500693.2018.1477261CrossRefGoogle Scholar
Launio, R. M. (2015). Instructional medium and its effect on students’ mathematics achievement. International Journal of Multidisciplinary and Current Research, 3, 462465.Google Scholar
Lin, A. M. (2019). Theories of trans/languaging and trans-semiotizing: Implications for content-based education classrooms. International Journal of Bilingual Education and Bilingualism, 22(1), 516. https://doi.org/10.1080/13670050.2018.1515175CrossRefGoogle Scholar
Liou, P. Y., & Hung, Y. C. (2015). Statistical techniques utilized in analyzing PISA and TIMSS data in science education from 1996 to 2013: A methodological review. International Journal of Science and Mathematics Education, 13(6), 14491468. https://doi.org/10.1007/s10763-014-9558-5CrossRefGoogle Scholar
Lo, Y. Y., & Lo, E. S. C. (2014). A meta-analysis of the effectiveness of English-medium education in Hong Kong. Review of Educational Research, 84(1), 4773. https://doi.org/10.3102/0034654313499615CrossRefGoogle Scholar
Martin, M. O., Mullis, I. V. S., & Hooper, M. (Eds.). (2016). Methods and Procedures in TIMSS 2015. Retrieved from Boston College, TIMSS & PIRLS International Study Center website. http://timssandpirls.bc.edu/publications/timss/2015-methods.htmlGoogle Scholar
Martin, M. O., von Davier, M., & Mullis, I. V. S. (Eds.). (2020). Methods and Procedures: TIMSS 2019 Technical Report. Retrieved from Boston College, TIMSS & PIRLS International Study Center website. https://timssandpirls.bc.edu/timss2019/methodsGoogle Scholar
Mullis, I. V. S., & Martin, M. O. (Eds.). (2017). TIMSS 2019 Assessment Frameworks. Boston College, TIMSS & PIRLS International Study Center. http://timssandpirls.bc.edu/timss2019/frameworks/Google Scholar
Mullis, I. V. S., Martin, M. O., Ruddock, G. J., O’Sullivan, C. Y., Arora, A., & Erberber, E. (2005). TIMSS 2007 assessment frameworks. Chestnut Hill: TIMSS & PIRLS International Study Center, Boston College.Google Scholar
Norris, S. P., & Phillips, L. M. (2003). How literacy in its fundamental sense is central to scientific literacy. Science Education, 87(2), 224240. https://doi.org/10.1002/sce.10066CrossRefGoogle Scholar
OECD (2017). PISA 2015 assessment and analytical framework: Science, reading, mathematics and financial literacy. Paris: OECD Publishing.Google Scholar
OECD (2019). PISA 2018 results: What students know and can do. Paris: OECD Publishing.Google Scholar
OECD (2020). PISA 2018 technical report. Paris: OECD Publishing.Google Scholar
Olufunminiyi, A. A., & Afolabi, F. (2010). Analysis of science process skills in West African senior secondary school certificate physics practical examinations in Nigeria. American-Eurasian Journal of Scientific Research, 5(4), 234240.Google Scholar
Perez, A. L., & Alieto, E. (2018). Change of “tongue” from English to a local language: A correlation of mother tongue proficiency and mathematics achievement. The Asian ESP Journal, 14, 132150.Google Scholar
Prinsloo, C. H., & Harvey, J. C. (2020). The differing effect of language factors on science and mathematics achievement using TIMSS 2015 data: South Africa. Research in Science Education, 50, 22072226. https://doi.org/10.1007/s11165–018–9769-9CrossRefGoogle Scholar
Pun, J., & Macaro, E. (2019). The effect of first and second language use on question types in English medium instruction science classrooms in Hong Kong. International Journal of Bilingual Education and Bilingualism, 22(1), 6477. https://doi.org/10.1080/13670050.2018.1510368CrossRefGoogle Scholar
Pun, J. K., & Tai, K. W. (2021). Doing science through translanguaging: A study of translanguaging practices in secondary English as a medium of instruction science laboratory sessions. International Journal of Science Education, 43(7), 11121139. https://doi.org/10.1080/09500693.2021.1902015CrossRefGoogle Scholar
Pun, J., Thomas, N., & Bowen, N. E. J. A. (2022). Questioning the sustainability of English-medium instruction policy in science classrooms: Teachers’ and students’ experiences at a Hong Kong secondary school. Sustainability, 14(4), 2168. https://doi.org/10.3390/su14042168CrossRefGoogle Scholar
Ricablanca, J. D. (2014). Effectiveness of mother tongue-based instruction on pupils’ achievement in mathematics. Unpublished Thesis. Central Mindanao University.Google Scholar
Tai, K. W., & Wei, L. (2021a). Co-learning in Hong Kong English medium instruction mathematics secondary classrooms: A translanguaging perspective. Language and Education, 35(3), 241267. https://doi.org/10.1080/09500782.2020.1837860CrossRefGoogle Scholar
Tai, K. W., & Wei, L. (2021b). Constructing playful talk through translanguaging in English Medium Instruction mathematics classrooms. Applied Linguistics, 42(4), 607640. https://doi.org/10.1093/applin/amaa043CrossRefGoogle Scholar
Thien, L. M., & Ong, M. Y. (2015). Malaysian and Singaporean students’ affective characteristics and mathematics performance: Evidence from PISA 2012. SpringerPlus, 4(1), 114. https://doi.org/10.1186/s40064–015-1358-zCrossRefGoogle ScholarPubMed
Tilakaratne, C. T. K., & Ekanayake, T. M. S. S. K. Y. (2017). Achievement level of science process skills of junior secondary students: Based on a sample of grade six and seven students from Sri Lanka. International Journal of Environmental & Science Education, 12(9), 20892108.Google Scholar
Tsui, C. Y. (2008). From PISA 2006 Results to some issues in Hong Kong science education. Paper presented in the NARST Conference, Kaohsiung, Taiwan.Google Scholar
Tupas, R. (2015). Inequalities of multilingualism: Challenges to mother tongue-based multilingual education. Language and Education, 29(2), 112124. https://doi.org/10.1080/09500782.2014.977295CrossRefGoogle Scholar
Van den Brande, J., Hillary, J., & Cullinane, C. (2019). Selective comprehensives: Great Britain. Slough: National Foundation for Educational Research (NFER)Google Scholar
van Laere, E., Aesaert, K., & van Braak, J. (2014). The role of students’ home language in science achievement: A multilevel approach. International Journal of Science Education, 36(16), 27722794. https://doi.org/10.1080/09500693.2014.936327CrossRefGoogle Scholar
Williams, C. (2002). A language gained: A study of language immersion at 11–16 years of age. School of Education, University of WalesGoogle Scholar
Yip, D. Y., & Tsang, W. K. (2007). Evaluation of the effects of the medium of instruction on science learning of Hong Kong secondary students: Students’ self-concept in science. International Journal of Science and Mathematics Education, 5(3), 393413. https://doi.org/10.1007/s10763–006-9043-xCrossRefGoogle Scholar
Yip, D. Y., Tsang, W. K., & Cheung, S. P. (2003). Evaluation of the effects of medium of instruction on the science learning of Hong Kong secondary students: Performance on the science achievement test. Bilingual Research Journal, 27(2), 295331. https://doi.org/10.1080/15235882.2003.10162808CrossRefGoogle Scholar
Yore, L., Bisanz, G. L., & Hand, B. M. (2003). Examining the literacy component of science literacy: 25 years of language arts and science research. International Journal of Science Education, 25, 689725. https://doi.org/10.1080/09500690305018CrossRefGoogle Scholar
Figure 0

Table 1.1 PISA languages used for the assessment.

Source: OECD (2020)
Figure 1

Table 1.2 TIMSS languages used for the assessment.

Source: Martin et al. (2020)

Accessibility standard: Unknown

Accessibility compliance for the HTML of this book is currently unknown and may be updated in the future.

Save book to Kindle

To save this book to your Kindle, first ensure no-reply@cambridge-org.demo.remotlog.com is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×