測驗學刊,第 66輯第 3期- 250 -Analysis of Trend of Gender Difference in ScientificLiteracy of Macao Students through Examination ofthe Changes of PISA Science AssessmentFramework and Mode of AssessmentSoi-kei Mak1 Kwok-cheung Cheung2Man-kai Ieong3 Pou-seong Sit4AbstractThis study seeks to analyze patterns of gender difference in scientific literacy of Macao’s 15-year-old students participating in Programme for International Student Assessment (PISA) 2015Study, organized by Organization for Economic Co-operation and Development (OECD). Unlikea number of high-performing countries or economies in the East Asian region, comparing be-tween PISA 2015 and past cycles of PISA scientific literacy assessment, Macao’s females rever-ted the inferior trend and started to outperform males in scientific literacy performance. This stu-dy attempts to investigate Macao’s trend of gender difference in scientific literacy from three van-tage points: (1) Analyze Macao students’ scientific literacy performance from international com-parative education perspective; (2) Compare Macao students’ scientific literacy performance inPISA 2006 and PISA 2015 from the local education system perspective, focusing on gender dif-ference in the performance of the high-, medium- and low-performing students on the varioussubscales of scientific literacy; (3) Analyze gender difference in scientific literacy performancein terms of the conceptual change of PISA assessment framework and the operational change ofmode of assessment, paying particular attention on the effect of student reading literacy on genderdifference in scientific literacy. This study uncovers the reason behind why Macao’s females in adecade’s time were able to revert the inferior trend and started to outperform males in scientificliteracy. This study not only possesses internal research validity, but also external research valid-ity signifying that Macao’s findings are also applicable to all other participating countries/econ-omies exhibiting similar trend of gender difference in scientific literacy as Macao’s.Keywords: gender difference, mode of assessment, PISA, reading literacy, scientific literacy1. Soi-kei Mak, Senior Researcher, Educational Testing and Assessment Research Centre, Universityof Macau2. Kwok-cheung Cheung, Professor, Faculty of Education, University of Macau3. Man-kai Ieong, Senior Researcher, Educational Testing and Assessment Research Centre, Univer-sity of Macau4. Pou-seong Sit, Associate Professor, Faculty of Education, University of MacauReceived: 2017.07.31; Revised: 2019.05.13; Accepted: 2019.07.30Corresponding Author: Soi-kei Mak; Email: skmak@um.edu.moAddress: Room 2008, E33, Faculty of Education, University of Macau Avenida da Universidade,Taipa, Macau, ChinaPsychological TestingSeptember 2019, Vol.66 No.3, pp.249-284
- 263 -麥瑞琪、張國祥、楊文佳、薛寶嫦 澳門學生科學素養的性別差異趨勢表1PISA2015與PISA2006科學素養高表現生與低表現生之性別差異比較(續)國家/經濟體PISA2015男生PISA2015女生PISA2015性別差異( 男女)PISA2006男生PISA2006女生PISA2006性別差異( 男女)水準2以下水準5或以上水準2以下水準5或以上水準2以下水準5或以上水準2以下水準5或以上水準2以下水準5或以上水準2以下水準5或以上%S.E.%S.E.%S.E.%S.E.%difS.E.%difS.E.%S.E.%S.E.%S.E.%S.E.%difS.E.%difS.E.(2.2)(1.6)(1.2)(1.4)(2.2)(2.8)(1.7)(1.4)(1.5)(1.3)(1.0)(1.7)(1.0)(1.9)(1.9)(1.2)(2.1)(1.2)(0.6)(1.1)(1.3)(1.0)(1.7)(0.7)(2.1)(1.4)(0.6)(1.0)(2.0)(1.2)(1.5)(1.5)(1.6)(0.9)0.30.00.915.02.94.00.50.25.10.00.20.98.40.10.10.00.64.410.07.70.70.60.21.90.74.526.516.60.41.10.13.21.78.5(0.1)(0.0)(0.2)(1.3)(0.5)(1.2)(0.2)(0.1)(0.6)(0.0)(0.1)(0.3)(0.9)(0.1)(0.1)(0.0)(0.2)(0.7)(0.8)(0.7)(0.2)(0.2)(0.1)(0.2)(0.3)(0.6)(0.9)(1.6)(0.2)(0.3)(0.1)(0.3)(0.4)(1.2)34.666.867.516.533.723.651.251.324.686.568.146.38.254.640.465.763.522.56.029.840.349.460.744.137.018.08.912.144.641.367.034.941.45.3(1.6)(1.7)(1.2)(1.4)(2.1)(2.8)(1.5)(1.5)(1.5)(1.2)(1.1)(1.4)(0.9)(1.9)(2.0)(1.6)(2.0)(1.3)(0.5)(1.1)(1.5)(0.9)(1.8)(0.6)(2.0)(1.3)(0.6)(1.0)(1.5)(1.1)(1.4)(1.4)(1.3)(0.8)0.40.00.511.92.81.40.20.12.90.00.20.86.30.10.20.00.33.98.37.50.70.30.11.50.63.121.714.10.51.60.02.40.88.0(0.2)(0.1)(0.1)(1.7)(0.5)(0.7)(0.1)(0.1)(0.5)(0.0)(0.1)(0.2)(0.8)(0.1)(0.1)(0.0)(0.1)(0.5)(0.7)(0.7)(0.2)(0.1)(0.1)(0.2)(0.3)(0.4)(0.9)(1.6)(0.2)(0.3)(0.0)(0.3)(0.2)(1.5)14.3*7.6* -1.9-0.47.8* -1.9-4.6*-9.9*0.1-1.69.0*8.5*2.4* 2.818.9*4.1* -1.84.3*4.1*5.4*3.8*3.3*-4.5*11.2*3.20.41.30.75.0*9.1* -2.313.9*-1.3 1.3(2.1)(1.9)(1.1)(1.1)(2.1)(2.8)(1.6)(1.6)(1.7)(1.2)(1.4)(1.7)(1.2)(2.0)(2.8)(1.7)(2.3)(1.4)(0.8)(1.6)(1.6)(1.3)(2.0)(0.9)(1.8)(1.6)(0.9)(1.2)(1.9)(1.6)(1.4)(2.0)(1.7)(0.8)-0.1 0.00.4*3.1* 0.12.6* 0.20.12.1* 0.00.00.12.1* -0.1 0.00.00.40.51.70.20.00.30.10.40.11.44.7* 2.5-0.1-0.5 0.00.80.9* 0.5(0.2)(0.1)(0.2)(1.1)(0.6)(1.3)(0.2)(0.1)(0.7)(0.0)(0.2)(0.4)(1.0)(0.1)(0.2)(0.0)(0.2)(0.7)(1.2)(1.1)(0.3)(0.2)(0.1)(0.3)(0.4)(0.7)(1.3)(2.4)(0.3)(0.4)(0.1)(0.5)(0.4)(1.1)m m 58.4 m 46.7 m 57.4 m 18.2 m m m 9.358.750.8 m m 22.111.3 m m 50.8 m 83.948.322.6 m 11.751.8 m 63.6 m 44.0 mm m (1.5)m (2.8)m (2.3)m (1.3)m m m (1.1)(4.8)(1.8)m m (1.2)(0.7)m m (1.3)m (0.6)(2.3)(1.6)m (1.2)(1.8)m (1.6)m (2.0)mm m 0.8 m 3.3 m 0.2 m 5.4 m m m 17.60.00.6 m m 4.66.6 m m 0.3 m 0.40.75.1 m 15.80.5 m 0.1 m 1.9 mm m (0.3)m (0.8)m (0.1)m (0.5)m m m (1.3)(0.1)(0.3)m m (0.7)(0.6)m m (0.2)m (0.1)(0.3)(0.7)m (1.3)(0.2)m (0.1)m (0.4)mm m 63.3 m 38.3 m 62.6 m 15.7 m m m 8.264.737.9 m m 18.59.2 m m 49.6 m 74.245.521.8 m 11.641.9 m 62.0 m 40.4 mm m (1.6)m (2.8)m (2.4)m (1.3)m m m (0.9)(2.5)(1.7)m m (1.3)(0.7)m m (1.2)m (0.7)(3.0)(1.6)m (1.3)(1.5)m (1.7)m (1.5)mm m 0.4 m 2.8 m 0.1 m 4.8 m m m 14.30.00.7 m m 5.44.0 m m 0.2 m 0.20.23.4 m 13.40.4 m 0.1 m 1.0 mm m (0.2)m (0.6)m (0.1)m (0.6)m m m (1.2)(0.0)(0.2)m m (0.8)(0.5)m m (0.2)m (0.1)(0.1)(0.5)m (1.3)(0.1)m (0.1)m (0.3)mm m-4.9*m 8.5* m-5.2 m 2.5 m m m 1.1-6.112.9*m m 3.6*2.1* m m 1.2 m 9.7*2.80.7 m 0.19.9* m 1.5 m 3.6 mm m (1.3)m (2.9)m (2.9)m (1.8)m m m (1.2)(3.8)(2.6)m m (1.6)(1.0)m m (1.8)m (1.1)(2.2)(1.5)m (1.4)(2.2)m (1.9)m (2.1)mm m 0.4 m 0.6 m 0.1 m 0.7 m m m 3.20.0-0.1 m m-0.8 2.5* m m 0.1 m 0.20.51.7* m 2.40.1 m 0.0 m 0.9 mm m (0.3)m (0.6)m (0.2)m (0.7)m m m (1.7)(0.1)(0.3)m m (0.7)(0.8)m m (0.2)m (0.2)(0.3)(0.7)m (2.0)(0.3)m (0.2)m (0.5)m經 濟 合 作 伙 伴阿爾巴尼亞阿爾及利亞巴西B-S-J-G( 中國)保加利亞布宜諾斯艾利斯( 阿根廷)哥倫比亞哥斯達尼加克羅地亞多明尼加馬其頓格魯吉亞香港( 中國)印尼約旦科索沃黎巴嫩立陶宛澳門( 中國)馬耳他摩爾多瓦黑山秘魯卡塔爾羅馬尼亞俄羅斯新加坡中華台北泰國特立尼達和多巴哥突尼斯阿聯酋烏拉圭越南48.974.455.616.041.621.746.641.324.785.067.254.810.657.359.369.861.726.910.135.244.152.656.255.340.118.310.212.849.650.564.648.840.16.6註:1.男女生科學素養精練水準的性別差異達顯著水準者用* 表示。2.m表示該地區沒有參加PISA2006,所以沒有相關數據。資料來源:整理自OECD(2016b,pp.325-326)
測驗學刊,第 66輯第 3期- 280 -參考文獻中文部分余民寧、翁雅芸、張靜軒(2018)。數理科學的學習動機有性別差異嗎?一個來自後設分析的證據。當代教育研究季刊,26(1),45-75。林煥祥、劉聖忠、林素微、李暉(2008)。臺灣參加 PISA 2006成果報告。行政院國家科學委員會專題研究成果報告(NSC-95-2522-S-026-002)。林曉芳(2009)。影響中學生科學素養差異之探討:以臺灣、日本、南韓和香港在 PISA 2006資料為例。教育研究與發展期刊,5(4),77-108。孫雲曉、李文道、趙霞(編著)(2011)。男孩危機。香港:三聯。陸真、沈書君(2012)。科學素養培養中男女生表現差異性的分析基於 PISA 科學素養測評的研究與思考。外國中小學教育,3,20-25。楊文佳、薛寶嫦、麥瑞琪、張國祥(2016)。透過 log 數據探析澳門學生的問題解決行為:以 PISA2012的公開題為例。測驗學刊,63(3),153-178。蔡佩穎、張文華、林陳涌、張惠博(2013)。不同性別七年級學生論證科學新聞之學習效益。科學教育學刊,21(4),455-481。簡晉龍、任宗浩(2011)。邁向科學之路?臺灣中學生性別對科學生涯選擇意向之影響。科學教育學刊,19(5),461-481。英文部分Anderson, J. O., Lin, H. S., Treagust, D. F., Ross, S. P., & Yore, L. D. (2007). Using large-scale assessment datasets for research in science and mathematics education: Pro-gramme for international student assessment (PISA). International Journal of Scienceand Mathematics Education, 5, 591-614.Balfanz, R. L., Herzog, L., & Mac Iver, D. J. (2007). Preventing student disengagement andkeeping students on the graduation path in urban middle-grades schools: Early identi-fication and effective interventions. Educational Psychologist, 42(4), 223-235.Barnea, N., & Dori, Y. J. (1999). High-school chemistry students’ performance and genderdifferences in a computerized molecular modeling learning environment. Journal ofScience Education and Technology, 8(4), 257-271.
- 281 -麥瑞琪、張國祥、楊文佳、薛寶嫦 澳門學生科學素養的性別差異趨勢Bell, P., & Linn, M. C. (2000). Scientific arguments as learning artifacts: Designing forlearning from the web with KIE. International Journal of Science Education, 22(8),797-817.Brand, B. R., & Moore, S. J. (2011). Enhancing teachers’ application of inquiry-based stra-tegies using a constructivist sociocultural professional development model. Interna-tional Journal of Science Education, 33, 889-913.Brotman, J. S., & Moore, F. M. (2008). Girl and science: A review of four themes in scienceeducation literature. Journal of Research in Science Teaching, 45(9), 971-1002.Burkam, D. T., Lee, V. E., & Smerdon, B. A. (1997). Gender and science learning early inhigh school: Subject matter and laboratory experiences. American Educational Re-search Journal, 34, 297-331.Catsambis, S. (1995). Gender, race, ethnicity, and science education in the middle grades.Journal of Research in Science Teaching, 32(3), 243-257.Cavallo, A. M. L., & Laubach, T. A. (2001). Students’ science perceptions and enrollmentdecisions in different learning cycle classrooms. Journal of Research in Science Tea-ching, 38, 1029-1062.Cheung, K. C., Mak, S. K., Sit, P. S., & Ieong, M. K. (2018). Why Macao is commendedas an economy of high-performance and high-equity amongst PISA 2015 participatingeconomies? An explanation from an insider perspective. In C. Magno, & A. David(Eds.), Philippine and Global Perspectives on Educational Assessment (pp. 49-71).Philippines: Philippine Educational Measurement and Evaluation Association.Cheung, K. C., Sit, P. S., Mak, S. K., & Ieong, M. K. (2016). Macao-PISA 2015 Report:Assessment of scientific, reading and mathematical literacy performance of 15-year-old students from an international comparison perspective. Macao: Educational Tes-ting and Assessment Research Centre, University of Macau.Cook, L. K., & Mayer, R. E. (1988). Teaching readers about the structure of scientific text.Journal of Educational Psychology, 80(4), 448-456.Doidge, N. (2007). The brain that changes itself: Stories of personal triumph from the fron-tiers of brain science. New York, NY: Penguin.Driver, R., Newton, P., & Osborne, J. (2000). Establishing the norms of scientific argumen-tation in classrooms. Science Education, 84(3), 287-312.Duschl, R. (2008). Science education in three-part harmony: Balancing conceptual, episte-mic, and social learning goals. Review of Research in Education, 32, 268-291.Dymock, S. (2005). Teaching expository text structure awareness. The Reading Teacher, 59(2), 177-181.
測驗學刊,第 66輯第 3期- 282 -Education Review Office. (2007). Boys’ education: Good practice in secondary school.Retrieved from http://www.ero.govt.nz/assets/Uploads/Boys-Education-GP-in-Sec-Schools-Jul08.pdfErikson, R., Goldthorpe, J. H., Jackson, M., Yaish, M., & Cox., D. R. (2005). On class dif-ferentials in educational attainment. Proceedings of the National Academy of Scien-ces, 102(27), 9730-9733.Gee, J. P. (2004). Language in the science classroom: Academic social languages as theheart of school-based literacy. In E. W. Saul (Ed.), Crossing borders in literacy andscience instruction: Perspectives in theory and practice (pp. 13-32). Newark, DE: In-ternational Reading Association/ National Science Teachers Association.Heard, P. F., Divall, S. A., & Johnson, S. D. (2000). Can ‘ears-on’ help hands-on sciencelearning- for girls and boys? International Journal of Science Education, 22,1133-1146.Hershkovitz, A., & Nachmias, R. (2008). Developing a log-based motivation measuringtool. In R. Baker, T. Barnes, & J. Beck (Eds.), Proceedings of the First InternationalConference on Educational Data Mining (pp. 226-233). Montreal, Canada.Jones, M. G., Howe, A., & Rua, M. J. (2000). Gender differences in students’ experiences,interest, and attitudes toward science and scientists. Science Education, 84(2),180-192.Kwon, H. (2016). Effect of middle school students’ motivation to learn technology on theirattitudes toward engineering. Eurasia Journal of Mathematics, Science and Technol-ogy Education, 12(9), 2281-2294.Lee, V. E., & Burkam, D. T. (1996). Gender differences in middle grade science achie-vement: Subject domain, ability level, and course emphasis. Science Education, 80,613-650.Lee, Y. J. (2015). Analyzing log files to predict students’ problem solving performance ina computer-based physics tutor. Educational Technology & Society, 18, 225-236.Medina, J. (2008). Brain rules: 12 principles for surviving and thriving at work, home andschool. Seattle, WA: Pear Press.Moir, A., & Jessel, D. (1993). Brain sex: The real difference between men & women. UK:Penguin Books.Murphy, P. (1999). Supporting collaborative learning: A gender dimension. In P. Murphy(Ed.), Learners, learning and assessment. London, UK: Paul Chapman Publishingand Open University.National Literacy Trust. (2012). Boys’ reading commission. Retrieved from https://literac-
- 283 -麥瑞琪、張國祥、楊文佳、薛寶嫦 澳門學生科學素養的性別差異趨勢ytrust.org.uk/policy-and-campaigns/all-party-parliamentary-group-literacy/boys-reading-commission/National Literacy Trust. (2017). Reading champions. Retrieved from https://literacytrust.org.uk/resources/reading-champions/Neuschmidt, O., Barth, J., & Hastedt, D. (2008). Trends in gender differences in mathemat-ics and science (TIMSS 1995-2003). Studies in Educational Evaluation, 34, 56-72.Norris, S. P., & Phillips, L. M. (1994). Interpreting pragmatic meaning when reading popu-lar reports of science. Journal of Research in Science Teaching, 31(9), 947-967.Oreopoulos, P. (2007). Do dropouts drop out too soon? Wealth, health and happiness fromcompulsory schooling. Journal of Public Economics, 91(11-12), 2213-2229.Organization for Economic Co-operation and Development. [OECD] (2006). Assessingscientific, reading and mathematical literacy: A framework for PISA 2006. Paris,France: Author.Organization for Economic Co-operation and Development. [OECD] (2007a). PISA 2006science competencies for tomorrow’s world (Volume I: Analysis). Paris, France: Auth-or.Organization for Economic Co-operation and Development. [OECD] (2007b). PISA 2006(Volume II: Data). Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2010a). The highcost of low educational performance: The long-run economic impact of improvingPISA outcomes. Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2010b). PISA 2009Results (Volume III): Learning to learn- Student engagement, strategies and practices.Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2013). OECD skillsoutlook 2013: First results from the survey of adult skills. Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2015). The ABC ofgender equality in education: Aptitude, behaviour, confidence. Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2016a). PISA 2015Assessment and analytical framework: Science, reading, mathematics and financialliteracy. Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2016b). PISA 2015results (Volume I): Excellence and equity in education. Paris, France: Author.Organization for Economic Co-operation and Development. [OECD] (2017). PISA 2015technical report. Paris, France: Author.
測驗學刊,第 66輯第 3期- 284 -Rose, H., & Betts, J. R. (2004). The effect of high school courses on earnings. The Reviewof Economics and Statistics, 86(2), 497-513.Rumberger, R. W. (2011). Why students drop out of high school and what can be done aboutit. Cambridge, MA: Harvard University Press.Rychen, D. S., & Salganik, L. H. (2001). Defining and selecting key competencies.Göttingen, Germany: Hogrefe & Huber.Sax, L. (2007). Boys adrift: The five factors driving the growing epidemic of unmotivatedboys and underachieving young men. New York, NY: Basic Books.Standing Committee on Education and Training, House of Representatives, Australia, Par-liament. (2002). Boys: getting it right: report on the inquiry into the education of boys.Canberra, A.C.T.: Parliament of the Commonwealth of Australia.Thier, M., & Daviss, B. (2002). The new science literacy: Using language skills to help stu-dents learn science. Portsmouth, NH: Heinemann.Yip, D. Y., Chiu, M. M., & Ho, E. S. C. (2004). Hong Kong student achievement in OECD-PISA study: Gender differences in science content, literacy skills, and test item for-mats. International Journal of Science and Mathematics Education, 2, 91-106.Yore, L. D., Pimm, D., & Tuan, H. L. (2007). The literacy component of mathematical andscientific literacy. International Journal of Science and Mathematics Education, 5,559-589.Zhou, Y., Fan, X., Wei, X., & Tai, R. H. (2017). Gender gap among high achievers in mathand implications for STEM pipeline. The Asia-Pacific Education Researcher, 26(5),259-269.Zohar, A. (2006). Connected knowledge in science and mathematics education. Interna-tional Journal of Science Education, 28(13), 1579-1599.