Programme for International Student Assessment

Last updated
Programme for International Student Assessment
AbbreviationPISA
Formation1997
PurposeComparison of education attainment across the world
HeadquartersOECD Headquarters
Location
Region served
World
Membership
79 government education departments
Official language
English and French
Head of the Early Childhood and Schools Division
Yuri Belfali
Main organ
PISA Governing Body (Chair – Michele Bruniges)
Parent organization
OECD
Website www.oecd.org/pisa/
PISA average Mathematics scores (2018) PISA average Mathematics scores 2018.png
PISA average Mathematics scores (2018)
PISA average Science scores (2018) PISA average Science scores 2018.png
PISA average Science scores (2018)
PISA average Reading scores (2018) PISA average Reading scores 2018.png
PISA average Reading scores (2018)

The Programme for International Student Assessment (PISA) is a worldwide study by the Organisation for Economic Co-operation and Development (OECD) in member and non-member nations intended to evaluate educational systems by measuring 15-year-old school pupils' scholastic performance on mathematics, science, and reading. [1] It was first performed in 2000 and then repeated every three years. Its aim is to provide comparable data with a view to enabling countries to improve their education policies and outcomes. It measures problem solving and cognition. [2]

Contents

The results of the 2022 data collection were released in December 2023. [3]

Influence and impact

PISA, and similar international standardised assessments of educational attainment are increasingly used in the process of education policymaking at both national and international levels. [4]

PISA was conceived to set in a wider context the information provided by national monitoring of education system performance through regular assessments within a common, internationally agreed framework; by investigating relationships between student learning and other factors they can "offer insights into sources of variation in performances within and between countries". [5]

Until the 1990s, few European countries used national tests. In the 1990s, ten countries / regions introduced standardised assessment, and since the early 2000s, ten more followed suit. By 2009, only five European education systems had no national student assessments. [4]

The impact of these international standardised assessments in the field of educational policy has been significant, in terms of the creation of new knowledge, changes in assessment policy, and external influence over national educational policy more broadly. [6] [7] [8]

Creation of new knowledge

Data from international standardised assessments can be useful in research on causal factors within or across education systems. [4] Mons notes that the databases generated by large-scale international assessments have made it possible to carry out inventories and comparisons of education systems on an unprecedented scale* on themes ranging from the conditions for learning mathematics and reading, to institutional autonomy and admissions policies. [9] They allow typologies to be developed that can be used for comparative statistical analyses of education performance indicators, thereby identifying the consequences of different policy choices. They have generated new knowledge about education: PISA findings have challenged deeply embedded educational practices, such as the early tracking of students into vocational or academic pathways. [10]

Barroso and de Carvalho find that PISA provides a common reference connecting academic research in education and the political realm of public policy, operating as a mediator between different strands of knowledge from the realm of education and public policy. [11] However, although the key findings from comparative assessments are widely shared in the research community [4] the knowledge they create does not necessarily fit with government reform agendas; this leads to some inappropriate uses of assessment data.

Changes in national assessment policy

Emerging research suggests that international standardised assessments are having an impact on national assessment policy and practice. PISA is being integrated into national policies and practices on assessment, evaluation, curriculum standards and performance targets; its assessment frameworks and instruments are being used as best-practice models for improving national assessments; many countries have explicitly incorporated and emphasise PISA-like competencies in revised national standards and curricula; others use PISA data to complement national data and validate national results against an international benchmark. [10]

External influence over national educational policy

PISA may influence national education policy choices in a variety of ways. Participation in international assessments like PISA has been linked to significant education policy changes and outcomes, such as higher student enrollments and education reforms. [6] However, critics have argued that participation could lead to undesirable outcomes, such as higher repetition rates and narrowing of curricula. [7] The impact of PISA may also vary according to the specific country context. [12]

Policy-makers in most participating countries see PISA as an important indicator of system performance; PISA reports can define policy problems and set the agenda for national policy debate; policymakers seem to accept PISA as a valid and reliable instrument for internationally benchmarking system performance and changes over time; most countries—irrespective of whether they performed above, at, or below the average PISA score—have begun policy reforms in response to PISA reports. [10]

Against this, impact on national education systems varies markedly. For example, in Germany, the results of the first PISA assessment caused the so-called 'PISA shock': a questioning of previously accepted educational policies; in a state marked by jealously guarded regional policy differences, it led ultimately to an agreement by all Länder to introduce common national standards and even an institutionalised structure to ensure that they were observed. [13] In Hungary, by comparison, which shared similar conditions to Germany, PISA results have not led to significant changes in educational policy. [14]

Because many countries have set national performance targets based on their relative rank or absolute PISA score, PISA assessments have increased the influence of their (non-elected) commissioning body, the OECD, as an international education monitor and policy actor, which implies an important degree of 'policy transfer' from the international to the national level; PISA in particular is having "an influential normative effect on the direction of national education policies". [10] Thus, it is argued that the use of international standardised assessments has led to a shift towards international, external accountability for national system performance; Rey contends that PISA surveys, portrayed as objective, third-party diagnoses of education systems, actually serve to promote specific orientations on educational issues. [4]

National policy actors refer to high-performing PISA countries to "help legitimise and justify their intended reform agenda within contested national policy debates". [15] PISA data can be "used to fuel long-standing debates around pre-existing conflicts or rivalries between different policy options, such as in the French Community of Belgium". [16] In such instances, PISA assessment data are used selectively: in public discourse governments often only use superficial features of PISA surveys such as country rankings and not the more detailed analyses. Rey (2010:145, citing Greger, 2008) notes that often the real results of PISA assessments are ignored as policymakers selectively refer to data in order to legitimise policies introduced for other reasons. [17]

In addition, PISA's international comparisons can be used to justify reforms with which the data themselves have no connection; in Portugal, for example, PISA data were used to justify new arrangements for teacher assessment (based on inferences that were not justified by the assessments and data themselves); they also fed the government's discourse about the issue of pupils repeating a year, (which, according to research, fails to improve student results). [18] In Finland, the country's PISA results (that are in other countries deemed to be excellent) were used by Ministers to promote new policies for 'gifted' students. [19] Such uses and interpretations often assume causal relationships that cannot legitimately be based upon PISA data which would normally require fuller investigation through qualitative in-depth studies and longitudinal surveys based on mixed quantitative and qualitative methods, [20] which politicians are often reluctant to fund.

Recent decades have witnessed an expansion in the uses of PISA and similar assessments, from assessing students' learning, to connecting "the educational realm (their traditional remit) with the political realm". [21] This raises the question of whether PISA data are sufficiently robust to bear the weight of the major policy decisions that are being based upon them, for, according to Breakspear, PISA data have "come to increasingly shape, define and evaluate the key goals of the national / federal education system". [10] This implies that those who set the PISA tests – e.g. in choosing the content to be assessed and not assessed – are in a position of considerable power to set the terms of the education debate, and to orient educational reform in many countries around the globe. [10]

Framework

PISA stands in a tradition of international school studies, undertaken since the late 1950s by the International Association for the Evaluation of Educational Achievement (IEA). Much of PISA's methodology follows the example of the Trends in International Mathematics and Science Study (TIMSS, started in 1995), which in turn was much influenced by the U.S. National Assessment of Educational Progress (NAEP). The reading component of PISA is inspired by the IEA's Progress in International Reading Literacy Study (PIRLS).

PISA aims to test literacy the competence of students in three fields: reading, mathematics, science on an indefinite scale. [22]

The PISA mathematics literacy test asks students to apply their mathematical knowledge to solve problems set in real-world contexts. To solve the problems students must activate a number of mathematical competencies as well as a broad range of mathematical content knowledge. TIMSS, on the other hand, measures more traditional classroom content such as an understanding of fractions and decimals and the relationship between them (curriculum attainment). PISA claims to measure education's application to real-life problems and lifelong learning (workforce knowledge).

In the reading test, "OECD/PISA does not measure the extent to which 15-year-old students are fluent readers or how competent they are at word recognition tasks or spelling." Instead, they should be able to "construct, extend and reflect on the meaning of what they have read across a wide range of continuous and non-continuous texts." [23]

PISA also assesses students in innovative domains. In 2012 and 2015 in addition to reading, mathematics and science, they were tested in collaborative problem solving. In 2018 the additional innovative domain was global competence.

Implementation

PISA is sponsored, governed, and coordinated by the OECD, but paid for by participating countries.[ citation needed ]

Method of testing

Sampling

The students tested by PISA are aged between 15 years and 3 months and 16 years and 2 months at the beginning of the assessment period. The school year pupils are in is not taken into consideration. Only students at school are tested, not home-schoolers. In PISA 2006, however, several countries also used a grade-based sample of students. This made it possible to study how age and school year interact.

To fulfill OECD requirements, each country must draw a sample of at least 5,000 students. In small countries like Iceland and Luxembourg, where there are fewer than 5,000 students per year, an entire age cohort is tested. Some countries used much larger samples than required to allow comparisons between regions.

Test

PISA test documents on a school table (Neues Gymnasium, Oldenburg, Germany, 2006) Pisatest.jpg
PISA test documents on a school table (Neues Gymnasium, Oldenburg, Germany, 2006)

Each student takes a two-hour computer based test. Part of the test is multiple-choice and part involves fuller answers. There are six and a half hours of assessment material, but each student is not tested on all the parts. Following the cognitive test, participating students spend nearly one more hour answering a questionnaire on their background including learning habits, motivation, and family. School directors fill in a questionnaire describing school demographics, funding, etc. In 2012 the participants were, for the first time in the history of large-scale testing and assessments, offered a new type of problem, i.e. interactive (complex) problems requiring exploration of a novel virtual device. [24] [25]

In selected countries, PISA started experimentation with computer adaptive testing.

National add-ons

Countries are allowed to combine PISA with complementary national tests.

Germany does this in a very extensive way: On the day following the international test, students take a national test called PISA-E (E=Ergänzung=complement). Test items of PISA-E are closer to TIMSS than to PISA. While only about 5,000 German students participate in the international and the national test, another 45,000 take the national test only. This large sample is needed to allow an analysis by federal states. Following a clash about the interpretation of 2006 results, the OECD warned Germany that it might withdraw the right to use the "PISA" label for national tests. [26]

Data scaling

From the beginning, PISA has been designed with one particular method of data analysis in mind. Since students work on different test booklets, raw scores must be 'scaled' to allow meaningful comparisons. Scores are thus scaled so that the OECD average in each domain (mathematics, reading and science) is 500 and the standard deviation is 100. [27] This is true only for the initial PISA cycle when the scale was first introduced, though, subsequent cycles are linked to the previous cycles through IRT scale linking methods. [28]

This generation of proficiency estimates is done using a latent regression extension of the Rasch model, a model of item response theory (IRT), also known as conditioning model or population model. The proficiency estimates are provided in the form of so-called plausible values, which allow unbiased estimates of differences between groups. The latent regression, together with the use of a Gaussian prior probability distribution of student competencies allows estimation of the proficiency distributions of groups of participating students. [29] The scaling and conditioning procedures are described in nearly identical terms in the Technical Reports of PISA 2000, 2003, 2006. NAEP and TIMSS use similar scaling methods.

Ranking results

All PISA results are tabulated by country; recent PISA cycles have separate provincial or regional results for some countries. Most public attention concentrates on just one outcome: the mean scores of countries and their rankings of countries against one another. In the official reports, however, country-by-country rankings are given not as simple league tables but as cross tables indicating for each pair of countries whether or not mean score differences are statistically significant (unlikely to be due to random fluctuations in student sampling or in item functioning). In favorable cases, a difference of 9 points is sufficient to be considered significant.[ citation needed ]

PISA never combines mathematics, science and reading domain scores into an overall score. However, commentators have sometimes combined test results from all three domains into an overall country ranking. Such meta-analysis is not endorsed by the OECD, although official summaries sometimes use scores from a testing cycle's principal domain as a proxy for overall student ability.

PISA 2018 ranking summary

The results of PISA 2018 were presented on 3 December 2019, which included data for around 600,000 participating students in 79 countries and economies, with China's economic area of Beijing, Shanghai, Jiangsu and Zhejiang emerging as the top performer in all categories. [30] Note that this does not represent the entirety of mainland China. [31] Reading results for Spain were not released due to perceived anomalies. [32]

MathematicsScienceReading
1Flag of the People's Republic of China.svg  China (B-S-J-Z) [lower-alpha 1] 591
2Flag of Singapore.svg  Singapore 569
3Flag of Macau.svg  Macau 558
4Flag of Hong Kong.svg  Hong Kong 551
5Flag of the Republic of China.svg  Taiwan 531
6Flag of Japan.svg  Japan 527
7Flag of South Korea.svg  South Korea 526
8Flag of Estonia.svg  Estonia 523
9Flag of the Netherlands.svg  Netherlands 519
10Flag of Poland.svg  Poland 516
11Flag of Switzerland (Pantone).svg   Switzerland 515
12Flag of Canada (Pantone).svg  Canada 512
13Flag of Denmark.svg  Denmark 509
13Flag of Slovenia.svg  Slovenia 509
15Flag of Belgium (civil).svg  Belgium 508
16Flag of Finland.svg  Finland 507
17Flag of Sweden.svg  Sweden 502
17Flag of the United Kingdom.svg  United Kingdom 502
19Flag of Norway.svg  Norway 501
20Flag of Germany.svg  Germany 500
20Flag of Ireland.svg  Ireland 500
22Flag of the Czech Republic.svg  Czech Republic 499
22Flag of Austria.svg  Austria 499
24Flag of Latvia.svg  Latvia 496
24Flag of Vietnam.svg  Vietnam 496
26Flag of France.svg  France 495
26Flag of Iceland.svg  Iceland 495
28Flag of New Zealand.svg  New Zealand 494
29Flag of Portugal.svg  Portugal 492
30Flag of Australia (converted).svg  Australia 491
International Average (OECD)489
31Flag of Russia.svg  Russia 488
32Flag of Italy.svg  Italy 487
33Flag of Slovakia.svg  Slovakia 486
34Flag of Luxembourg.svg  Luxembourg 483
35Flag of Lithuania.svg  Lithuania 481
35Flag of Spain.svg  Spain 481
35Flag of Hungary.svg  Hungary 481
38Flag of the United States.svg  United States 478
39Flag of Belarus.svg  Belarus 472
39Flag of Malta.svg  Malta 472
41Flag of Croatia.svg  Croatia 464
42Flag of Israel.svg  Israel 463
43Flag of Turkey.svg  Turkey 454
44Flag of Ukraine.svg  Ukraine 453
45Flag of Cyprus.svg  Cyprus 451
45Flag of Greece.svg  Greece 451
47Flag of Serbia.svg  Serbia 448
48Flag of Malaysia.svg  Malaysia 440
49Flag of Albania.svg  Albania 437
50Flag of Bulgaria.svg  Bulgaria 436
51Flag of the United Arab Emirates.svg  United Arab Emirates 435
52Flag of Brunei.svg  Brunei 430
52Flag of Montenegro.svg  Montenegro 430
52Flag of Romania.svg  Romania 430
55Flag of Kazakhstan.svg  Kazakhstan 423
56Flag of Moldova.svg  Moldova 421
57Flag of Azerbaijan.svg  Azerbaijan 420
58Flag of Thailand.svg  Thailand 419
59Flag of Uruguay.svg  Uruguay 418
60Flag of Chile.svg  Chile 417
61Flag of Qatar.svg  Qatar 414
62Flag of Mexico.svg  Mexico 409
63Flag of Bosnia and Herzegovina.svg  Bosnia and Herzegovina 406
64Flag of Costa Rica.svg  Costa Rica 402
65Flag of Jordan.svg  Jordan 400
65Flag of Peru.svg  Peru 400
67Flag of Georgia.svg  Georgia 398
68Flag of North Macedonia.svg  North Macedonia 394
69Flag of Lebanon.svg  Lebanon 393
70Flag of Colombia.svg  Colombia 391
71Flag of Brazil.svg  Brazil 384
72Flag of Argentina.svg  Argentina 379
72Flag of Indonesia.svg  Indonesia 379
74Flag of Saudi Arabia.svg  Saudi Arabia 373
75Flag of Morocco.svg  Morocco 368
76Flag of Kosovo.svg  Kosovo 366
77Flag of Panama.svg  Panama 353
77Flag of the Philippines.svg  Philippines 353
79Flag of the Dominican Republic.svg  Dominican Republic 325
1Flag of the People's Republic of China.svg  China (B-S-J-Z) [lower-alpha 1] 590
2Flag of Singapore.svg  Singapore 551
3Flag of Macau.svg  Macau 544
4Flag of Vietnam.svg  Vietnam 543
5Flag of Estonia.svg  Estonia 530
6Flag of Japan.svg  Japan 529
7Flag of Finland.svg  Finland 522
8Flag of South Korea.svg  South Korea 519
9Flag of Canada (Pantone).svg  Canada 518
10Flag of Hong Kong.svg  Hong Kong 517
11Flag of the Republic of China.svg  Taiwan 516
12Flag of Poland.svg  Poland 511
13Flag of New Zealand.svg  New Zealand 508
14Flag of Slovenia.svg  Slovenia 507
15Flag of the United Kingdom.svg  United Kingdom 505
16Flag of Australia (converted).svg  Australia 503
16Flag of Germany.svg  Germany 503
16Flag of the Netherlands.svg  Netherlands 503
19Flag of the United States.svg  United States 502
20Flag of Belgium (civil).svg  Belgium 499
20Flag of Sweden.svg  Sweden 499
22Flag of the Czech Republic.svg  Czech Republic 497
23Flag of Ireland.svg  Ireland 496
24Flag of Switzerland (Pantone).svg   Switzerland 495
25Flag of Denmark.svg  Denmark 493
25Flag of France.svg  France 493
27Flag of Portugal.svg  Portugal 492
28Flag of Austria.svg  Austria 490
28Flag of Norway.svg  Norway 490
International Average (OECD)489
30Flag of Latvia.svg  Latvia 487
31Flag of Spain.svg  Spain 483
32Flag of Lithuania.svg  Lithuania 482
33Flag of Hungary.svg  Hungary 481
34Flag of Russia.svg  Russia 478
35Flag of Luxembourg.svg  Luxembourg 477
36Flag of Iceland.svg  Iceland 475
37Flag of Croatia.svg  Croatia 472
38Flag of Belarus.svg  Belarus 471
39Flag of Ukraine.svg  Ukraine 469
40Flag of Italy.svg  Italy 468
40Flag of Turkey.svg  Turkey 468
42Flag of Slovakia.svg  Slovakia 464
43Flag of Israel.svg  Israel 462
44Flag of Malta.svg  Malta 457
45Flag of Greece.svg  Greece 452
46Flag of Chile.svg  Chile 444
47Flag of Serbia.svg  Serbia 440
48Flag of Cyprus.svg  Cyprus 439
49Flag of Malaysia.svg  Malaysia 438
50Flag of the United Arab Emirates.svg  United Arab Emirates 434
51Flag of Brunei.svg  Brunei 431
52Flag of Jordan.svg  Jordan 429
53Flag of Moldova.svg  Moldova 428
54Flag of Romania.svg  Romania 426
54Flag of Thailand.svg  Thailand 426
54Flag of Uruguay.svg  Uruguay 426
57Flag of Bulgaria.svg  Bulgaria 424
58Flag of Mexico.svg  Mexico 419
58Flag of Qatar.svg  Qatar 419
60Flag of Albania.svg  Albania 417
61Flag of Costa Rica.svg  Costa Rica 416
62Flag of Montenegro.svg  Montenegro 415
63Flag of Colombia.svg  Colombia 413
63Flag of North Macedonia.svg  North Macedonia 413
65Flag of Argentina.svg  Argentina 404
65Flag of Brazil.svg  Brazil 404
65Flag of Peru.svg  Peru 404
68Flag of Azerbaijan.svg  Azerbaijan 398
68Flag of Bosnia and Herzegovina.svg  Bosnia and Herzegovina 398
70Flag of Kazakhstan.svg  Kazakhstan 397
71Flag of Indonesia.svg  Indonesia 396
72Flag of Saudi Arabia.svg  Saudi Arabia 386
73Flag of Lebanon.svg  Lebanon 384
74Flag of Georgia.svg  Georgia 383
75Flag of Morocco.svg  Morocco 377
76Flag of Kosovo.svg  Kosovo 365
76Flag of Panama.svg  Panama 365
78Flag of the Philippines.svg  Philippines 357
79Flag of the Dominican Republic.svg  Dominican Republic 336
1Flag of the People's Republic of China.svg  China (B-S-J-Z) [lower-alpha 1] 555
2Flag of Singapore.svg  Singapore 549
3Flag of Macau.svg  Macau 525
4Flag of Hong Kong.svg  Hong Kong 524
5Flag of Estonia.svg  Estonia 523
6Flag of Canada (Pantone).svg  Canada 520
6Flag of Finland.svg  Finland 520
8Flag of Ireland.svg  Ireland 518
9Flag of South Korea.svg  South Korea 514
10Flag of Poland.svg  Poland 512
11Flag of New Zealand.svg  New Zealand 506
11Flag of Sweden.svg  Sweden 506
13Flag of the United States.svg  United States 505
13Flag of Vietnam.svg  Vietnam 505
15Flag of Japan.svg  Japan 504
15Flag of the United Kingdom.svg  United Kingdom 504
17Flag of Australia (converted).svg  Australia 503
17Flag of the Republic of China.svg  Taiwan 503
19Flag of Denmark.svg  Denmark 501
20Flag of Norway.svg  Norway 499
21Flag of Germany.svg  Germany 498
22Flag of Slovenia.svg  Slovenia 495
23Flag of Belgium (civil).svg  Belgium 493
23Flag of France.svg  France 493
25Flag of Portugal.svg  Portugal 492
26Flag of the Czech Republic.svg  Czech Republic 490
International Average (OECD)487
27Flag of the Netherlands.svg  Netherlands 485
28Flag of Austria.svg  Austria 484
28Flag of Switzerland (Pantone).svg   Switzerland 484
30Flag of Croatia.svg  Croatia 479
30Flag of Latvia.svg  Latvia 479
30Flag of Russia.svg  Russia 479
33Flag of Hungary.svg  Hungary 476
33Flag of Italy.svg  Italy 476
33Flag of Lithuania.svg  Lithuania 476
36Flag of Belarus.svg  Belarus 474
36Flag of Iceland.svg  Iceland 474
38Flag of Israel.svg  Israel 470
38Flag of Luxembourg.svg  Luxembourg 470
40Flag of Turkey.svg  Turkey 466
40Flag of Ukraine.svg  Ukraine 466
42Flag of Slovakia.svg  Slovakia 458
43Flag of Greece.svg  Greece 457
44Flag of Chile.svg  Chile 452
45Flag of Malta.svg  Malta 448
46Flag of Serbia.svg  Serbia 439
47Flag of the United Arab Emirates.svg  United Arab Emirates 432
48Flag of Romania.svg  Romania 428
49Flag of Uruguay.svg  Uruguay 427
50Flag of Costa Rica.svg  Costa Rica 426
51Flag of Cyprus.svg  Cyprus 424
51Flag of Moldova.svg  Moldova 424
53Flag of Montenegro.svg  Montenegro 421
54Flag of Bulgaria.svg  Bulgaria 420
54Flag of Mexico.svg  Mexico 420
56Flag of Jordan.svg  Jordan 419
57Flag of Malaysia.svg  Malaysia 415
58Flag of Brazil.svg  Brazil 413
59Flag of Colombia.svg  Colombia 412
60Flag of Brunei.svg  Brunei 408
61Flag of Qatar.svg  Qatar 407
62Flag of Albania.svg  Albania 405
63Flag of Bosnia and Herzegovina.svg  Bosnia and Herzegovina 403
64Flag of Argentina.svg  Argentina 402
65Flag of Peru.svg  Peru 401
66Flag of Saudi Arabia.svg  Saudi Arabia 399
67Flag of North Macedonia.svg  North Macedonia 393
67Flag of Thailand.svg  Thailand 393
69Flag of Azerbaijan.svg  Azerbaijan 389
70Flag of Kazakhstan.svg  Kazakhstan 387
71Flag of Georgia.svg  Georgia 380
72Flag of Panama.svg  Panama 377
73Flag of Indonesia.svg  Indonesia 371
74Flag of Morocco.svg  Morocco 359
75Flag of Kosovo.svg  Kosovo 353
75Flag of Lebanon.svg  Lebanon 353
77Flag of the Dominican Republic.svg  Dominican Republic 342
78Flag of the Philippines.svg  Philippines 340
   
   

Rankings comparison 2000–2015

Mathematics
Country201520122009200620032000
ScoreRankScoreRankScoreRankScoreRankScoreRankScoreRank
International Average (OECD)490494495494499492
Flag of Albania.svg  Albania 41357394543775338133
Flag of Algeria.svg  Algeria 36072
Flag of Argentina.svg  Argentina 4095838830
Flag of Australia (converted).svg  Australia 49425504175141352012524105336
Flag of Austria.svg  Austria 497205061649622505175061850312
Flag of the People's Republic of China.svg  China B-S-J-G [lower-alpha 2] 5316
Flag of Belgium (civil).svg  Belgium 5071551513515125201152975208
Flag of Brazil.svg  Brazil 377683895538651370503563933435
Flag of Bulgaria.svg  Bulgaria 4414743943428414134343028
Flag of Argentina.svg  Argentina CABA [lower-alpha 3] 4564341849
Flag of Canada (Pantone).svg  Canada 51610518115278527753265336
Flag of Chile.svg  Chile 4235042347421444114438432
Flag of the Republic of China.svg  Taiwan 5424560354345491
Flag of Colombia.svg  Colombia 39064376583815237049
Flag of Costa Rica.svg  Costa Rica 4006240753
Flag of Croatia.svg  Croatia 46441471384603846734
Flag of Cyprus.svg  Cyprus 43748
Flag of the Czech Republic.svg  Czech Republic 492284992249325510155161249814
Flag of Denmark.svg  Denmark 511125002050317513145141451410
Flag of the Dominican Republic.svg  Dominican Republic 32873
Flag of Estonia.svg  Estonia 520952195121551513
Flag of Finland.svg  Finland 51113519105415548254425365
Flag of France.svg  France 49326495234972049622511155179
Flag of North Macedonia.svg  Macedonia 3716938133
Flag of Georgia.svg  Georgia 40460
Flag of Germany.svg  Germany 506165141451314504195031949016
Flag of Greece.svg  Greece 454444534046637459374453244724
Flag of Hong Kong.svg  Hong Kong 548256125552547355015601
Flag of Hungary.svg  Hungary 477374773749027491264902548817
Flag of Iceland.svg  Iceland 488314932550716506165151351410
Flag of Indonesia.svg  Indonesia 386663756037155391473603736734
Flag of Ireland.svg  Ireland 504185011848730501215032050312
Flag of Israel.svg  Israel 4703946639447394423843326
Flag of Italy.svg  Italy 490304853048333462364663145722
Flag of Japan.svg  Japan 532553665297523953455572
Flag of Jordan.svg  Jordan 38067386573875038448
Flag of Kazakhstan.svg  Kazakhstan 460424324540548
Flag of South Korea.svg  South Korea 524755445463547454235473
Flag of Kosovo.svg  Kosovo 36271
Flag of Latvia.svg  Latvia 482344912648234486304832746321
Flag of Lebanon.svg  Lebanon 39663
Flag of Lithuania.svg  Lithuania 47836479354773548629
Flag of Luxembourg.svg  Luxembourg 486334902748928490274932344625
Flag of Macau.svg  Macau 544353855251052585278
Flag of Malaysia.svg  Malaysia 4464542148
Flag of Malta.svg  Malta 47935
Flag of Mexico.svg  Mexico 408594135041946406453853638731
Flag of Moldova.svg  Moldova 42052
Flag of Montenegro.svg  Montenegro 41854410514034939946
Flag of the Netherlands.svg  Netherlands 512115238526953155384
Flag of New Zealand.svg  New Zealand 49521500215191152210523115374
Flag of Norway.svg  Norway 502194892849819490284952249913
Flag of Peru.svg  Peru 38765368613655729236
Flag of Poland.svg  Poland 504175181249523495244902447020
Flag of Portugal.svg  Portugal 492294872948731466354663045423
Flag of Qatar.svg  Qatar 40261376593685631852
Flag of Romania.svg  Romania 4444644542427424154242629
Flag of Russia.svg  Russia 494234823246836476324682947818
Flag of Singapore.svg  Singapore 564157315621
Flag of Slovakia.svg  Slovakia 4753848233497214922549821
Flag of Slovenia.svg  Slovenia 51014501195011850418
Flag of Spain.svg  Spain 486324843148332480314852647619
Flag of Sweden.svg  Sweden 494244783649424502205091651011
Flag of Switzerland (Pantone).svg   Switzerland 521853175346530652795297
Flag of Thailand.svg  Thailand 415564274641945417414173543227
Flag of Trinidad and Tobago.svg  Trinidad and Tobago 4175541447
Flag of Tunisia.svg  Tunisia 3677038856371543655135938
Flag of Turkey.svg  Turkey 4205144841445404244042333
Flag of the United Arab Emirates.svg  United Arab Emirates 4274943444
Flag of the United Kingdom.svg  United Kingdom 49227494244922649523508175297
Flag of the United States.svg  United States 470404813448729474334832849315
Flag of Uruguay.svg  Uruguay 4185340952427434273942234
Flag of Vietnam.svg  Vietnam 4952251115
Science
Country2015201220092006
ScoreRankScoreRankScoreRankScoreRank
International Average (OECD)493501501498
Flag of Albania.svg  Albania 427543975839154
Flag of Algeria.svg  Algeria 37672
Flag of Argentina.svg  Argentina 43252
Flag of Australia (converted).svg  Australia 510145211452795278
Flag of Austria.svg  Austria 49526506214942851117
Flag of the People's Republic of China.svg  China B-S-J-G [lower-alpha 2] 51810
Flag of Belgium (civil).svg  Belgium 50220505225071951018
Flag of Brazil.svg  Brazil 40166402554054939049
Flag of Bulgaria.svg  Bulgaria 44646446434394243440
Flag of Argentina.svg  Argentina CABA [lower-alpha 3] 4753842549
Flag of Canada (Pantone).svg  Canada 5287525952975343
Flag of Chile.svg  Chile 44745445444474143839
Flag of the Republic of China.svg  Taiwan 532452311520115324
Flag of Colombia.svg  Colombia 41660399564025038850
Flag of Costa Rica.svg  Costa Rica 4205842947
Flag of Croatia.svg  Croatia 47537491324863549325
Flag of Cyprus.svg  Cyprus 43351
Flag of the Czech Republic.svg  Czech Republic 49329508205002251314
Flag of Denmark.svg  Denmark 50221498254992449623
Flag of the Dominican Republic.svg  Dominican Republic 33273
Flag of Estonia.svg  Estonia 5343541552885315
Flag of Finland.svg  Finland 5315545455415631
Flag of France.svg  France 49527499244982549524
Flag of North Macedonia.svg  Macedonia 38470
Flag of Georgia.svg  Georgia 41163
Flag of Germany.svg  Germany 50916524105201251612
Flag of Greece.svg  Greece 45544467404703847337
Flag of Hong Kong.svg  Hong Kong 5239555154925422
Flag of Hungary.svg  Hungary 47735494305032050420
Flag of Iceland.svg  Iceland 47339478374962649126
Flag of Indonesia.svg  Indonesia 40365382603835539348
Flag of Ireland.svg  Ireland 50319522135081850819
Flag of Israel.svg  Israel 46740470394553945438
Flag of Italy.svg  Italy 48134494314893347535
Flag of Japan.svg  Japan 5382547353945316
Flag of Jordan.svg  Jordan 40964409544154742243
Flag of Kazakhstan.svg  Kazakhstan 456434254840053
Flag of South Korea.svg  South Korea 516115386538552210
Flag of Kosovo.svg  Kosovo 37871
Flag of Latvia.svg  Latvia 49031502234942949027
Flag of Lebanon.svg  Lebanon 38668
Flag of Lithuania.svg  Lithuania 47536496284913148831
Flag of Luxembourg.svg  Luxembourg 48333491334843648633
Flag of Macau.svg  Macau 5296521155111651116
Flag of Malaysia.svg  Malaysia 4434742050
Flag of Malta.svg  Malta 46541
Flag of Mexico.svg  Mexico 41661415524164641047
Flag of Moldova.svg  Moldova 42853
Flag of Montenegro.svg  Montenegro 41162410534015141246
Flag of the Netherlands.svg  Netherlands 5091752212522105259
Flag of New Zealand.svg  New Zealand 513125161653265307
Flag of Norway.svg  Norway 49824495295002348732
Flag of Peru.svg  Peru 397673736136957
Flag of Poland.svg  Poland 5012252685081749822
Flag of Portugal.svg  Portugal 50123489344933047436
Flag of Qatar.svg  Qatar 41859384593795634952
Flag of Romania.svg  Romania 43550439464284341845
Flag of Russia.svg  Russia 48732486354783747934
Flag of Singapore.svg  Singapore 556155125423
Flag of Slovakia.svg  Slovakia 46142471384903248829
Flag of Slovenia.svg  Slovenia 51313514185121551911
Flag of Spain.svg  Spain 49330496274883448830
Flag of Sweden.svg  Sweden 49328485364952750321
Flag of Switzerland (Pantone).svg   Switzerland 50618515175171351215
Flag of Thailand.svg  Thailand 42157444454254542144
Flag of Trinidad and Tobago.svg  Trinidad and Tobago 4255641048
Flag of Tunisia.svg  Tunisia 38669398574015238651
Flag of Turkey.svg  Turkey 42555463414544042442
Flag of the United Arab Emirates.svg  United Arab Emirates 4374844842
Flag of the United Kingdom.svg  United Kingdom 50915514195141451513
Flag of the United States.svg  United States 49625497265022148928
Flag of Uruguay.svg  Uruguay 43549416514274442841
Flag of Vietnam.svg  Vietnam 52585287
Reading
Country201520122009200620032000
ScoreRankScoreRankScoreRankScoreRankScoreRankScoreRank
International Average (OECD)493496493489494493
Flag of Albania.svg  Albania 40563394583855534939
Flag of Algeria.svg  Algeria 35071
Flag of Argentina.svg  Argentina 42556
Flag of Australia (converted).svg  Australia 50316512125158513752545284
Flag of Austria.svg  Austria 485334902647037490214912249219
Flag of the People's Republic of China.svg  China B-S-J-G [lower-alpha 2] 49427
Flag of Belgium (civil).svg  Belgium 499205091650610501115071150711
Flag of Brazil.svg  Brazil 407624075241249393474033639636
Flag of Bulgaria.svg  Bulgaria 4324943647429424024343032
Flag of Argentina.svg  Argentina CABA [lower-alpha 3] 4753842948
Flag of Canada (Pantone).svg  Canada 527352375245527452835342
Flag of Chile.svg  Chile 4594244143449414423741035
Flag of the Republic of China.svg  Taiwan 4972352384952149615
Flag of Colombia.svg  Colombia 42557403544134838549
Flag of Costa Rica.svg  Costa Rica 4275244145
Flag of Croatia.svg  Croatia 48731485334763447729
Flag of Cyprus.svg  Cyprus 44345
Flag of the Czech Republic.svg  Czech Republic 487304932447832483254892449220
Flag of Denmark.svg  Denmark 500184962349522494184921949716
Flag of the Dominican Republic.svg  Dominican Republic 35869
Flag of Estonia.svg  Estonia 5196516105011250112
Flag of Finland.svg  Finland 526452455362547254315461
Flag of France.svg  France 499195051949620488224961750514
Flag of North Macedonia.svg  Macedonia 3527037337
Flag of Georgia.svg  Georgia 40165
Flag of Germany.svg  Germany 509115081849718495174912148422
Flag of Greece.svg  Greece 467414773848330460354723047425
Flag of Hong Kong.svg  Hong Kong 527254515333536351095256
Flag of Hungary.svg  Hungary 470404882849424482264822548023
Flag of Iceland.svg  Iceland 482354833550015484234922050712
Flag of Indonesia.svg  Indonesia 397673965740253393463823837138
Flag of Ireland.svg  Ireland 5215523649619517651565275
Flag of Israel.svg  Israel 4793748632474354393945229
Flag of Italy.svg  Italy 485344902548627469324762948721
Flag of Japan.svg  Japan 51685383520749814498145229
Flag of Jordan.svg  Jordan 40861399554055140144
Flag of Kazakhstan.svg  Kazakhstan 427543935939054
Flag of South Korea.svg  South Korea 517753645391556153425257
Flag of Kosovo.svg  Kosovo 34772
Flag of Latvia.svg  Latvia 488294892748428479274912345828
Flag of Lebanon.svg  Lebanon 34773
Flag of Lithuania.svg  Lithuania 47239477374683847031
Flag of Luxembourg.svg  Luxembourg 481364883047236479284792744130
Flag of Macau.svg  Macau 5091250915487264922049815
Flag of Malaysia.svg  Malaysia 4315039856
Flag of Malta.svg  Malta 44744
Flag of Mexico.svg  Mexico 423584244942544410424003742234
Flag of Moldova.svg  Moldova 41659
Flag of Montenegro.svg  Montenegro 42755422504085039248
Flag of the Netherlands.svg  Netherlands 50315511135089507105138
Flag of New Zealand.svg  New Zealand 50910512115216521552255293
Flag of Norway.svg  Norway 51395042050311484245001250513
Flag of Peru.svg  Peru 39866384613705732740
Flag of Poland.svg  Poland 5061351895001450884971647924
Flag of Portugal.svg  Portugal 498214883148925472304782847026
Flag of Qatar.svg  Qatar 40264388603725631251
Flag of Romania.svg  Romania 4344743846424453964542833
Flag of Russia.svg  Russia 495264754045940440384423246227
Flag of Singapore.svg  Singapore 535154225264
Flag of Slovakia.svg  Slovakia 4534346341477334663346931
Flag of Slovenia.svg  Slovenia 50514481364832949419
Flag of Spain.svg  Spain 496254882948131461344812649318
Flag of Sweden.svg  Sweden 5001748334497175079514751610
Flag of Switzerland (Pantone).svg   Switzerland 492285091450113499134991349417
Flag of Thailand.svg  Thailand 409604414442146417404203543131
Flag of Trinidad and Tobago.svg  Trinidad and Tobago 4275341647
Flag of Tunisia.svg  Tunisia 3616840453404523805037539
Flag of Turkey.svg  Turkey 4285147539464394473644133
Flag of the United Arab Emirates.svg  United Arab Emirates 4344844242
Flag of the United Kingdom.svg  United Kingdom 49822499214942349516507105238
Flag of the United States.svg  United States 4972449822500164951850415
Flag of Uruguay.svg  Uruguay 4374641151426434134143434
Flag of Vietnam.svg  Vietnam 4873250817
  1. 1 2 3 Beijing, Shanghai, Jiangsu, Zhejiang
  2. 1 2 3 Shanghai (2009, 2012); Beijing, Shanghai, Jiangsu, Guangdong (2015)
  3. 1 2 3 Ciudad Autónoma de Buenos Aires

Previous years

PeriodFocusOECD countriesPartner countriesParticipating studentsNotes
2000Reading284 + 11265,000The Netherlands disqualified from data analysis. 11 additional non-OECD countries took the test in 2002.
2003Mathematics3011275,000UK disqualified from data analysis, due to its low response rate. [33] Also included test in problem solving.
2006Science3027400,000Reading scores for US disqualified from analysis due to misprint in testing materials. [34]
2009 [35] Reading3441 + 10470,00010 additional non-OECD countries took the test in 2010. [36] [37]
2012 [38] Mathematics3431510,000


Reception

(China) China's participation in the 2012 test was limited to Shanghai, Hong Kong, and Macau as separate entities. In 2012, Shanghai participated for the second time, again topping the rankings in all three subjects, as well as improving scores in the subjects compared to the 2009 tests. Shanghai's score of 613 in mathematics was 113 points above the average score, putting the performance of Shanghai pupils about 3 school years ahead of pupils in average countries. Educational experts debated to what degree this result reflected the quality of the general educational system in China, pointing out that Shanghai has greater wealth and better-paid teachers than the rest of China. [39] Hong Kong placed second in reading and science and third in maths.

Andreas Schleicher, PISA division head and co-ordinator, stated that PISA tests administered in rural China have produced some results approaching the OECD average. Citing further as-yet-unpublished OECD research, he said, "We have actually done Pisa in 12 of the provinces in China. Even in some of the very poor areas you get performance close to the OECD average." [40] Schleicher believes that China has also expanded school access and has moved away from learning by rote, [41] performing well in both rote-based and broader assessments. [40]

In 2018 the Chinese provinces that participated were Beijing, Shanghai, Jiangsu and Zhejiang. In 2015, the participating provinces were Jiangsu, Guangdong, Beijing, and Shanghai. [42] The 2015 Beijing-Shanghai-Jiangsu-Guangdong cohort scored a median 518 in science in 2015, while the 2012 Shanghai cohort scored a median 580.

Critics of PISA counter that in Shanghai and other Chinese cities, most children of migrant workers can only attend city schools up to the ninth grade, and must return to their parents' hometowns for high school due to hukou restrictions, thus skewing the composition of the city's high school students in favor of wealthier local families. A population chart of Shanghai reproduced in The New York Times shows a steep drop off in the number of 15-year-olds residing there. [43] According to Schleicher, 27% of Shanghai's 15-year-olds are excluded from its school system (and hence from testing). As a result, the percentage of Shanghai's 15-year-olds tested by PISA was 73%, lower than the 89% tested in the US. [44] Following the 2015 testing, OECD published in depth studies on the education systems of a selected few countries including China. [45]

In 2014, Liz Truss, the British Parliamentary Under-Secretary of State at the Department for Education, led a fact-finding visit to schools and teacher-training centres in Shanghai. [46] Britain increased exchanges with Chinese teachers and schools to find out how to improve quality. In 2014, 60 teachers from Shanghai were invited to the UK to help share their teaching methods, support pupils who are struggling, and help to train other teachers. [47] In 2016, Britain invited 120 Chinese teachers, planning to adopt Chinese styles of teaching in 8,000 aided schools. [48] By 2019, approximately 5,000 of Britain's 16,000 primary schools had adopted the Shanghai's teaching methods. [49] The performance of British schools in PISA improved after adopting China's teaching styles. [50] [51]

Finland

Finland, which received several top positions in the first tests, fell in all three subjects in 2012, but remained the best performing country overall in Europe, achieving their best result in science with 545 points (5th) and worst in mathematics with 519 (12th) in which the country was outperformed by four other European countries. The drop in mathematics was 25 points since 2003, the last time mathematics was the focus of the tests. For the first time Finnish girls outperformed boys in mathematics narrowly. It was also the first time pupils in Finnish-speaking schools did not perform better than pupils in Swedish-speaking schools. Former minister of Education and Science Krista Kiuru expressed concern for the overall drop, as well as the fact that the number of low-performers had increased from 7% to 12%. [52]

India

India participated in the 2009 round of testing but pulled out of the 2012 PISA testing, with the Indian government attributing its action to the unfairness of PISA testing to Indian students. [53] India had ranked 72nd out of 73 countries tested in 2009. [54] The Indian Express reported, "The ministry (of education) has concluded that there was a socio-cultural disconnect between the questions and Indian students. The ministry will write to the OECD and drive home the need to factor in India's "socio-cultural milieu". India's participation in the next PISA cycle will hinge on this". [55] The Indian Express also noted that "Considering that over 70 nations participate in PISA, it is uncertain whether an exception would be made for India".

India did not participate in the 2012, 2015 and 2018 PISA rounds. [56]

A Kendriya Vidyalaya Sangathan (KVS) committee as well as a group of secretaries on education constituted by the Prime Minister of India Narendra Modi recommended that India should participate in PISA. Accordingly, in February 2017, the Ministry of Human Resource Development under Prakash Javadekar decided to end the boycott and participate in PISA from 2020. To address the socio-cultural disconnect between the test questions and students, it was reported that the OECD will update some questions. For example, the word avocado in a question may be replaced with a more popular Indian fruit such as mango. [57]

Malaysia

In 2015, the results from Malaysia were found by the OECD to have not met the maximum response rate. [58] Opposition politician Ong Kian Ming said the education ministry tried to oversample high-performing students in rich schools. [59] [60]

Sweden

Sweden's result dropped in all three subjects in the 2012 test, which was a continuation of a trend from 2006 and 2009. It saw the sharpest fall in mathematics performance with a drop in score from 509 in 2003 to 478 in 2012. The score in reading showed a drop from 516 in 2000 to 483 in 2012. The country performed below the OECD average in all three subjects. [61] The leader of the opposition, Social Democrat Stefan Löfven, described the situation as a national crisis. [62] Along with the party's spokesperson on education, Ibrahim Baylan, he pointed to the downward trend in reading as most severe. [62]

In 2020, Swedish newspaper Expressen revealed that Sweden had inflated their score in PISA 2018 by not conforming to OECD standards. According to professor Magnus Henrekson a large number of foreign-born students had not been tested. [63] According to an article of Sveriges Radio, poor immigrant children's scores are a significant cause of the recent decrease in Swedish Pisa scores.

United Kingdom

In the 2012 test, as in 2009, the result was slightly above average for the United Kingdom, with the science ranking being highest (20). [64] England, Wales, Scotland and Northern Ireland also participated as separated entities, showing the worst result for Wales which in mathematics was 43rd of the 65 countries and economies. Minister of Education in Wales Huw Lewis expressed disappointment in the results, said that there were no "quick fixes", but hoped that several educational reforms that have been implemented in the last few years would give better results in the next round of tests. [65] The United Kingdom had a greater gap between high- and low-scoring students than the average. There was little difference between public and private schools when adjusted for socio-economic background of students. The gender difference in favour of girls was less than in most other countries, as was the difference between natives and immigrants. [64]

Writing in the Daily Telegraph , Ambrose Evans-Pritchard warned against putting too much emphasis on the UK's international ranking, arguing that an overfocus on scholarly performances in East Asia might have contributed to the area's low birthrate, which he argued could harm the economic performance in the future more than a good PISA score would outweigh. [66]

In 2013, the Times Educational Supplement (TES) published an article, "Is PISA Fundamentally Flawed?" by William Stewart, detailing serious critiques of PISA's conceptual foundations and methods advanced by statisticians at major universities. [67]

In the article, Professor Harvey Goldstein of the University of Bristol was quoted as saying that when the OECD tries to rule out questions suspected of bias, it can have the effect of "smoothing out" key differences between countries. "That is leaving out many of the important things," he warned. "They simply don't get commented on. What you are looking at is something that happens to be common. But (is it) worth looking at? PISA results are taken at face value as providing some sort of common standard across countries. But as soon as you begin to unpick it, I think that all falls apart."

Queen's University Belfast mathematician Dr. Hugh Morrison stated that he found the statistical model underlying PISA to contain a fundamental, insoluble mathematical error that renders Pisa rankings "valueless". [68] Goldstein remarked that Dr. Morrison's objection highlights "an important technical issue" if not a "profound conceptual error". However, Goldstein cautioned that PISA has been "used inappropriately", contending that some of the blame for this "lies with PISA itself. I think it tends to say too much for what it can do and it tends not to publicise the negative or the weaker aspects." Professors Morrison and Goldstein expressed dismay at the OECD's response to criticism. Morrison said that when he first published his criticisms of PISA in 2004 and also personally queried several of the OECD's "senior people" about them, his points were met with "absolute silence" and have yet to be addressed. "I was amazed at how unforthcoming they were," he told TES. "That makes me suspicious." "Pisa steadfastly ignored many of these issues," he says. "I am still concerned." [69]

Professor Svend Kreiner, of the University of Copenhagen, agreed: "One of the problems that everybody has with PISA is that they don't want to discuss things with people criticising or asking questions concerning the results. They didn't want to talk to me at all. I am sure it is because they can't defend themselves. [69]

United States

Since 2012 a few states have participated in the PISA tests as separate entities. Only the 2012 and 2015 results are available on a state basis. Puerto Rico participated in 2015 as a separate US entity as well.

2012 US State results
MathematicsScienceReading
Flag of Massachusetts.svg  Massachusetts 514
Flag of Connecticut.svg  Connecticut 506
Flag of the United States.svg US Average481
Flag of Florida.svg  Florida 467
Flag of Massachusetts.svg  Massachusetts 527
Flag of Connecticut.svg  Connecticut 521
Flag of the United States.svg US Average497
Flag of Florida.svg  Florida 485
Flag of Massachusetts.svg  Massachusetts 527
Flag of Connecticut.svg  Connecticut 521
Flag of the United States.svg US Average498
Flag of Florida.svg  Florida 492
2015 US State results
MathematicsScienceReading
Flag of Massachusetts.svg  Massachusetts 500
Flag of North Carolina.svg  North Carolina 471
Flag of the United States.svg US Average470
Flag of Puerto Rico.svg  Puerto Rico 378
Flag of Massachusetts.svg  Massachusetts 529
Flag of North Carolina.svg  North Carolina 502
Flag of the United States.svg US Average496
Flag of Puerto Rico.svg  Puerto Rico 403
Flag of Massachusetts.svg  Massachusetts 527
Flag of North Carolina.svg  North Carolina 500
Flag of the United States.svg US Average497
Flag of Puerto Rico.svg  Puerto Rico 410

PISA results for the United States by race and ethnicity

Mathematics
Race2018 [70] 20152012200920062003
ScoreScoreScoreScoreScoreScore
Asian539498549524494506
White503499506515502512
US Average478470481487474483
More than one race474475492487482502
Hispanic452446455453436443
Other423436460446446
Black419419421423404417
Science
Race2018 [70] 2015201220092006
ScoreScoreScoreScoreScore
Asian551525546536499
White529531528532523
US Average502496497502489
More than one race502503511503501
Hispanic478470462464439
Other462439465453
Black440433439435409
Reading
Race2018 [70] 201520122009200620032000
ScoreScoreScoreScoreScoreScoreScore
Asian556527550541513546
White531526519525525538
US Average505497498500495504
More than one race501498517502515
Hispanic481478478466453449
Black448443443441430445
Other440438462456455

Research on possible causes of PISA disparities in different countries

Although PISA and TIMSS officials and researchers themselves generally refrain from hypothesizing about the large and stable differences in student achievement between countries, since 2000, literature on the differences in PISA and TIMSS results and their possible causes has emerged. [71] Data from PISA have furnished several researchers, notably Eric Hanushek, Ludger Wößmann, Heiner Rindermann, and Stephen J. Ceci, with material for books and articles about the relationship between student achievement and economic development, [72] democratization, and health; [73] as well as the roles of such single educational factors as high-stakes exams, [74] the presence or absence of private schools and the effects and timing of ability tracking. [75]

Comments on accuracy

David Spiegelhalter of Cambridge wrote: "Pisa does present the uncertainty in the scores and ranks - for example the United Kingdom rank in the 65 countries is said to be between 23 and 31. It's unwise for countries to base education policy on their Pisa results, as Germany, Norway and Denmark did after doing badly in 2001." [76]

According to a Forbes opinion article, some countries such as China, Hong Kong, Macau, and Argentina select PISA samples from only the best-educated areas or from their top-performing students, slanting the results. [77]

According to an open letter to Andreas Schleicher, director of PISA, various academics and educators argued that "OECD and Pisa tests are damaging education worldwide". [78]

According to O Estado de São Paulo, Brazil shows a great disparity when classifying the results between public and private schools, where public schools would rank worse than Peru, while private schools would rank better than Finland. [79]

See also

Explanatory notes

    Related Research Articles

    <span class="mw-page-title-main">Mathematics education</span> Teaching, learning, and scholarly research in mathematics

    In contemporary education, mathematics education—known in Europe as the didactics or pedagogy of mathematics—is the practice of teaching, learning, and carrying out scholarly research into the transfer of mathematical knowledge.

    Education in Japan is managed by the Ministry of Education, Culture, Sports, Science and Technology (MEXT) of Japan. Education is compulsory at the elementary and lower secondary levels. Throughout all levels, the academic year starts in April and ends in March, with two long holidays: summer and winter.

    The educational system in Taiwan is the responsibility of the Ministry of Education. The system produces pupils with some of the highest test scores in the world, especially in mathematics and science. Former president Ma Ying-jeou announced in January 2011 that the government would begin the phased implementation of a twelve-year compulsory education program by 2014.

    <span class="mw-page-title-main">Education in Switzerland</span>

    The education system in Switzerland is very diverse, because the constitution of Switzerland delegates the authority for the school system mainly to the cantons. The Swiss constitution sets the foundations, namely that primary school is obligatory for every child and is free in state schools and that the confederation can run or support universities.

    <span class="mw-page-title-main">National Assessment of Educational Progress</span> Assessment

    The National Assessment of Educational Progress (NAEP) is the largest continuing and nationally representative assessment of what U.S. students know and can do in various subjects. NAEP is a congressionally mandated project administered by the National Center for Education Statistics (NCES), within the Institute of Education Sciences (IES) of the United States Department of Education. The first national administration of NAEP occurred in 1969. The National Assessment Governing Board (NAGB) is an independent, bipartisan board that sets policy for NAEP and is responsible for developing the framework and test specifications.The National Assessment Governing Board, whose members are appointed by the U.S. Secretary of Education, includes governors, state legislators, local and state school officials, educators, business representatives, and members of the general public. Congress created the 26-member Governing Board in 1988.

    <span class="mw-page-title-main">Progress in International Reading Literacy Study</span> International study of fourth graders literacy

    The IEA's Progress in International Reading Literacy Study (PIRLS) is an international study of reading (comprehension) achievement in 9-10 year olds. It has been conducted every five years since 2001 by the International Association for the Evaluation of Educational Achievement (IEA). It is designed to measure children's reading literacy achievement, to provide a baseline for future studies of trends in achievement, and to gather information about children's home and school experiences in learning to read.

    <span class="mw-page-title-main">Trends in International Mathematics and Science Study</span> Study of international math and science skills

    The IEA's Trends in International Mathematics and Science Study (TIMSS) is a series of international assessments of the mathematics and science knowledge of students around the world. The participating students come from a diverse set of educational systems in terms of economic development, geographical location, and population size. In each of the participating educational systems, a minimum of 4,000 to 5,000 students is evaluated. Contextual data about the conditions in which participating students learn mathematics and science are collected from the students and their teachers, their principals, and their parents via questionnaires.

    <span class="mw-page-title-main">Australian Council for Educational Research</span> Educational research organization

    The Australian Council for Educational Research (ACER), established in 1930, is an independent educational research organisation based in Camberwell, Victoria (Melbourne) and with offices in Adelaide, Brisbane, Dubai, Jakarta, London, New Delhi, Perth and Sydney. ACER develops and manages a range of testing and assessment services and conducts research and analysis in the education sector.

    Education in Lebanon is regulated by the Ministry of Education and Higher Education (MEHE). In Lebanon, the main three languages, English and/or French with Arabic are taught from early years in schools. English or French are the mandatory media of instruction for mathematics and sciences for all schools. Education is compulsory from age 3 to 14.

    Singapore math is a teaching method based on the national mathematics curriculum used for first through sixth grade in Singaporean schools. The term was coined in the United States to describe an approach originally developed in Singapore to teach students to learn and master fewer mathematical concepts at greater detail as well as having them learn these concepts using a three-step learning process: concrete, pictorial, and abstract. In the concrete step, students engage in hands-on learning experiences using physical objects which can be everyday items such as paper clips, toy blocks or math manipulates such as counting bears, link cubes and fraction discs. This is followed by drawing pictorial representations of mathematical concepts. Students then solve mathematical problems in an abstract way by using numbers and symbols.

    <span class="mw-page-title-main">Literacy in the United States</span> Overview of literacy in the United States

    Literacy in the United States was categorized by the National Center for Education Statistics into different literacy levels, with 92% of American adults having at least "Level 1" literacy in 2014. Nationally, over 20% of adult Americans have a literacy proficiency at or below Level 1. Adults in this range have difficulty using or understanding print materials. Those on the higher end of this category can perform simple tasks based on the information they read, but adults below Level 1 may only understand very basic vocabulary or be functionally illiterate. According to a 2020 report by Gallup based on data from the U.S. Department of Education, 54% of adults in the United States lack English literacy proficiency.

    <span class="mw-page-title-main">NAPLAN</span> Australias national school assessment program

    The National Assessment Program – Literacy and Numeracy (NAPLAN) is a series of tests focused on basic skills that are administered to Australian students in year 3, 5, 7 and 9. These standardised tests assess students' reading, writing, language and numeracy and are administered by the Australian Curriculum, Assessment and Reporting Authority (ACARA). The National Assessment Program is overseen by the Education Ministers Meeting.

    <span class="mw-page-title-main">Nuno Crato</span> Portuguese professor, researcher, applied mathematician, economist and writer

    Nuno Paulo de Sousa Arrobas Crato, GCIH, GCPI is a Portuguese university professor, researcher, applied mathematician, economist, and writer. For many years, Crato was a researcher and professor in the United States. Back in Portugal, he taught mathematics and statistics at the ISEG/Technical University of Lisbon, now University of Lisbon, while pursuing his research in stochastic models and time series. He also published many articles and participated in events of science popularization and for the history of science. In June 2011, he was appointed Minister of Education, Higher Education and Science, in the cabinet of the Portuguese Government led by Pedro Passos Coelho, serving through the end of Coelho's government in 2015. He was three times awarded a national medal from the President of the Republic, as commander (2008) and with the grand cross (2016) of the Order of Prince Henry the Navigator, which is the highest grade given to a national figure. Lastly, as grand cross of Order of Public Instruction (Portugal) (2022), which is the highest grade of this order. He has lived and worked in Lisbon, Azores, the United States and Italy.

    <span class="mw-page-title-main">Education policy in Brazil</span> Overview of the education policy in Brazil

    Education policy in Brazil has been given importance by the federal and local governments since 1995. At that time, the government of President Fernando Henrique Cardoso and the Brazilian Ministry of Education began to pursue three areas of national education policy:

    The gender gaps in mathematics and reading achievement refer to the finding that, on average, the two sexes perform differently in mathematics and reading skills on tests. On average, boys and men excell in mathematics, while girls and women excell in reading skills.

    The Programme for International Student Assessment has had several runs before the most recent one in 2012. The first PISA assessment was carried out in 2000. The results of each period of assessment take about one year and a half to be analysed. First results were published in November 2001. The release of raw data and the publication of technical report and data handbook only took place in spring 2002. The triennial repeats follow a similar schedule; the process of seeing through a single PISA cycle, start-to-finish, always takes over four years. 470,000 15-year-old students representing 65 nations and territories participated in PISA 2009. An additional 50,000 students representing nine nations were tested in 2010.

    <span class="mw-page-title-main">Female education in STEM</span>

    Female education in STEM refers to child and adult female representation in the educational fields of science, technology, engineering, and mathematics (STEM). In 2017, 33% of students in STEM fields were women.

    Margaret Wu is an Australian statistician and psychometrician who specialises in educational measurement. She is an honorary professor at the University of Melbourne.

    <span class="mw-page-title-main">Education of Generation Z</span> Schooling of those born between the mid-to-late 1990s and early 2010s

    Generation Z, colloquially also known as zoomers, is the demographic cohort succeeding Millennials and preceding Generation Alpha. Researchers and popular media use the mid-to-late 1990s as starting birth years and the early 2010s as ending birth years. This article focuses specifically on the education of Generation Z.

    References

    1. "About PISA". OECD PISA. Retrieved 8 February 2018.
    2. Berger, Kathleen (3 March 2014). Invitation to The Life Span (second ed.). worth. ISBN   978-1-4641-7205-2.
    3. "PISA 2022 Results". OECD. December 2023. Archived from the original on 5 December 2023. Retrieved 15 December 2023.
    4. 1 2 3 4 5 "Rey O, 'The use of external assessments and the impact on education systems' in CIDREE Yearbook 2010, accessed January 2017". Archived from the original on 3 February 2017. Retrieved 22 November 2019.
    5. McGaw, B (2008) 'The role of the OECD in international comparative studies of achievement' Assessment in Education: Principles, Policy & Practice, 15:3, 223–243
    6. 1 2 Kijima, Rie; Lipscy, Phillip Y. (1 January 2024). "The politics of international testing". The Review of International Organizations. 19 (1): 1–31. doi: 10.1007/s11558-023-09494-4 . ISSN   1559-744X.
    7. 1 2 Ramirez, Francisco O.; Schofer, Evan; Meyer, John W. (2018). "International Tests, National Assessments, and Educational Development (1970–2012)". Comparative Education Review. 62 (3): 344–364. doi:10.1086/698326. ISSN   0010-4086.
    8. Kamens, David H.; McNeely, Connie L. (2010). "Globalization and the Growth of International Educational Testing and National Assessment". Comparative Education Review. 54 (1): 5–25. doi:10.1086/648471. ISSN   0010-4086.
    9. Mons N, (2008) 'Évaluation des politiques éducatives et comparaisons internationales', Revue française de pédagogie, 164, juillet-août-septembre 2008 5–13
    10. 1 2 3 4 5 6 Breakspear, S. (2012). "The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance". OECD Education Working Paper. OECD Education Working Papers. 71. doi: 10.1787/5k9fdfqffr28-en .
    11. Barroso, J. and de Carvalho, L.M. (2008) 'Pisa: Un instrument de régulation pour relier des mondes', Revue française de pédagogie, 164, 77–80
    12. Martens, Kerstin; Niemann, Dennis (2013). "When Do Numbers Count? The Differential Impact of the PISA Rating and Ranking on Education Policy in Germany and the US". German Politics. 22 (3): 314–332. doi:10.1080/09644008.2013.794455. ISSN   0964-4008.
    13. Ertl, H. (2006). "Educational standards and the changing discourse on education: the reception and consequences of the PISA study in Germany". Oxford Review of Education. 32 (5): 619–634. doi:10.1080/03054980600976320. S2CID   144656964.
    14. Bajomi, I., Berényi, E., Neumann, E. and Vida, J. (2009). 'The Reception of PISA in Hungary' accessed January 2017
    15. Steiner-Khamsi (2003), cited by Breakspear, S. (2012). "The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance". OECD Education Working Paper. OECD Education Working Papers. 71. doi: 10.1787/5k9fdfqffr28-en .
    16. Mangez, Eric; Cattonar, Branka (September–December 2009). "The status of PISA in the relationship between civil society and the educational sector in French-speaking Belgium". Sísifo: Educational Sciences Journal (10). Educational Sciences R&D Unit of the University of Lisbon: 15–26. ISSN   1646-6500 . Retrieved 26 December 2017.
    17. "Greger, D. (2008). 'Lorsque PISA importe peu. Le cas de la République Tchèque et de l'Allemagne', Revue française de pédagogie, 164, 91–98. cited in Rey O, 'The use of external assessments and the impact on education systems' in CIDREE Yearbook 2010, accessed January 2017". Archived from the original on 3 February 2017. Retrieved 22 November 2019.
    18. Afonso, Natércio; Costa, Estela (September–December 2009). "The influence of the Programme for International Student Assessment (PISA) on policy decision in Portugal: the education policies of the 17th Portuguese Constitutional Government" (PDF). Sísifo: Educational Sciences Journal (10). Educational Sciences R&D Unit of the University of Lisbon: 53–64. ISSN   1646-6500 . Retrieved 26 December 2017.
    19. Rautalin, M.; Alasuutari (2009). "The uses of the national PISA results by Finnish officials in central government". Journal of Education Policy. 24 (5): 539–556. doi:10.1080/02680930903131267. S2CID   154584726.
    20. Egelund, N. (2008). 'The value of international comparative studies of achievement – a Danish perspective', Assessment in Education: Principles, Policy & Practice, 15, 3, 245–251
    21. "Behrens, 2006 cited in Rey O, 'The use of external assessments and the impact on education systems in CIDREE Yearbook 2010, accessed January 2017". Archived from the original on 3 February 2017. Retrieved 22 November 2019.
    22. Hefling, Kimberly. "Asian nations dominate international test". Yahoo!.
    23. "Chapter 2 of the publication 'PISA 2003 Assessment Framework'" (PDF). Pisa.oecd.org.
    24. Keeley B. PISA, we have a problem… OECD Insights, April 2014.
    25. Poddiakov, Alexander Complex Problem Solving at PISA 2012 and PISA 2015: Interaction with Complex Reality. // Translated from Russian. Reference to the original Russian text: Poddiakov, A. (2012.) Reshenie kompleksnykh problem v PISA-2012 i PISA-2015: vzaimodeistvie so slozhnoi real'nost'yu. Obrazovatel'naya Politika, 6, 34–53.
    26. C. Füller: Pisa hat einen kleinen, fröhlichen Bruder. taz, 5.12.2007
    27. Stanat, P; Artelt, C; Baumert, J; Klieme, E; Neubrand, M; Prenzel, M; Schiefele, U; Schneider, W (2002), PISA 2000: Overview of the study—Design, method and results, Berlin: Max Planck Institute for Human Development
    28. Mazzeo, John; von Davier, Matthias (2013), Linking Scales in International Large-Scale Assessments, chapter 10 in Rutkowski, L. von Davier, M. & Rutkowski, D. (eds.) Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis., New York: Chapman and Hall/CRC.
    29. von Davier, Matthias; Sinharay, Sandip (2013), Analytics in International Large-Scale Assessments: Item Response Theory and Population Models, chapter 7 in Rutkowski, L. von Davier, M. & Rutkowski, D. (eds.) Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis., New York: Chapman and Hall/CRC.
    30. PISA 2018 Results: Combined Executive Summaries, Volumes I, II, & III (PDF) (Report). OECD. 2019. Retrieved 24 November 2022.
    31. PISA 2018: Insights and Interpretations (PDF), OECD, 3 December 2019, retrieved 4 December 2019
    32. PISA 2018 in Spain (PDF), OECD, 15 November 2019, retrieved 28 February 2021
    33. Jerrim, John (2021). "PISA 2018 in England, Northern Ireland, Scotland and Wales: Is the data really representative of all four corners of the UK?". Review of Education. 9 (3). doi:10.1002/rev3.3270. ISSN   2049-6613.
    34. Baldi, Stéphane; Jin, Ying; Skemer, Melanie; Green, Patricia J; Herget, Deborah; Xie, Holly (10 December 2007), Highlights From PISA 2006: Performance of U.S. 15-Year-Old Students in Science and Mathematics Literacy in an International Context (PDF), NCES , retrieved 14 December 2013, PISA 2006 reading literacy results are not reported for the United States because of an error in printing the test booklets. Furthermore, as a result of the printing error, the mean performance in mathematics and science may be misestimated by approximately 1 score point. The impact is below one standard error.
    35. PISA 2009 Results: Executive Summary (PDF), OECD, 7 December 2010
    36. ACER releases results of PISA 2009+ participant economies, ACER, 16 December 2011, archived from the original on 14 December 2013
    37. Walker, Maurice (2011), PISA 2009 Plus Results (PDF), OECD, archived from the original (PDF) on 22 December 2011, retrieved 28 June 2012
    38. PISA 2012 Results in Focus (PDF), OECD, 3 December 2013, retrieved 4 December 2013
    39. Tom Phillips (3 December 2013) OECD education report: Shanghai's formula is world-beating The Telegraph. Retrieved 8 December 2013
    40. 1 2 Cook, Chris (7 December 2010), "Shanghai tops global state school rankings", Financial Times , retrieved 28 June 2012
    41. Mance, Henry (7 December 2010), "Why are Chinese schoolkids so good?", Financial Times , retrieved 28 June 2012
    42. Coughlan, Sean (26 August 2014). "Pisa tests to include many more Chinese pupils". BBC News.
    43. Helen Gao, "Shanghai Test Scores and the Mystery of the Missing Children", New York Times, 23 January 2014. For Schleicher's initial response to these criticisms see his post, "Are the Chinese Cheating in PISA Or Are We Cheating Ourselves?" on the OECD's website blog, Education Today, 10 December 2013.
    44. "William Stewart, "More than a quarter of Shanghai pupils missed by international Pisa rankings", Times Educational Supplement, March 6, 2014". Archived from the original on 15 March 2014. Retrieved 7 March 2014.
    45. http://www.oecd.org/china/Education-in-China-a-snapshot.pdf [ bare URL PDF ]
    46. Howse, Patrick (18 February 2014). "Shanghai visit for minister to learn maths lessons". BBC News . Retrieved 19 July 2014.
    47. Coughlan, Sean (12 March 2014). "Shanghai teachers flown in for maths". BBC News. Retrieved 11 August 2020.
    48. "Britain invites 120 Chinese Maths teachers for aided schools". India Today. 20 July 2016. Retrieved 12 August 2020.
    49. "Scores bolster case for Shanghai math in British schools | The Star". www.thestar.com.my. Retrieved 11 August 2020.
    50. Turner, Camilla (3 December 2019). "Britain jumps up international maths rankings following Chinese-style teaching". The Telegraph. ISSN   0307-1235 . Retrieved 11 August 2020.
    51. Starkey, Hannah (5 December 2019). "UK Boost International Maths Ranking After Adopting Chinese-Style Teaching". True Education Partnerships. Retrieved 11 August 2020.
    52. PISA 2012: Proficiency of Finnish youth declining University of Jyväskylä. Retrieved 9 December 2013
    53. Hemali Chhapia, TNN (3 August 2012). "India backs out of global education test for 15-year-olds". The Times of India . Archived from the original on 29 April 2013.
    54. PISA (Program for International Student Assessment): OECD, Drishti, 1 Sept 2021.
    55. "Poor PISA score: Govt blames 'disconnect' with India". The Indian Express. 3 September 2012.
    56. "India chickens out of international students assessment programme again". The Times of India. 1 June 2013.
    57. "PISA Tests: India to take part in global teen learning test in 2021". The Indian Express. 22 February 2017. Retrieved 19 May 2018.
    58. "Ong: Did ministry try to rig results for Pisa 2015 report?". 8 December 2016.
    59. "Who's telling the truth about M'sia's Pisa 2015 scores?". 9 December 2016.
    60. "Malaysian PISA results under scrutiny for lack of evidence – School Advisor". 8 December 2016.
    61. Lars Näslund (3 December 2013) Svenska skolan rasar i stor jämförelse Expressen . Retrieved 4 December 2013 (in Swedish)
    62. 1 2 Jens Kärrman (3 December 2013) Löfven om Pisa: Nationell kris Dagens Nyheter . Retrieved 8 December 2013 (in Swedish)
    63. "Sveriges PISA-framgång bygger på falska siffror". 2 June 2020.
    64. 1 2 Adams, Richard (3 December 2013), "UK students stuck in educational doldrums, OECD study finds", The Guardian , retrieved 4 December 2013
    65. Pisa ranks Wales' education the worst in the UK BBC. 3 December 2013. Retrieved 4 December 2013.
    66. Ambrose Evans-Pritchard (3 December 2013) Ambrose Evans-Pritchard Telegraph.co.uk. Retrieved 4 December 2013.
    67. "William Stewart, "Is Pisa fundamentally flawed?" Times Educational Supplement, July 26, 2013". Archived from the original on 23 August 2013. Retrieved 26 July 2013.
    68. Morrison, Hugh (2013). "A fundamental conundrum in psychology's standard model of measurement and its consequences for PISA global rankings" (PDF). Archived from the original (PDF) on 5 June 2013. Retrieved 13 July 2017.
    69. 1 2 Stewart, "Is PISA fundamentally flawed?" TES (2013).
    70. 1 2 3 "Highlights of U.S. PISA 2018 Results Web Report" (PDF).
    71. Hanushek, Eric A., and Ludger Woessmann. 2011. "The economics of international differences in educational achievement." In Handbook of the Economics of Education, Vol. 3, edited by Eric A. Hanushek, Stephen Machin, and Ludger Woessmann. Amsterdam: North Holland: 89–200.
    72. Hanushek, Eric; Woessmann, Ludger (2008), "The role of cognitive skills in economic development" (PDF), Journal of Economic Literature, 46 (3): 607–668, doi:10.1257/jel.46.3.607
    73. Rindermann, Heiner; Ceci, Stephen J (2009), "Educational policy and country outcomes in international cognitive competence studies", Perspectives on Psychological Science, 4 (6): 551–577, doi:10.1111/j.1745-6924.2009.01165.x, PMID   26161733, S2CID   9251473
    74. Bishop, John H (1997). "The effect of national standards and curriculum-based exams on achievement". American Economic Review . Papers and Proceedings. 87 (2): 260–264. JSTOR   2950928.
    75. Hanushek, Eric; Woessmann, Ludger (2006), "Does educational tracking affect performance and inequality? Differences-in-differences evidence across countries" (PDF), Economic Journal, 116 (510): C63–C76, doi:10.1111/j.1468-0297.2006.01076.x
    76. Alexander, Ruth (10 December 2013). "How accurate is the Pisa test?". BBC News. Retrieved 22 November 2019.
    77. Flows, Capital. "Are The PISA Education Results Rigged?". Forbes. Retrieved 22 November 2019.
    78. Guardian Staff (6 May 2014). "OECD and Pisa tests are damaging education worldwide – academics". The Guardian. Retrieved 22 November 2019 via www.theguardian.com.
    79. Cafardo, Rafael (4 December 2019). "Escolas privadas de elite do Brasil superam Finlândia no Pisa, rede pública vai pior do que o Peru" . Retrieved 4 December 2019 via www.estadao.com.br.