National Assessment Program – Literacy and Numeracy

National Assessment Program – Literacy and Numeracy

Sign announcing tests, Greenbank State School, 2014
Acronym NAPLAN
Type Standardised test
Developer / administrator Australian Curriculum, Assessment and Reporting Authority
Knowledge / skills tested Numeracy, literacy
Purpose To provide a snapshot of a student's current reading, writing, language and numeracy skills
Offered Once a year
Countries / regions Australia
Languages English
Scores / grades used by Schools (grades 3, 5, 7 and 9)
Website www.nap.edu.au/naplan/naplan.html

The National Assessment Program – Literacy and Numeracy (NAPLAN) is a series of tests focused on basic skills that are administered annually to Australian students. These standardised tests assess students' reading, writing, language (spelling, grammar and punctuation) and numeracy and are administered by the Australian Curriculum, Assessment and Reporting Authority (ACARA). The National Assessment Program is overseen by the Council of Australian Governments Education Council.[1]

NAPLAN was introduced in 2008. ACARA has managed the tests from 2010 onwards.[2] The tests are designed to determine if Australian students are achieving outcomes.[2] There has been a great deal of contention in the educational community as to whether the tests are appropriate, whether teachers are teaching as they normally would or teaching to the test, and what the results of the test are being used for. The data obtained from the NAPLAN tests are collated and used to show all schools' average performance against other schools in the country on the Government My School website.[3]

The tests are also designed to be carried out on the same days all across Australia in any given year. Parents are able to decide whether their children take the test or not.[4] The vast majority of Year 3, 5, 7 and 9 students participate.[5]

Background

Prior to the introduction of NAPLAN the testing of literacy and numeracy was done individually by each jurisdiction.[6] According to New South Wales Public Schools the NAPLAN tests, which commenced in 2008, were instigated after the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) determined that "national testing in literacy and numeracy would proceed for the full cohort of students in years 3, 5, 7 and 9 from 2008 onward".[7] The NAPLAN tests would be used to determine if students were performing either above, at or below the National Minimum Standard in the areas of reading, language conventions, writing and numeracy skills for their particular year level.[7] The emergence of a national schooling system in Australia is part of a shift towards making educational policy part of national economic policy in response to globalization.[8]

According to ACARA the main purpose of the NAPLAN tests is to measure whether literacy and numeracy skills and knowledge that provide the critical foundation for other learning and for their productive and rewarding participation in the community. In essence the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) influence brought about a series of tests to determine whether students being prepared for later life appropriately in the present day school system. The introduction of national literacy and numeracy tests in 2008 has provided consistency, comparability and transferability of information on students’ literacy and numeracy performance nationally.

Stakeholders

External video
What is NAPLAN
Why NAPLAN is valuable

The primary stakeholders are students, parents and teachers. According to a Parent's Brochure the NAPLAN test results will be used to assist students and parents in discussing student progress with teachers, identifying students who require "greater challenges or additional support", identifying teaching program strengths and weaknesses and allow for school program review and support".[9]

Development

The development of the NAP tests began in 1999 when the Australian ministers of education worked together to produce the Adelaide declaration on national goals for schooling in the 21st century which sought to make all young Australian successful learners, confident and creative individuals and active and informed citizens.[10]

ACARA claims in their MySchool fact sheet that "processes have been put in place to ensure that NAPLAN is a valid and reliable measurement of students' literacy and numeracy ability".[11] It further goes on to state that "NAPLAN has a number of purposes including reporting national and jurisdictional achievements in literacy and numeracy as well as providing accurate and reliable measures of student and school performance. These purposes are carefully considered during the NAPLAN development process".

The development of the test includes input from indigenous experts from around the country to ensure the tests are designed to be inclusive of all students.[12] Intense community pressure on school performance has led to the growth of a test preparation industry.[13]

Each test contains between 30 and 40 questions.[14] Most students complete the tests by using a pencil and paper. In Victoria, Pearson Australia has been responsible for collecting NAPLAN data and marking some tests.[15] In Queensland the printing and distribution of tests, data collection and some marking is undertaken by Fuji Xerox Document Management Solutions which also processes tests from South Australia.[16]

In 2016, some schools will be trialing online testing.[17] If able to do so, some schools are expected to be able to conduct tests online by 2017. By 2019 all schools are expected to be able to complete testing online.[17]

Analysis and evaluation

"...at a national level we are seeing little change in student achievement in these important areas of learning."

Robert Randall, Chief Executive Officer, ACARA, [18]

The tests are not a high stakes event in a student's education. It is a snapshot of a student's current abilities. The tests do not measure higher-order thinking skills or creativity.[13] NAPLAN is a tool used for school improvement.[6]

Data from NAPLAN is modelled according to the item response theory.[14] This allows for comparisons to be made between tests, a process known as equating.

Validity and reliability

The down side of NAPLAN can be see when teachers are teaching to the test rather than teaching to the curriculum as can be seen in Victoria where according to Perkins (2010) teachers have been told to "teach explicitly for the national tests that are the cornerstone of the Federal Government's controversial My School website".

NAPLAN is also valid in that "special provisions which typically will reflect the support normally provided in the classroom may be provided to students with disabilities or special needs".

The Validity and Reliability in Quality Assessment in relation to NAPLAN can be summed up by ACARA in that they use an equating process to "provide a high level of assurance as to the reliability of comparisons between years" and that this process ensures that "any test difference has been taken into account before making statements about one year's results compared to the next".[11]

Flexibility and fairness

On the point of fairness it is important not to just rate the fairness of the test itself but to also rate the procedure of giving the test as well. Apart from the fact that the test is given mid-year so not all learning may have been successfully completed as would be expected by the end of the year for that particular grade,[19] writes that Queensland Teachers Union president Steve Ryan said some schools "probably have devoted too much time to NAPLAN".[19]

Although the test itself is extremely fair in that all students perform the same test nationwide, it also does not seem to take into account the fact that students in schools don’t just comprise the average but also include the likes of special needs students. ACARA points out that "Students can be exempted from one or more NAPLAN tests if they have significant intellectual or functional disability or if they are from a non-English-speaking background and arrived in Australia less than one year before the tests". It is understood therefore that NAPLAN is designed to test Literacy and Numeracy levels in students considered to be normal.[7] There is also the consideration to be given to the fact that selective schools can pick and choose which students attend their schools giving them unfair advantage in attaining higher scores in almost any national assessment and especially in NAPLAN.

Authenticity

As far as authenticity is concerned in the NAPLAN tests there are elements of real-world application and there are elements that are not real-world. One of the important points to consider however with the NAPLAN tests is that, especially in relation to numeracy, not all areas can have immediately foreseeable real-world application however that does not necessarily mean that the questions are unimportant. For the most part, the NAPLAN tests do seem to have quite a bit of real-world authenticity about them.

Results

Year Band National
minimum standard
3 1 to 6 2
5 3 to 8 4
7 4 to 9 5
9 5 to 10 6
Source: National Minimum Standards[7]

The NAPLAN Data Service identify areas of strength or weakness within a school or classroom. At the classroom level, the Item Analysis Report, the Writing Criteria Report and (for numeracy in particular) the Assessment Area Report provide powerful diagnostic information which can be used to complement school assessment and to inform the planning of teaching and learning programs. Reports are usually delivered in September.[20] Each student tested receives a student report.[14] Schools receive detailed results as to how each student answered individual questions, but do not have access to what the questions were. The tests provide an indication, not a fine grading, of a student's performance.[14] Parents are only given general feedback as to which percentile band their children are in for each type of test. ACARA does not provide the magnitude of the measurement error or the imprecision of the tests.[14]

On average in almost all NAPLAN tests home-schooled students perform better than students who attend schools.[21] Some schools, particularly small ones, are reporting such significant changes in year to year results that the results are meaningless.[2]

The data from NAPLAN is collated onto the MySchool website. The Australian Primary Principals Association does not support the publication of results in a way that allows for easy intra-school comparisons.[22] The results are graded along a series of ten bands based on achieving complex solutions to questions and spanning all age groups.[20] Data analysis packages are available to schools.[13] Some school are using the results from NAPLAN on an individual basis when making decisions regarding enrolment.[19] Tests results are directly linked to federal funding agreements with the states.[23]

The delay between testing and the release of results has been criticised for taking too long to be useful within the same year.[17] The test results have shown that since 2008 Year 3 students have gained at reading, grammar and writing skills. They have also revealed that improvements in spelling and numeracy were achieved by Year 5 students while the writing skills of Year 7 and 9 students have declined.[18]

Availability of past tests

The 2008, 2009, and 2010 tests were available from the National Assessment Program website, but have been removed, although archived copies are still available from The Wayback Machine. The 2011 tests were never available due to copyright. The tests appear to have become more difficult over time, particularly from 2008 to 2009.

See also

References

  1. ↑ "National Assessment Program". ACARA. Retrieved 4 March 2016.
  2. 1 2 3 Johnston, Jenny (2013). Contemporary Issues in Australian Literacy Teaching. lulu.com. p. 3132. ISBN 1300812826. Retrieved 28 February 2016.
  3. ↑ Justine Ferrari (27 January 2010). "Parents' guide to My School website". The Australian. News Limited. Retrieved 25 February 2016.
  4. ↑ Brittany Vonow (22 February 2016). "School flouts NAPLAN; Principal ‘doesn’t believe in’ the tests". The Courier-Mail. News Corp. Retrieved 23 February 2016.
  5. ↑ Care, Esther; Patrick Griffin; Zonghua Zhang; Danielle Hutchinson (2014). "Large scale learning and its contribution to learning". In Wyatt-Smith, Claire; Klenowski, Valentina; Colbertb, Peta. Designing Assessment for Quality Learning Volume 1 of The Enabling Power of Assessment. Springer Science & Business Media. p. 56. ISBN 9400759029. Retrieved 28 February 2016.
  6. 1 2 Guenther, John (2015). "Analysis of National Test Scores in very Remote Australian Schools". In Askell-Williams, Helen. Transforming the Future of Learning with Educational Research. IGI Global. pp. 125–127. ISBN 1466674962. Retrieved 28 February 2016.
  7. 1 2 3 4 "National Minimum Standards". NSW Education. Retrieved 25 February 2016.
  8. ↑ Lingard, Bob; Wayne Martino; Goli Rezai-Rashti; Sam Sellar (2015). Globalizing Educational Accountabilities. Routledge. p. 8. ISBN 1134640803. Retrieved 5 March 2016.
  9. ↑ "National Assessment Program Literacy and Numeracy 2010: Information for Parents" (PDF). ACARA. Retrieved 1 March 2016.
  10. ↑ "Why NAP?". ACARA. Retrieved 4 March 2016.
  11. 1 2 "My Schools Fact Sheet" (PDF). ACARA. January 2010. Retrieved 1 March 2016.
  12. ↑ Paulo, Santiago; Donaldson Graham; Herman Joan; Shewbridge Claire (2011). OECD Reviews of Evaluation and Assessment in Education OECD Reviews of Evaluation and Assessment in Education: Australia 2011 Volume 2011 of OECD Reviews of Evaluation and Assessment in Education. OECD Publishing. p. 60. ISBN 9264116672. Retrieved 23 February 2016.
  13. 1 2 3 Weatherby-Fell, Noelene (2015). Weatherby-Fell, Noelene, ed. Learning to Teach in the Secondary School. Cambridge University Press. p. 97. ISBN 1107461804. Retrieved 28 February 2016.
  14. 1 2 3 4 5 Wu, Margaret (2015). "What National Testing Data Can Tell Us". In Lingard, Bob; Thompson, Greg; Sellar, Sam. National Testing in Schools: An Australian Assessment. Routledge. pp. 19–23, 27. ISBN 1317333683. Retrieved 5 March 2016.
  15. ↑ Timna Jacks (23 December 2015). "Company marking NAPLAN accused of conflict of interest". The Age. Fairfax Media. Retrieved 25 February 2016.
  16. ↑ "FXDMS wins $4.8m govt contract". ProPrint. Sulobu Media. 30 October 2014. Retrieved 25 February 2016.
  17. 1 2 3 Alexandra Smith (31 October 2014). "NAPLAN numeracy and literacy tests to be online in 2017". Sydney Morning Herald. Fairfax Media. Retrieved 25 February 2016.
  18. 1 2 Alexandra Smith (5 August 2015). "NAPLAN 2015: Education chiefs warn students are not improving". Sydney Morning Herald. Fairfax Medi. Retrieved 25 February 2016.
  19. 1 2 3 Tanya Chilcott. "NAPLAN test focus slammed as students over-practise". The Courier-Mail. News Limited. Retrieved 29 February 2016.
  20. 1 2 Brady, Laurie; Kerry Kennedy (2013). Curriculum Construction. Pearson Higher Education AU. p. 200. ISBN 1486005152. Retrieved 28 February 2016.
  21. ↑ Alexandra Smith (7 February 2016). "Home-schooled kids perform better in NAPLAN: report". The Sydney Morning Herald. Fairfax Media. Retrieved 23 February 2016.
  22. ↑ "Strip results from My School website, say school principals". Sydney Morning Herald. Fairfax Media. 1 February 2010. Retrieved 11 September 2014.
  23. ↑ Miki Perkins (5 February 2010). "Teach for tests, teachers told". The Sydney Morning Herald. Faifax Media. Retrieved 1 March 2016.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.