RoleM On-Line Testing
What is the RoleM test?
The RoleM test is an online extension of the paper-based test used in the highly successful RoleM longitudinal study (2010 – 2013). These tests were administered in Foundation to Year 2 in some of the most disadvantaged schools in Queensland.

Questions are classified into the three strands of the Australian Mathematics Curriculum: Number and Algebra, Measurement and Geometry and Probability and Statistics.

What are the key features of the RoleM online test?

  • administered online
  • key concepts from the Australian Mathematics Curriculum are covered
  • test items are randomly generated
  • test papers are instantly marked
  • test program is compatible with a variety of IT platforms and software
  • tests can be administerd either individually, in small groups or whole class
  • questions are read to students which requires limited teacher support
  • entire test is completed within 30 minutes.

The RoleM Online testing report can be utilised in a number of ways, such as to:

  • provide a level of student achievement in accordance with the Australian Mathematics Curriculum
  • provide specific areas of the curriculum that need to be targeted
  • provide diagnostic information for whole class and individual students
  • identify concepts where misconceptions exist
  • identify students who may need additional support intervention or extension
  • link specific RoleM Learning Experiences that target these areas of support
  • provide a RoleM scale score which provides comparison between students
  • measures growth between pre and post testing
  • provide information to support teacher’s mathematics planning.

Quality RoleM Resources

  • Align with The Australian Mathematics Curriculum
  • Research based mathematics program (P-3)
  • Provide a gradual learning progression
  • Supports group work
  • Equitable teaching
  • Engaged and focussed
  • Makes mathematical connections
  • Supports NAPLAN
  • The learning experiences caters for a
  • range of modes of learning (linguistic, logical-mathematical, listening writing, speaking, body-kinesthetic, visual-spatial, musical, IT integration)
  • range of learners (differentiated  – consolidating, engaging and independent and extending learning experiences)
  • Supports mathematical thinking and language development
  • Uses a multi-representational approach
  • Coaches teachers to directly or explicitly model concepts
  • Uses hands on materials

Longitudinal Data

  • Teachers  – Semi-structured interviews (3 per year)
  • Principals – Semi-structured interviews (2 per year)
  • Indigenous education workers – Semi-structured interviews (2 per year) – conducted by Indigenous person
  • All interviews audio-taped, transcribed, analysed
  • Students (pre and post tests)
  • Marked, entered into SPSS for analysis

Selection of RoleM Test Items

  • Balance of questions types
  • Table to select the type of questions (and the representations in the test)
  • Examined existing tests used in schools
  • For content Australian Mathematics Curriculum
  • For the development of items
  • Balance between multiple choice or short answer
  • Trialed
  • Modified the questions and ordered questions in the test from easiest to most difficult
  • For the Administration of the test
  • Video taped the administration in the trial school
  • Analysed the style of delivery
  • Identified any biases in the administration
  • Wrote instructions on administration
  • Trained RoleM team members on different level tests
  • Team members watched experts administrating the test
  • Team members practiced the delivery of the test with small groups of students
  • Administered the test to whole sample

Why RoleM was successful

  • Whole School Approach (Consistency in learning)
  • Assessment driven
  • RoleM model of Professional learning
  • RoleM materials (sustainability)
  • P-3 implementation
  • Mathematical Language and Representations
  • Teachers and Teacher Aides trained
  • Teachers and Teacher Aides supported in classrooms
  • Pre-Post Testing
  • Links to the Australian Mathematics Curriculum