Reliability, Validity and Practicality
How do you know if a test is effective? if you want to know the answer to that questions, you have to respond these questions about the test itself:
- Can I apply the test within appropiate administrative constraints?
- Does the test measure what you are trying to measure?
- Can the test be score by different teachers and yield similar results?
If you can answer positively to those three and other related questions, your test is an effective test or in other words your test is reliable, practical and valid.
Are Your Test Reliable, Valid and Practical
Let’s explore those concepts of reliability, validity and practicality a little bit more
A reliable test means that it should give the same results for similar groups of students and with different people marking.
- Keep the instruction language simple and give an example.
- Use language that is similar to what you’ve used in class, so as not to confuse students.
- If possible, ask a colleague to do the test before you use it with students.
- For testing productive skills such as writing and speaking, have two markers and use standard written criteria.
There are factors that contributes to the unreliability of a test such as:
- Student-related reliability which can be caused by fatigue, sickness, anxiety.
- Rater Reliability which can be caused by subjectivity, bias and human error
- Test Administration Reliability which can be caused by the conditions in which a test is administered
- Test Reliability which is caused by the nature of a test. Long tests can cause fatigue
Validity is the extent to which a test measures what it claims to measure. To make a valid test, you must be clear about what you are testing.
Always test what you have taught and can reasonably expect your students to know.
Check these two examples that illustrate the concept of validity well.
- To test writing with a question where your students don’t have enough background knowledge is unfair.
- Testing speaking where they are expected to respond to a reading passage they can’t understand will not be a good test of their speaking skills.
Practicality in assessment means that the test is easy to design, easy to administer and easy to score.
No matter how valid or reliable a test is, it has to be practical to make and to take this means that:
- It is economical to deliver. It is not excessively expensive
- The layout should be easy to follow and understand.
- It stays within appropriate time constraints
- It is relatively easy to administer
- Its correct evaluation procedure is specific and time-efficient
Characteristics of impractical tests are:
- these test are excessively expensive
- they are too long
- they require a handful of examiners to administer and score
- it takes several hours to grade a test
Learn More about Language Assessment
- What are Objective and Subjective Tests?
- How to Assess Grammar and Lexis
- How to Assess Writing Skills
- How to Assess Reading Skills
- How to Assess Speaking Skills
Lesson Planning: Listening
- The 3 Stages of a Listening Lesson
- 12 Types of Pre-Listening Activities
- 12 Examples of While-Listening Activities
- 10 Types of Post-Listening Activities
- What Types of Listening are There?
- Listening for Gist and Detail