Two ways to increase the confidence with which you approach student evaluation are: to ensure that your evaluation program is the best that you can make it and to reaffirm that the most appropriate techniques for evaluating many objectives requires informed, inferential, and professional decisions. We know that, no matter how objective a mark or a grade may look on paper, it represents a professional's estimate, arrived at through a process involving subjective decision making.
Let us continue the analogy of the financial planner. Once the planner knows your current financial state, he or she can advise you in establishing your goals and in accomplishing them. At this stage, the planner's expertise will come into play more than in the inventory stage. However, the final decisions are yours, based on your own understanding of your goals. In this chapter, you will read about research findings, Saskatchewan policies on curriculum and evaluation, and trends in Saskatchewan curricula. To keep the handbook as readable as possible, no references to the literature are given in the text. A comprehensive bibliography is provided toward the end of the handbook.
After reading these sections, you might want to expand your evaluation program to take into account some of the issues raised. The handbook will show you how to do this. As before, we will proceed in steps. You will find it helpful to refer to your curriculum guide, daybook, or other resource documents you use for instructional planning.
By the time you have worked through this chapter, you will have reviewed the techniques you currently use to evaluate your students in terms of how adequate they are at the task. You will have identified gaps in your student evaluation program and will have considered which additional techniques would be suitable to fill the gaps. You will, in essence, have developed your own student evaluation program.
You may find that working through all the stages of the following process is challenging and time consuming, even to the point where you may feel overwhelmed. If that happens, decide on the one course where you feel it is most important to reassess your student evaluation program. Limit your scope to that course for now, and return to your other courses when time permits. Planning for student evaluation is a complex matter. To oversimplify it for expediency would be selling short your obligation to your students and to your own professionalism.
A number of issues need to be addressed before we embark on the planning activities of this chapter. One concerns the matter of how the Common Essential Learnings can be accommodated within a student evaluation program. Others include discussions concerning the Adaptive Dimension, bias, fairness and equity issues, and relationships among learning objectives, instructional approaches, and assessment techniques.
Teachers may choose to make adjustments in one, two, or all of the following areas.the concept of making adjustments in approved educational programs to accommodate diversity in student learning needs (p. 30).
The Adaptive Dimension permeates all practices the teacher uses to make learning meaningful and appropriate to each student. It requires constant monitoring of student progress and exploration into the reasons for the progress or lack of it. It is not designed solely for special needs students but emphasizes the importance of adapting programs for all students, as appropriate.
Student evaluation, as part of good pedagogy, must also be addressed within the Adaptive Dimension. If you are adjusting your program to meet the requirements of the Adaptive Dimension, you must also be prepared to adjust your student evaluation program. The assessment techniques you use are the same techniques that are outlined in Chapter 4.
The specific assessment techniques and the way they are used in the student evaluation program must be in line with the adaptations of curriculum content, instructional approaches and learning environment required within the Adaptive Dimension. Because each student is unique with individual strengths and weaknesses, and abilities, assessing all students in the same way may penalize some students. It is important to remember that, when assessing any student, barriers to accomplishing the assessment task, such as physical disabilities or visual impairment, should not interfere with the task.
When making adaptations to reflect specific student needs, it is important to remember that curricular objectives should not be modified. Therefore, although instructional strategies and assessment techniques may differ, all students are working toward attaining similar learning outcomes. The assessment practices used should align with the adaptations to curriculum and instruction provided for the student.
Adapting assessment techniques may require changing parameters such as the frequency of use, the criteria for judging student progress, the length of time allowed to complete the assessment activity, and the type of assessment technique itself. Some examples of these changes include:
As outlined in the Instructional Approaches document, the first step in the Adaptive Dimension is the assessment and evaluation of the needs of all students relative to the approved curriculum. Then, teachers have the opportunity to make decisions concerning the needs, abilities, and interests of small groups of students or of individual students.
|
Adaptations to curriculum, instruction, and learning environment should be guided by the following beliefs:
Principles of the Adaptive Dimension, Instructional Approaches: A Framework for Professional Practice, p. 32 |
A challenge to teachers is to determine the knowledge, processes, and skills that already exist in relation to the levels of expectation for the students' age and grade and the knowledge, processes, and skills that are in need of instructional attention in order to facilitate their growth. Both these objectives can be met by using diagnostic evaluation.
Diagnostic evaluation involves an intensive effort to gather information about a student's learning. The classroom teacher or resource teacher may conduct a formal assessment that includes standardized test results on the student's achievement and/or ability. The classroom teacher may also conduct informal assessment based on the curricula that will give information about the student's learning within the classroom setting.
Informal diagnostic assessment has the advantage that it is directly related to instruction. Using diagnostic assessment techniques will provide information on the student's current level of performance, help in the selection of instructional goals and objectives, give direction to instructional modifications, provide documentation of student learning progress, and guide future assessment.
In all types of assessment, and especially in informal diagnostic assessment, teacher observation assessment tools such as rating scales, checklists, and anecdotal records are important and useful data recording and scoring devices. When observation techniques are used systematically to detail, record, and analyze student performance, information is gathered concerning the student's strengths and instructional needs. Work samples collected over a period of time in a portfolio can be the basis for evaluation. Informal inventories and quizzes may also form part of the diagnostic assessment conducted by the classroom teacher.
Diagnostic assessment and evaluation will also provide the teacher with information about student learning style and the instructional strategies that >have been tried previously with the student, either successfully or unsuccessfully. Instructional time can be saved by eliminating unsuccessful methods early in the school year. As well, through daily school contact you become sensitive to the nonverbal reactions students have to the work being presented and you develop the ability to assess these clues for signs of frustration or enjoyment. Recording this information through the use of assessment techniques such as portfolios and anecdotal records are valuable tools within the Adaptive Dimension.
Structuring assessment techniques into questionnaires and interviews can also be used to obtain formative information on student motivation and interests, student study habits, and effective learning strategies. Adaptation can then be made to curriculum content, instruction, or classroom environment for small groups or individual students.
Many students have test information accompanying them throughout their school careers. It is important that teachers are aware of what assessments have been done and what information is already available. Historical test data that is more than one year old can provide some information about students, but current data are more valuable for planning purposes. You may wish to look at the assessment data accompanying students in terms of:
Maintaining good communication channels between the home and the school is important with all students, but with students having difficulties in school, the importance escalates. For example, knowing how extensively parents or guardians have been involved in supporting a student's educational program and how past communications have occurred can be valuable information in providing teachers with access to support mechanisms.
For more information about instruction and the Adaptive Dimension refer to Instructional Approaches: A Framework for Instructional Practice, Saskatchewan Education, 1991.
|
When evaluating a student who may require modifications in curriculum content, instructional practices, and/or learning environment, you may find the following steps useful.
|
Students, teachers and programs must be evaluated in a way that is sensitive to the context of the family, classroom, school and community. Since the determinants of educational outcomes vary so greatly among classrooms, schools, and communities it is important that evaluation procedures in education provide for fairness among students, teachers and others in education and, in particular, that procedures be sensitive to issues of educational equity (p. 10).
Operationalizing the terms is not simple. It depends upon what is meant by the phrase 'fairness and equity.' There are two extreme views on the matter.
These two views on fairness and equity can be seen as mutually exclusive. In Saskatchewan we might generalize by saying that in the elementary school the first view predominates, and by Grade 12 the second view has taken over. How you interpret fairness and equity is a value judgment that you as a teacher must make according to the philosophy of the curricula you use and your own goals and those of your school and district. By acknowledging openly where you stand on the continuum whose ends have been identified above, you will reduce the potential for confusion when you are discussing your teaching and evaluation practices with students and parents/guardians.
Saskatchewan Education has instituted specific mechanisms for reducing racial and gender bias in curricular and resource material. Teachers must be alert to the possibility of all kinds of bias within their classrooms and must act to eliminate them.
Recent research has found that testing practices are extremely susceptible to gender and ethnic bias. If you develop test items that use illustrations from hockey and baseball, you will find that boys consistently out-perform girls, even when the underlying principles are equally well understood by the two genders. As another example, if you develop an observation checklist to assess your students" functioning in group situations, you may unwittingly assume that your expectations for group functioning are the appropriate ones. In some cultures, group expectations are quite different from those of the mainstream culture to which most teachers belong. For an example of responses being subject to socioeconomic bias, consider the evaluation of an assignment devoted to 'comparing our community to another Canadian community'. Students who have been able to travel may be at an advantage when completing this >assignment.
It is very important that you are constantly on the alert for any type of bias that might creep into your student evaluation practices.
A useful way of examining the meaning or intent of curriculum objectives is in reference to a taxonomy of instructional objectives. Although it is recognized that other valuable taxonomies exist, elements of Bloom's Taxonomy (1956) are referred to here because educators generally recognize and understand them. Through an examination of the main verbs, teachers can gain insights into the intent of the objectives and the cognitive (knowledge, understanding, thinking), affective (feelings, interests, attitudes, appreciation), and psychomotor (physical skills) levels or domains that the objectives address.
Once they have understood the meaning of curriculum-stated learning objectives, teachers must develop specific course, unit, and lesson objectives. It is important that these objectives are stated clearly because they will form the basis for the selection or design of instructional material and teaching methods. As well, they provide insights into appropriate assessment techniques that can be used to determine the extent to which the learning objectives have been met.
With regard to assessment, teachers should use a variety of techniques to evaluate the cognitive domain. However, the verbs used to convey the intent of the learning objectives provide useful information for selecting specific assessment techniques. For example:
Learning objectives within the psychomotor domain are concerned with gross and finely coordinated body movements as well as verbal and nonverbal communication. Observation checklists, rating scales and anecdotal records are effective ways of gathering student progress information on student psychomotor development.
The chart on the following page has been constructed to aid teachers in matching assessment techniques to various instructional outcome categories that were identified in Instructional Approaches: A Framework for Professional Practice. The assessment techniques assigned to learning outcome categories are only suggestions for usage. Other combinations may also be appropriate.
Matching Assessment Techniques With Learning Outcome Categories
|
Learning Outcome Category & Assessment Technique |
|
|
|
|
|
|
|
|
|
|
|
Written Assignments |
X |
X |
X |
X |
X |
X |
X |
X | ||
|
Presentations |
X |
X |
X |
X |
X |
X |
X |
X |
X | |
|
Performance Assessments |
X |
X |
X |
X |
X |
X |
X |
X |
X |
X |
|
Homework |
X |
X |
X |
X |
X |
X |
X |
X | ||
|
Oral Assessment Items |
X |
X |
X |
X |
X |
X |
X |
X |
X | |
|
Performance Test Items |
X |
X |
X |
X |
X |
X |
X |
X |
X | |
|
Extended Open-Response Items |
X |
X |
X |
X |
X |
X |
X |
X | ||
|
Short-Answer Items |
X |
X |
X |
X |
X |
X |
X |
X | ||
|
Matching Items |
X |
X |
X |
X |
X | |||||
|
Multiple Choice Items |
X |
X |
X |
X |
X | |||||
|
True/False Items |
X |
X |
X |
X |
X |
The instructional plan is based on the Elementary Science Curriculum at the Grade 4 Level. One core unit in the curriculum is titled Cells and Systems. The first of two foundational objectives is "Understand some aspect of cell theory." Within the core unit, students are expected to learn some basic information about cells. Having mastered this basic information, the students proceed to the next foundational objective in which they study the skin in detail. The following example of instructional planning relates only to the first foundational objective. It should be pointed out at the outset that each teacher's approach to this unit would likely be different. This example is meant to illustrate some of the thought processes a teacher might go through in developing an instructional plan that incorporates assessment and evaluation in a unit of work. The chart that follows provides a handy overview of the planning decisions made by the teacher.

Although the instructional objectives appear to emphasize the two lowest cognitive levels, the curriculum guide provides possible teaching activities that incorporate experiential, interactive, and indirect instructional strategies. However, this is not to say that direct instruction (e.g., lecture, texts, and note-taking) is inappropriate. Indeed, it can be an effective way of introducing knowledge- level information, provided there is an appropriate match with the teaching and learning styles of the teacher and student respectively.
For the purposes of this example, the teacher spends two weeks on this unit of study.
|
Day 1
|
Numerous instructional approaches are possible to assist students to acquire the basic knowledge and understandings required of the unit. The direct lecture method is appropriate for constructing knowledge; however, in this instance the teacher has considered the learning styles of the students in the class and has concluded that they learn best by indirect and other student-centered methods. Since the purpose of the exercise is mainly formative, the teacher circulates around the class, observes student progress, provides encouragement and guidance, and notes significant observations on student behaviors by using checklists and creating anecdotal records. |
|
Day2
For those students who demonstrate prior knowledge and understanding of the basic concepts, learning contracts are developed to provide them enrichment. The tasks outlined in the learning contracts are to be completed by day eight. Linkages with subject areas such as health, language arts, social studies, physical education, mathematics, and consumer education are encouraged when developing contracts with the students. In these circumstances, learning contracts provide an excellent instructional solution for the more advanced students. Not only do they provide enrichment, but they also provide valuable and challenging activities for these students while the balance of the class obtains the basic unit knowledge and understandings. In addition, attention to more advanced students addresses the Adaptive Dimension. Checklists, rating scales, and anecdotal records are used to assess processes and products related to the learning contracts. The specific content of these data recording methods mirrors the evaluation criteria established in advance with the students.
|
Day3
In this case, the teacher decides that having the students share their knowledge and understanding and having them discuss concepts assists them to construct and reinforce the required knowledge base. In addition, misconceptions on the part of the students are readily identified and corrected. Again, since the activity is mainly formative in nature, the teacher uses the discussion period to determine whether the students have grasped the basic concepts or whether additional instruction is needed before proceeding to the next part of the instructional plan. Since acquisition of specific knowledge is to be demonstrated by the students at this point, the teacher employs a checklist and a rating scale to record the extent to which specific learnings are exhibited by the student.
|
|
Day4
Approximately four days are provided to introduce and complete the project. |
Day 9 On the final day of the unit, a summative, multiple-choice and short-answer test is used to check for knowledge and understanding. The multiple-choice and short-answer format is selected, in this instance, because it lends itself well to the Knowledge and Understanding cognitive levels of the learning objectives. In addition, this format provides for a low level of inference on the part of the teacher; all things being equal, this is desirable. The nature of the learning objectives suggests that assessment techniques employing higher levels of teacher inference are unnecessary, and indeed, they could result in less-reliable evaluations of student progress. In the event that some students have not yet mastered the required knowledge and understanding, the assessment information would serve a formative purpose, suggesting areas where the teacher should re-instruct or where additional student work is required. |
|
Day 8
|
Summative Evaluation Provided that summative evaluation of students at the end of this unit is desirable, the following are some considerations.
|
For printing and copying, these tables require Acrobat Reader
Make several copies of Worksheet 'E'. Then, start with your first grouping. For each course or subject in that grouping, list five or six of the major learning objectives your students are expected to achieve. If there are too many major learning objectives, start with a unit or two, then add additional major learning objectives for subsequent units. It is not important for this exercise that the objectives be stated in strict behaviorist termsÄall that matters is that they are pedagogically important and have a basis in the curriculum guide of the course or subject. Additional major learning objectives may be derived from:
Using Worksheet E, record some of the most important objectives for each of the units, courses, or subjects in your first grouping.
Record in the second column the technique to techniques you are using to assess your students. If your current evaluation program does not allow you to assess an objective, the gap in this column will alert you that additional techniques may be needed.
Repeat this analysis for all the groups in your courses using as many copies of worksheet E as you need.
Leave blank for the moment the column headed Additional Assessment Techniques to be Included.

Matching Student Assessment to course Objectives:
Worksheet E
Student Instructional or
Assessment Grouping
&nb sp;
|
|
|
|
| ||||
|
Major Objectives |
Assessment Techniques |
Additional assessment Techniques To be Included |
Uses? Diagnostic? Formative? Summative? |
Best Use? | |||
|
Objective #1 | |||||||
|
Objective #2 | |||||||
|
Objective #3 | |||||||
|
Objective #4 | |||||||
Diagnostic evaluation requires the most care because it is necessary to look at students' performance in terms of both what they are able to demonstrate and how and why they perform in the way they do. What strengths are noted and what areas are weak?
Systematic Use of Techniques
For each of the techniques you have selected for this
grouping, decide how you can use it more systematically.
Diagnostic evaluations involving the assessment of the level of science vocabulary or concepts, mathematical technical competency, language competence, or reading level are often done at the beginning of the year. Summative evaluations are most commonly carried out at the end of a unit although assessment information may have been collected much more frequently. Formative evaluations may be more informal because they are often carried out in response to the way you interpret your students' progress. An example of this is checking on students" rough notes before they begin a major project on 'The Environment'.
Also, record in your planning book any decisions you have made in light of the working through this section.
Recording of Data
The recording and storing of the raw data from
which you will make your evaluative decisions is
extremely important. Indeed, this may well be
where your new student evaluation program will
differ most from your current one. The importance
of keeping complete records stems from both the
nature of the techniques in an expanded evaluation
program and the job the information must do.
The nature of many of the techniques is that they require the teacher as the instrument much more than is traditionally the case. This is, of course, an entirely appropriate professional role. However, teachers are human beings and so have imperfect memories. Not only might you forget important information that you have collected on your students over the course of a school year, but your recollection of the information may be colored by the way you and your students have changed over time. You may be so pleased with the way your class is now functioning you forget the student growth that had to occur in order for the progress to happen. Anita and Darcy may have come out of their shells to such an extent that your recollection of this development fades. Only records written at the time can refresh your memory of what things were like back then. By rereading your data you will be able to arrive at an appropriate assessment of your students' achievements over the school year.
The second reason for maintaining your raw data is that these records have a job to do beyond the classroom. You may find in your community that you will need to work with your students' parents/guardians in explaining how your student evaluation program operates and what it is designed to accomplish. Parents/guardians are familiar with written examinations and have probably accepted the idea that marks on tests are somehow sacrosanct. When you report student progress on dimensions that were not assessed through written tests, you may well find that you need to demonstrate how you arrived at your evaluation. In turn, parents/guardians may provide you with insights into what sort of evaluative information they find most useful and relevant.
The data sheets will be invaluable aids to communication as well as records of student accomplishment. Here are some things to consider.
Also, record in your planning book any decisions you have made in light of reading this section.
Do not assume that low subjectivity means making no inferences at all! If you wish to gather data about your students' persona! and social skills, directly observing how your students function in social situations will provide you with more appropriate information than a written test. Asking students what they would do in certain situations provides a wealth of information in this area. The written test may appear to reduce the level of inference you must make about your students" achievements. But it is still an inappropriate assessment technique here because it cannot provide you with the information demanded by the objective.
When you feel you have fully considered this characteristic in relation to the assessment techniques listed on the worksheet, indicate this in the Lowest Possible Inference section of the Best Use column of Worksheet E 6;.
Also, record in your planning book any decisions you have made in light of reading this section.
Also, record in your planning book any decisions you have made in light of reading this section.
Scan Worksheet E and the notes you have made in your planning book.
Decide where you need additional or alternative student assessment techniques in your overall program.
Write those techniques in the column Additional Assessment Techniques to be Included.
You may find it helpful to browse through Chapter 4 of this handbook to refresh your memory of the techniques that are available. Each description of a technique includes the student evaluation context in which its use is most appropriate. Also, consult with your colleagues about how they assess their students. There is no point in reinventing the wheel. If you can borrow and adapt an existing instrument, so much the better.
For example, your course in science might comprise the following types of student learning, weighted according to the percentages shown in parentheses: - knowledge acquisition (30%), knowledge use in critical and creative thinking situations (30%), equipment-using skills (20%), functioning in group learning situations (10%), and attitude towards the subject (10%). These types of student learning may all have been assessed concurrently, through student activities or quizzes and tests, and not sequentially. The types of student learning come from the learning objectives of the course and are made explicit through the types of instructional strategies, student learning activities, and assessment techniques that you employ. You can usually arrive at the weighting of student learning by deciding what proportion of the final grade should be given to the assessment information collected by the various techniques.
Use Worksheet F to identify the learning components of your lesson, unit, or course. Identify also the techniques you will use for assessing your students on these components and the weighting you have decided to give each component.
For printing and copying, this table requires Acrobat Reader
Weighting the Student Assessment Information:
Worksheet 'F'

Reflecting on Student Assessment: Worksheet G
Course Name:
|
Issue for Reflection |
Comments and Observations |
Action to be Taken |
|
Did the plan cover enough of: Knowledge? Understanding? Skills? Attitudes? Processes? Growth? | ||
|
Did my student evaluation plan allow me to make efficient use of time? | ||
|
Did my evaluation plan make use of a variety of assessment techniques? | ||
|
Did the range of my techniques allow me to make interpretations and evaluate my students progress? | ||
|
Did I consider the appropriateness of my assessment techniques in conjunction with the instructional approaches used? | ||
|
Were the assessment techniques appropriate for the information I required? | ||
|
Did my assessment techniques allow my students to show their best performance? | ||
|
Were my techniques fair, and were they used fairly? | ||
|
Did the assessment techniques that I used involve my student in transferring their knowledge and skills into life experiences? | ||
|
Did I involve my students in self-appraisal? | ||
|
Did I communicate my evaluation plan to my students in advance? | ||
|
Did I regularly communicate evaluation information to my students and to their parent/guardians? | ||
|
Were my reporting procedures meaningful to my students and to their parent/guardians? |