Study · Standards · Tests and results
How learning is tested
Tests, examinations and results
How the University tests what a learner has learned, at the level a university does: a test for every course, an examination for every term course, and a result stated as a university states one. All of it is proposed, in the draft directive on standards and credits.
From a lesson to a result
Read across: the step, what it is, and what it counts for in a term course.
| Step | What it is | Counts for |
|---|---|---|
| Self-check | Three questions at the end of each lesson. A learner passes them before moving on. | Nothing. It is practice. |
| Test | Twenty questions for each course, drawn afresh from its bank each time, in six kinds. Marked at once. | 10 per cent |
| Written and spoken work | A reading of a primary source, a seminar or moot, and the final essay or brief. | 55 per cent |
| Term examination | Two hours, sat with an invigilator or held aloud: thirty questions, a source and short answers, and an essay. | 35 per cent |
Nine tenths of the mark is for work that a teacher marks by hand or sees done. Only the tests are marked by the page.
Six ways to answer
Every question is tied to a lesson’s reading or to the source it prints. A learner answers with buttons and lists that work from a keyboard and on a phone, and nothing has to be dragged. The questions run in the reader’s own browser: nothing is installed, and nothing is sent anywhere. Read across: the kind, what the learner does, what it tests, and how many the banks now hold.
| Kind | The learner | It tests | In the banks |
|---|---|---|---|
| Choose one | Picks one of four answers to a case. | Applying a rule to a new situation | 1153 |
| From the source | Picks the words of the printed source that answer the question. | Close reading of the source itself | 191 |
| Put in order | Moves steps or events up and down until they are in order. | Sequence and method | 102 |
| Match | Pairs each term or case with its meaning. | Terms, and what goes with what | 75 |
| Sort | Puts each case into its group. | Telling one kind of thing from another | 62 |
| Work it out | Works out a figure and types it in. | Calculation | 35 |
The banks hold 1,618 questions: 748 test recall, 554 application and 316 analysis. Try a full bank: the test for RES 302.
The term examination
Two hours and one hundred marks. Read across: the part, what it holds, its marks, and how it is set and marked.
| Part | What it holds | Marks | How it is set and marked |
|---|---|---|---|
| A | Thirty questions, one mark each | 30 | Drawn from the bank of all the term’s courses, six from each. Marked at once. |
| B | A source, and three short answers | 40 | Question 1, on a source printed in the paper, is compulsory. Then three of five short answers. Ten marks each. |
| C | One essay | 30 | One of three questions. Marked for its argument, its evidence, the objection it meets, and its writing. |
- An examination is sat in a room with an invigilator, or held aloud with the teacher. No software watches a learner, and no camera is required.
- A learner who cannot sit on the day for a ceremony, an observance, an illness or a bereavement is given another sitting.
- A learner who needs another way to sit the paper is given it, wherever the outcomes can still be shown.
- A sample paper and its marking guide are published. The paper sat is drawn afresh, and the Registrar of the University holds it until the sitting.
- The written parts are marked to the guide. One paper in five is marked again by a second marker.
- A mark may be reviewed: by the marker, then by a second marker through the Chair, then by the Dean.
A sample paper: MU 3100 Research Methods and Research Ethics, MU 3200 The Mohawk and the Confederacy before 1784.
The weights, before and now
Read across: the part, what it counted for, and what it counts for now. An essay no longer carries nearly half the mark, and an examination is added.
| Part | Before | Now, as proposed |
|---|---|---|
| Self-checks, every lesson | 15% | Counts for nothing: practice |
| Primary-source analysis | 25% | 15% |
| Seminar or moot participation | 15% | 10% |
| Final essay or brief | 45% | 30% |
| Tests, one for each course | None | 10% |
| Term examination | None | 35% |
Beside two universities
Read across: the point, what the university’s calendar says, and ours.
| Point | A university | Ours |
|---|---|---|
| The weight of any one piece | University of Toronto, Arts and Science: “No essay, test, examination etc. in the marking scheme may be assigned a weight of more than 80% of the course mark.” | No part counts for more than 35 per cent. |
| A final examination | Toronto: an examination in each first-year course, counting for “between one-third and two-thirds of the final mark”. In third and fourth year the department decides. | An examination in every term course, at 35 per cent. |
| Marked work early | Toronto: marked work worth at least 10 per cent of a one-term course is returned before the deadline to drop it. | A self-check in every lesson and a test in every course, marked at once, from the first week. |
| Changing the scheme | Toronto: once announced, it is not changed without the consent of a majority of the class. | A change to assessment does not reach a learner who has begun, unless the learner agrees. |
| How a mark is stated | University of Waterloo: “All faculties use numeric grades on a scale from 0 to 100.” Averages are reported as percentages. | A percentage, with a letter beside it. An average weighted by credit. No ranking. |
Results
- A result for a term course states the mark for each part, the percentage and the letter.
- The letter follows the proposed scale: A, 80 to 100; B, 70 to 79; C, 60 to 69; D, 50 to 59; F, below 50.
- The pass mark is 50 per cent. A programme or a pathway may ask for more, and says so: a partner university commonly asks for 60 before it gives credit.
- A transcript lists each course completed, its credits, its percentage and its letter, and the average weighted by credit. It does not rank learners.
- The Registrar of the University issues a transcript from the Register.
A specimen, with marks made up to show the form. Read across: the course, its units, the percentage and the letter. The average is weighted by units.
| Course | Title | Units | Per cent | Letter |
|---|---|---|---|---|
| MU 2100 | Loyalist Mohawk History and Law | 3 | 78 | B |
| MU 2600 | Method and Evidence | 3 | 84 | A |
| MU 3100 | Research Methods and Research Ethics | 3 | 71 | B |
| Average | Weighted by units | 9 | 77.7 | B |
Keeping the questions honest
Once a question has been answered thirty times, two things are looked at: how many got it right, and whether those who did well on the whole paper got it right more often than those who did not. A question that nearly everyone gets right, or nearly everyone gets wrong, or that the strongest learners miss, is rewritten or withdrawn. The counts are kept without names.
What has still to be done
The bank is full, at eight or more questions a lesson, for 11 of 59 courses: REC 101, RES 301, RES 302, RES 303, RES 304, RES 305, HIS 302, HIS 303, HIS 304, HIS 305, HIS 306.
- The banks of the 49 first-year courses, enlarged to at least eight questions a lesson, term course by term course.
- A term examination, with its sample paper and guide, for each of the nine first-year term courses.
- Invigilators and markers named, and a second marker for each faculty.
- Marks, results and the transcript kept in the Register by the Registrar of the University.
- The directive adopted by the Gazette.