Of complex assessment of english proficiency
METHODS OF ASSESSMENT OF LANGUAGE PROFICIENCY OF LEARNERS
As it was already noted in the Preface of the linguistic complex, the group of compilers worked out the scale of complex assessment of knowledge, skills and abilities the learner has to master. In the scale all tasks are divided into two blocks.
The first block is theoretical, and it involves lexical and grammar material which is given in the form of 20 closed tests for each level.
The first block of examination is theoretical, the examinee passes LGT according to the level of training answered 20 closed tests from 120 of Database. With the help of the table 1 it is possible to determine the level of theoretical knowledge of the learner. If the learner gets 50% and more (i.e. 10 correct answers) the examinee is allowed to pass the practical part of the exam.Time limit - 20 minutes.
Table 1
ASSESSMENT OF LEARNERS THEORETICAL KNOWLEDGE
ON LEXICAL GRAMMAR TEST
| Grades | Score equivalent | % equivalent (marks) | Number of right answers |
| A | 4.0 | 95-100 | 19-20 test assignments |
| A- | 3.67 | 18 test assignments | |
| B+ | 3.33 | 17 test assignments | |
| B | 3.0 | 16 test assignments | |
| B- | 2.67 | 15 test assignments | |
| C+ | 2.33 | 14 test assignments | |
| C | 2.0 | 13 test assignments | |
| C- | 1.67 | 12 test assignments | |
| D+ | 1.33 | 11 test assignments | |
| D | 1.0 | 10 test assignments | |
| F | 0-45 | 1-9 test assignments |
The second blockis the practical block which determines the level of practical language proficiency.
The exam on the second block consists of 30 exam cards, each card has tasks on 4 types of speech activity (TSA): listening, speaking, reading, and writing according to the learner’s level.
The practical part of examination lasts 40 minutes: listening – 7 minutes (time for preparation - 5 min.); speaking – 10 minutes (time for preparation -7 min.); reading – 9 minutes (time for preparation -5 min.); writing – 14 minutes (time for preparation -13 min.).
In the table №2 (p.11) it is shown the content of the tasks on all TSA; time limit for preparation (30 minutes) and time for answer (10 minutes).
Thus, all combined exam materials are divided into two blocks: a) tasks which help to determine the depth of the knowledge of theoretical material; b) tasks which help to determine practical knowledge, skills and ability. Total mark T can be represented in general as:
T = X · P
where X – an absolute mark of theoretical knowledge on one of the five levels. It is shown in grades (A, B, C, D, F) (table 1).
P – a relative characteristics of practical language proficiency which is shown in marks (from 0 to 100 %).
The authors of ‘Universal criteria of complex assessment of language proficiency’ paid great attention to the level of practical language proficiency, which is estimated at the examination. The answer is evaluated in percentage (marks) from 0 to 100%, Beginner (1st level) - 0-20%; Pre-Intermediate (2nd level) –21-40%; Intermediate (3rd level) –41-60%; Upper-Intermediate (4th level) –61-80%; Advanced(5th level) – 81-100%.
On the result of oral exam, the upper and lower thresholds are defined. The upper threshold is 19% - 20% for the 1st level, 39% - 40% for the 2nd level, 59% - 60% for the 3rd level, 79% - 80% for the 4th level. It allows the learner to transfer to the next level. The lower threshold for the 2nd level is 21% - 29%; 41% - 49% for the 3rd level; 61% - 69% for the 4th level, 81% - 89% for the 5th level. It means the learner has to retake the same level.
If the result of exam is from 10 - 18% (for the 1st level); from 30 - 38% (for the 2nd level); from 50 - 58% (for the 3rd level); from 70 - 78% (for the 4th level); from 90 - 98% (for the 5th level) the learner will stay at the same level of training.
At all levels of the language course it is offered 2 tasks for listening, speaking and for reading 3 tasks, for writing – one task. All types of tasks should be fulfilled in exactly settled order. Tasks are not be missed or replaced.
To show the priority of one type of TSA above others, it was necessary to implement a differential key which was called ‘relevance index’ of TSA. According to the world research it was revealed that modern society spends 40% of time for listening, for speaking – 30%, for reading – 20%, for writing – 10%. It is obvious that the major TSA is listening, the ‘relevance index’ of it in our criteria made up 0.4. The second significant activity is speaking – 0.3. On the third place there is reading – 0.2, on the fourth – writing – 0.1. For simplification the procedure of calculation in ‘Universal criteria of a complex assessment of language proficiency’ there have already been presented calculated percentage taking into account the ‘relevance index’ of TSA.
Learners in KazGASA and KAU in the first semester of academic year are admitted to the 2nd ‘Pre- Intermediate’ level on Kazakh and Russian course classes while in English class first-year students are admitted for the 1st ‘Beginner’ level.
Note: a) in case of language insufficiency for the precisely level the learners have to take independently additional courses (within 7 weeks) to achieve necessary ‘admission’ level till the first midterm rating control.
b) for the language proficient (advanced level) learners the training is held individually in an advisory form during all time of study (the learner takes the tasks from the teacher and passes them once in two weeks).
Entrance test to define learners language level on linguistic disciplines is held on the basis of materials and worked out methods and criteria. For an academic period (semester) a learner has to raise the level of practical language proficiency to at least one level (from the 1st to the 2nd, from the 2nd to the 3rd; from the 3rd to the 4th; from the 4th to the 5th).
The sample of language proficiency assessment on the 3rd level ‘Intermediate’
For example, the examinee chose the 3rd level and answered 19 tasks out of 20 on theoretical block of correctly. He got A which corresponds to the assessment of his theoretical knowledge (table 1).
The examinee passes also 3rd (Intermediate) level on practical block (table 2).
It took him 7 minutes for listening. According to the 1st task the examinee listened to the text ‘Frederick’s restaurant’, filled up the table having answered 4 tasks correctly and got 12% from maximum 12% because he answered all tasks correctly. According to the 2nd task the examinee retold the main idea of the text in compliance with logical sequence, that is why he got 12% from maximum 12%. Total: 24%
For listening practice the examinee got 24% from maximum 24%.
It took him 10 minutes for speaking. According to the 1st task the examinee took part in discussion on ‘Money matters’, was able to prove his point of view and got 8% from maximum 8%. According to the 2nd task the examinee made a connected monologue about Kazakh national sport (6 sentences from 7) and got 10% from maximum 10% Total:18%
For speaking practice the examinee got 18% from maximum 18%.
It took him 9 minutes for reading.The examinee read cursorily the text ‘Kazakh cuisine’ fluently with observance of all orthoepical rules, with correct intonation, verbal stress and got 3% from maximum 3%. According to the 1st task the learner made a plan to the text and got 3% from maximum 3%. According to the 2nd task the learner translated the 2nd paragraph of the text and got 6% from maximum 6%. Total: 12%
For reading practice the examinee got 12% from maximum 12%.
It took him 14 minutes for writing.According to the writing task the examinee wrote an essay on the given topic, consisting of 60 words and got 5% from maximum 6% because there wasn’t any original presentation of the theme in his essay. Total: 5%
For writing practice the examinee got 5% from maximum 6%.
Thus, for the fulfilment of practical block the examinee got 59%.
Table 2