Part I universal criteria of complex assessment of english proficiency

Methods of assessment of language proficiency

As it was already noted in the Preface of the linguistic complex, the group of compilers worked out the scale of complex assessment of knowledge, skills and abilities the learner has to master. In the scale all tasks are divided into two blocks.

The first block is theoretical, and it involves lexical and grammar material which is given in the form of 20 closed tests for each level.

The first block of examination is theoretical, the examinee passes the computer based test on his/her level answering 20 closed tests from 120 of Database. With the help of the Table 1 it is possible to determine the level of theoretical knowledge of the learner. If the learner gets 50% and more (i.e. 10 correct answers) the examenee is allowed to pass the practical part of the exam. Time limit - 20 minutes.

Assessment of theoretical knowledge on computer based test

Table 1

Grades	Score equivalent	% equivalent (marks)	Number of right answers
A	4.0	95-100	19-20 test assignments
A-	3.67	90	18 test assignments
B+	3.33	85	17 test assignments
B	3.0	80	16 test assignments
B-	2.67	75	15 test assignments
C+	2.33	70	14 test assignments
C	2.0	65	13 test assignments
C-	1.67	60	12 test assignments
D+	1.33	55	11 test assignments
D	1.0	50	10 test assignments
F	0	0-45	1-9 test assignments

The second block is the practical block which determines the level of practical language proficiency.

The exam on the second block consists of 30 exam cards, each card has tasks on 4 types of speech activity (TSA): listening, speaking, reading, and writing according to the learner’s level.

The practical part of examination lasts 40 minutes: listening – 7 minutes (time for preparation - 5 min.); speaking – 10 minutes (time for preparation -7 min.); reading – 9 minutes (time for preparation -5 min.); writing – 14 minutes (time for preparation -13 min.).

In the table № 2 (p.11) it is shown the content of the tasks on all TSA; time limit for preparation (30 minutes) and time for answering (10 minutes).

Thus, all test materials are divided into two groups: a) tasks which help to determine the depth of the knowledge of theoretical material; b) tasks which help to determine practical knowledge, skills and ability. Total mark can be represented in general as:

T = X · P

where X – an absolute mark of theoretical knowledge on one of the five levels. It is shown in grades (A, B, C, D, F) (table 1).

P – a relative characteristics of practical language proficiency which is shown in marks (from 0 to 100 %).

The authors of ‘Universal criteria of complex assessment of language proficiency’ paid great attention to the level of practical language proficiency, which is estimated at the examination. The answer is evaluated in percentage (marks) from 0 to 100%, Beginner (1^st level) - 0-20%; Pre-Intermediate (2^nd level) –21-40%; Intermediate (3^rd level) –41-60%; Upper-Intermediate (4^th level) –61-80%; Advanced (5^th level) – 81-100% .

On the result of oral exam the upper and lower thresholds are defined. The upper threshold is 19% - 20% for the 1^st level, 39% - 40% for the 2^nd level, 59% - 60% for the 3^rd level, 79% - 80% for the 4^th level. It allows the examenee to transfer to the next level. The lower threshold for the 2^nd level is 21% - 29%; 41% - 49% for the 3^rd level; 61% - 69% for the 4^th level, 81% - 89% for the 5^th level. It means the examinee has to retake the same level.

If the result of exam is from 10 - 18% (for the 1^st level); from 30 - 38% (for the 2^nd level); from 50 - 58% (for the 3^rd level); from 70 - 78% (for the 4^th level); from 90 - 98% (for the 5^th level) the examinee will stay at the same level of training.

For objective determination of learners level of language proficiency there were taken equal quantitative parameters of the proposed tasks. At all levels of the language course it is offered 2 tasks for listening, speaking and reading, for writing – one task. For determination of the learners competence on each TSA, all tasks of tests are fulfiled in exactly settled order. Tasks are not be missed or replaced.

To show the priority of one type of TSA above others, it was necessary to implement a differential key which was called ‘relevance index’ of TSA. According to the world research it was revealed that modern society spends 40% of time for listening, for speaking – 30%, for reading – 20% , for writing – 10%. It is obvious that the major TSA is listening, the ‘relevance index’ of it in our criteria made up 0.4. The second significant activity is speaking – 0.3. On the third place there is reading – 0.2, on the fourth – writing – 0.1. For simplification the procedure of calculation in ‘Universal criteria of a complex assessment of language proficiency’ there have already been presented calculated percentage taking into account the ‘relevance index’ of TSA.

Learners in KazGASA and KAU in the first semester of academic year are admitted to the 2^nd ‘Pre- Intermediate’ level on Kazakh and Russian course classes while in English class first-year students are admitted for the 1^st ‘Beginner’ level.

Note: a) in case of lanfuage insufficiency for the precisely level the students have to take independently additional courses (within 7 weeks) to achieve necessary ‘admission’ level till the first midterm rating control.

b) for the language proficient (advanced level) students the training is held individually in an advisory form during all time of study (the student takes the tasks from the teacher and passes them once in two weeks).

Entrance test to define learners language level on linguistic disciplines is held on the basis of materials and worked out methods and criteria.

For an academic period (semester) a student has to raise the level of practical language proficiency to at least one level (from the 1^st to the 2^nd, from the 2^nd to the 3^rd; from the 3^rd to the 4^th; from the 4^th to the 5^th).