PHliONG P H A P D A N H GIA CHAT LUONG NfiANJlANG CAu HOITHI^ METHODS TO EVALUATE THE QUALITY OF THE TEST QUESTIONS BANK H OJ ThS Nguyen Tien HUng, ThS Pham DilTc CUdng Bgi hgc Suphgm Ky thudt Nam Din[.]
PHliONG P H A P D A N H GIA CHAT LUONG NfiANJlANG CAu HOITHI^ METHODS TO EVALUATE THE QUALITY OF THE TEST QUESTIONS BANK ThS Nguyen Tien HUng, ThS Pham DilTc CUdng H-OJ Bgi hgc Suphgm Ky thudt Nam Dinh Tom tat Ap dung ly thuyet lUdng de d i n h g i i chit Idpng ngan hang c i u hdi thi trie nghiem ddng mdt vai trd quan trong viec nang cao chat lupng dao tao cua nha trudng Hien tai ed hai phuang p h i p ca b i n de d i n h gia chat lUpng ngin hang c i u hdi thi dd la phdang p h i p chuyen gia va phuang phap dinh luang Bai bao sddung phuang phap danh gia dinh tinh va djnh luang de p h i n tich va d i n h g i i chat lUpng ngin hang c i u hdi th trie nghiemi, Thdng qua dd, cac Nha giao cd nhihig bien p h i p tich cgc de dieu chinh ngan bang cau hdi thi mdt each hop ly TCrkhda: Ngdn hdng cdu hdi, danh gid, lUdng phuang phdp chuyin gia, phuong phdp dinh lugng Abstract Applying measurement theory to assess the quality of Test question bank plays an important role in improving the academic quality of the schools Currently there are two baste methods to assess the quality of Test question bank that is expert methods and quantitative methods This paper uses qualitative methods and quantitative methods to analyze and evaluate the quality of the Test questions Through it,Teachers will have positive methods to adjust the exam questions bank for reasonable Keywords: Questions bank, Evaluation, Measuremnet, expert methods, quantitative methods I.Oatvande cho cic nhdm giao vien phu trach hoc phSn, De nang cao dUpc chat lupng dao tao, viee mon hpc thgc hien Can bp giang day (CBGD) danh gia de thi ed vai trd het sdc quan trpng, "^y dgng bd de hau het deu theo kinh nghiem nham mye dich d i n h g i i chinh xic ket qua hpe chu quan cCia minh, chUa dupe trang bj day du t i p ciia sinh vien Dieu chSng nhdng la khiu ve kien thdc va ky ning thiet ke de thi, cic de thi phan hdi chat Idpng cua ngan hang eau hdi CBGD bien soan dupc dUa vao sQ dyng trge thi (NHCH) hay de thi trie nghiem (DTTN) chat t'ep, khdng qua qua trinh thd nghiem va danh Idpng boat dpng ciia ea q u i trinh giing day ma gia dan den cac de thi kem chat lupng Chfnh cdn la yeu td quan cd chdc nang tdang t i c vi vay, d b i i vi^t niy chung tdi dua phuang ngupe trd lai de dieu ehinh, cii thien cac khau p h i p dinh g i i ; ehuyen gia va dmh luang de trude dd nham giup eho q u i trinh dao tao dam danh gia chat lUang de thi vdi muc dfch nang bao chat lupng v i hieu q u i tdt Thgc te hien nay, cao chat lUpng va hieu qua ciia edng t i c danh vifc xay dgng cic bd ngin hang de thi dupc giao g i i tien hinh xay dgng NHCH, So 30 thing 3/2016 KHOA HOC D A Y NGHE [19] PhUtfng phap danh gia ngan hang cau hdi thi 2.1 Phuang phap chuyen gia Khi danh gia d mdc B (khdng phu hpp) ehuyen gia can ghi rd ly de can bd bien soan ed the can cd v i o de xem xet, chinh sQa Day la phuang phap danh gia djnh tinh, de danh g i i bd n g i n hang cau hdi thi can danh g i i theo eac tieu ehi sau d i y : 2) Do khd cua cdc cau cung mgt goi cau hdi -SgphCi hap gida cau hdi va mdc danh h i n g eau hdi thi la cac cau hdi cimg mdt gia; Mdt cae yeu cau bien soan n g i n nhdm {eung mQe diem, cung mdc dp d i n h - Su tuang duang ve khdi luang kien thdc gida cac cau mdt gdi cau hdi; - Su tuang duang ve dd khd eua eae eau gii) p h i i cd dp khd tQOng dQOng [2] de to hpp ngau nhien de thi, eac de thi ed dd khd tuang duang Chuyen gia hdi cung mgt gdi cau hdi; d i n h g i i can xem xet ky c i u hdi, d i p i n de - Dap an eua cau hdi thi; nhan xet ve dp khd eua cie cau hdi theo cic - Mdc dp rd ^ n g , dk hieu d mdi ciu hdi thi I) SUphu hap giUa ndi dung cau hoi va mCfc ddnh gid De bien soan ngan hang cau hdi thi, viec dau tien can phai xay ddng bing thdng ke kien thdc, ky nang can d i n h g i i va mdc dd danh gia [1] Khi viet cau hdi thi, ngudi bien soan da bam sit cae mdc dd danh gia da thdng nh^t eho tdng eau hdu Tuy nhien, vi nhieu ly khac nhau, ddi cau hdi lai khdng phu hpp vdi mdc dp d i n h g i i d i dg kien, cd lai qua khd hoac qua de Chuyen gia ein so sinh ndi dung cau hdi v i mdc danh gia de cho y kien d hai mdc: A la hdp ly v i B ia chua hpp ly Ket q u i d i n h gia npi dung dimg phieu sau: Phieu danh gia sd phii hcfp giuTa npi dung cau hdi thi va mdc danh gia mdc: A la hpp ly v i B la ehua hpp ly Nhdng eau hdi danh g i i mdc B p h i i chinh sda lai de cd dp khd, dd d i i tuang duang Neu danh g i i tdt tieu ehi ciing chi dUOc eie cau q u i khd hoac qua de, gid lai nhdng ciu hdi vda sQc vdi ddi tQpng danh gia Phieu danh gia Oo kho cda cac cau hoi thi Ten hpe phan: Hpvaten ngddi d i n h gia: Mircd6 Y kien/ Ly danh gia Goi cdu hoi so (2.0 diem) caul Cau hoi Goi cdu hoi so (4,0 diem) Cau Ten hpc phan: 3) MUc dd tuang duang ve khoi lugng kien Hp va ten ngUdi danh gia: M^d9 Cau hoi phii hop Cdu hoi muc Nhd Caul A thUc giUa cdc cdu mdt gdi cdu hdi y kien/ Ly Tdang tg nhu dd khd, khdi luang kien thdc gida cie eau mdt gdi cau hdi cung phai tdOng ddang Khdi lupng kien thdc d i n h g i i d hai mdc: A la hap ly va B la ehUa hap ly Cdu hoi muc Hieu Cau NhQng eau hdi d i n h g i i mdc B va phii chinh sda lai de eac eau hdi ed khdi iQpng kien thdc tuang duang [20] KHOA HOC D A Y NGHE Sd 30 thing 3/2016 - Phieu danh gia Khoi lUtfng kien thufc cua cac cau h6i thi Ten hpc phan: eau chd p h i i rd rang; thdng nhat cic ky hieu, thuat ngd theo quy dinh hien hanh"[2] Vdi c i u hdi trac nghiem edn quy dinh rd: - Sddung ngdn ngdphuhppvdiSV, khdng Hpva tdn ngudi danh g i i : hdi y kien rieng eua SV; ehi hdi sg kien, kien Mircd$ danh gia Cau hoi Y kien/ Ly hdi thddng cd hai phan, phan dau dupe gpi l i B Caul thQe - Cau hdi trac nghiem nhieu Iga chpn: cau Goi cdu hoi so (2,0 dtim) phan dan, neu van de, cung cap thdng tin can thiet hoac neu mdt c i u hdi; phan sau la Gdi cdu hoi so (4,0 diem) Cau2 cic phuang an de chon t r i ldi, thddng dimg phdang an dupc danh dau bang eie chd cii A, 4) Banh gid dap dn cua cau hdi thi D i p an la mdt bd p h i n quan trpng cda NHCHT, nd quyet djnh chat luong eiia bd n g i n hing cau hdi thi D i p i n phai n g i n gon, ehinh xic tao thuan lai q u i trinh cham diem; thang diem p h i i phii hop va phai ehia nhd den mdc hpp 1^ Chfnh vi vay, viee d i n h g i i sU ehinh xic, hpp ly eiia d i p i n la rat can thiet, Cic mdc dd d i n h g i i d i p i n : A la hap ly v i B la ehUa hop ly B, C, D Khi bien soan cic phuong i n chon ehi ed nhat mdt phuang i n dung, cae phuang an sai phii ed ve hpp ly, phai sap xep phuong an dung mdt eich n g i u nhien; d i m bao eho cau dan ndi lien vdi mpi phuang i n chpn theo dimg ngdphap;tranh dimg eau phii djnh, dac biet la phii dinh lan; tranh viee tao phUang i n dung khac biet so vdi eac phuang an khie (dil ban hoac ngan hon, md t i ty my han ) Ddi vdi eau hdi t d luan, van d i p eung quy djnh: "Cau hdi can rd r i n g va xac dinh, lam Phieu danh gia Dap an cua cac cau hoi thi cho SV hieu rd can phai lam c i i gi, Neu can cu Ten hpc phan: the ban, cd the phac hpa eau true ehung ciia Ho vaten ngUdi danh gia: b i i tra ldi" Nhu vay, cich dien dat eau hdi rat quan trpng, de sinh vien hieu dung va day dii Mircdg danh g\k Cau hoi V kien/ Ly ndi dung eau hdi tieu chf danh g i i d hai mdc do: A la hpp ly va B la ehda hpp ly Goi cdu hoi so (2,0 diem) Cau Phieu danh gia Cach dien dat cua cac cau hoi thi A G6i cdu hoi so (4,0 diem) Ten hpc phan: Cau Hpvaten ngudi danh g i i : Nhdng c i u hdi danh gia mdc B, cdt Ly can ghi rd nhdng sai sdt can ehinh sda 5) MUc dd rd rang, di hiiu (each dien dot) cua Cau hoi Yki^n/Lydo Goi cdu hoi so I (2,0 diem) Cau 1-01-Cl cau hoi M^do danh gia A Trong quy dmh bien soan ngan hang eau hdi thi d i cd yeu eau ve viet eau hdi thi: " D i m b i o tfnh khoa hpe, chfnh xae, c h i t ehe, ldi v i n Goi cdu hoi so (4,0 diem) - So30thang3/2016KHOAHOC D A Y N G H E [21] Nhdng eau hdi danh gia mdc B, cdt ly can ghi rd nhdng sai sdt can chinh sda Sau tung ehuyen gia danh gia theo tdng tieu chf can lap bing thong ke tong hpp mdc dp dinh g i i , nhdng cau hdi ed tieu ehi dinh g i i mdc A dudi ngUdng can phii ehinh sda Bang tong hdp danh gia ngan hang cau hdi thi Ten NHCHT: Hp ten eac can bd danh gia: TT Ma cau hoi Cau ^ IS ddnh gii 6'mircAtbeotimgtieuclii(%) TCI 66,6 TC2 TC3 66,6 100 TC4 TC5 Cau hdi cd nhdng tieu chi cd ty le td 60% trd len sd y kien danh gia d mQc A la dat chat luong, cic tidu chf cd ty t>' le d i n h gia mdc A dudi 60% can xem xet, chinh sda [1], 2.2 Phitang phdp dinh fitang Cie eau hdi thi, sau dem sQ dung can phai tien hanh p h i n tich de xem cic eau hdi thl d i bien soan cd phu hpp vdi myc dich kiem tra, d i n h g i i khdng.Tren easddd loai trd nhdng eau hdi khdng pbij hpp hoac chinh sda de n i n g cao chat lUang eau hdi thi Viee p h i n tfch tdng cau hdi thi va toan bd de thi phu thudc v i o mue dfch ciia ky thi, dd cac die trung thdng ke phai p h i n i n h duac muc dfch Khi p h i n tfch eau hdi thi, hai ehi sd co ban ein phan tich l i khd v i dp p h i n biet Odi vdi c i u hdi trac nght&m nhieu lua ehpn c^n ed chf sd nda can p h i n tfch, dd la mdc ddi Idi eudn v i o cae phdang i n tra Idi [2] Phan duac k h i o s i t phan tfch t d 295 phieu dieu tra, SQ dyng trj sd thdng ke P [3] de dd khd cho ta biet mQc khd, de cda ciu trie nghiem ma khdng can biet ndi dung eiia nd thudc ITnh vdc nio Gii tri ehi sd Pi thay ddi pham vi t d O - 1, g i i trj Pi eang nhd thi ciu trac nghiem eang khd va ngdOc lai, gia tri Pi cang Idn thi cau trie nghiem cang de Vi du cd he sd Pi ciia hai c i u hdi trie nghiem nhu sau: P/Alra liri A B C« S6 luanfi Gia tn P 12 IS 248 17 0,84 0,05 0,04 0,06 D Ghi chO: * ky hieu phuang dn tra ksi dOng Qua vf du tren eho thay: cd den 248/295 SV t r i Idi diing, he sd P = 0,84, nhd vay cau hdi thudc loai de P/AtralM A* B So luong Gia t r i p 61 0,21 68 0,23 BdD Tang sot 66 10 295 0,84 0,30 0,22 C 90 Ghi chii- *kyhiiu phuang an tra idi dUng Ciu hdi ed P = 0,21, chi cd 61/295 SVtri Idi dung, nhu vay c i u thudc cau khd Khi Iga chpn cac c i u trac nghiem theo dp khd, thudng phai loai cac cau q u i khd hoac q u i d§ Mdt bai trac nghiem tdt la bai cd nhQng cau cd dp khd trung binh (Pie) Dd khd trung binh eiia eau trac nghidm dUpc djnh nghTa l i trung binh cdng giQa xac suat lam dung h o i n t o i n c i u hdi ay vdi xic suat may rill t g nhien Mdi loai cau trac nghiem cd mgt x i c suit may rui t g nhien khie vi v i y khd trung binh cung khic Cdng thdc tfnh dp khd trung binh eOa cau hdi i nhu sau: Pie^{1+n)/2.[3]Trongdd: Pie la khd trung binh eiia eau thd i I) Do khd cdo cdu trac nghiem n la xae suat may rui tg nhien Gpi Pi l i dp khd eua cau trie nghiem t h d I, -Vdi eau hdi dung sai: tacd:Pi=Si/N[3].Trongdd: Si: sd sinh vien lam dung eau hdi thd I N: tdng sd sinh vien tham gia lam c i u hdi B6 T6ng sot 295 n= 0,5 nen Pie= {1 -i-0,5)/2 = 0,75 -Vdi eau hdi cd Ida chpn: n= 0,25 nen Pie- 0,625 [22] KHOA HOC D A Y NGHE S6 30 thing 3/2016 - - Vdi eau hdi ed Iga chpn: r)=0,2nen Pie=0,6 nang lUc khic eiia sinh vien: gidi, trung binh, kem De ed ca sd xac dinh mdt cau trie nghiem de, hay khd, hay vda sdc eua sinh vien, dau tien ta xic dinh khd Pi eua cau hdi ay rdi dem so sinh vdi khd trung binh Pie ciia nd Dd khd thgc te tiem ein vdi dd khd trung binh thi duac chap n h i n Tuy nhien Pi nam khoing nao la hpp ly?Theo GS.TS, L i m Quang Thiep [3] vdi cau hdi cd Iga ehpn Pi eiia cau hdi ed the chap nhan dUpc nam khoing td 0,25 den 0,75; ciu cd Pi Idn ban 0,75 la qua de, ed Pi nhd han 0,25 la ciu q u i khd Theo Osterlind [7], g i i tri Pi nen n i m khoing t d 0,40 den 0,80 Dudi 0,4 nghia l i eau hdi qua khd va tren 0,80 la q u i de ddi vdi nhdm thi sinh.Theo chung tdi, viec lay gia trj P khoang gia tri nao phu thudc v i o hudng sQ dung ket qua danh gia Neu d i n h g i i theo chuan (so sanh thi sinh n i y vdi thi sinh khie) thi de thi can cd nhOmg c i u hdi khd de phan loai thi sinh thi c i u hdi thi can cd Pi cd gia tri nhd TrUdng hop n i y cd the ehpn Pi khoing td 0,25 den 0,75 Khi d i n h gia theo tieu ehi, danh gia ddpc sd dung de xic dinh mdc dp thgc hien eiia mdt c i nhan nao dd so vdi eac tieu ehi xac dfnh cho trUdc khdng c i n cau hdi qua khd, trUdng hpp n i y dd khd Pi can lay khoang 0,40 den 0,80 la phu hap {Pi chenh lech so vdi Pie xung quanh g i i tri ± 0,2) Nhu vay vdi n g i n hang eau hdi thi ket thue hpc p h i n Pi lay khoang 0,40 den 0,80 Mdt van de d i t la sd m i u phan tfch tdi thieu bao nhieu la d i m b i o dd tin cay Theo eie ehuyen gia ludng danh gia, sd ngudi tham gia tra Idi c i u hdi trac nghiem cang Idn thi ket q u i eing chfnh xic, nhien sd ngudi tra Idi phai tdi thieu l i 50 mdi d i m bao dp tin cay [4] [5] 2) Bd phdn biet cOa cau trdc nghiem Dp phan biet {dp phan cich) la kha nang cau trac nghiem thgc hien dupc su phan biet Cie budc xic dmh dp phan biet ciia cau trac nghiem: sau cham toan bd bai trac nghiem cua sd mau tham gia, tien h i n h tfnh dp p h i n biet eiia c i u trac nghiem, v i l i m theo cic bude sau: Budc T Sip xep eac bai kiem tra theo thd t g t d d i e m eao den diem thap hoac ngupc lai, Budc 2: Liy 27% tdng sd bai lam tinh t d diem cao nhat xep xudng va xep vao nhom cao, ddng thdi lay 27% sd bai lam tfnh td diem thap nhat xep len va xep vao nhom thdp LUu y rang theo Kelly (1939) [6] eho rang eon sd 27% cd the cho mdt chi sd dn dinh ve su khac gida hai nhdm ed nang Idc cao va thap Budc 3: Tinh tdng sd bai la dung eau hdi i nhdm cao v i goi l i Ci, ddng thdi tinh tdng sd b i i l i dung eau hdi i nhdm thap va gpi l i Ti Budc 4: Xic djnh dd p h i n eich D eiia cau hdi i theo bieu thdc sau: Di = (Ci - Ti)/n [6] Trong dd: Ci l i sd sinh vien nhdm eao lam dung cau i Ti l i sd sinh vien nhdm thap la dung eau I N la tdng sd sinh vien nhdm cao {hoac nhdm thap) Theo cdng thdc xic djnh dp phan biet nhQ tren thi Di thudc doan [-1; 1] Tuy nhien, dd p h i n biet cd g i i trj i m , nghTa l i sd ngddi d nhdm thap lam dung cau i nhieu hdn sd ngddi d nhdm cao, dd dp phan biet khdng cd y nghTa Cac nha nghien cdu [3] [6],[7] ve ludng va kiem djnh giao due da dda tieu chf d i n h g i i dd p h i n biet nhd sau: Di < 0,2: eau trie nghiem i ed dd phan biet kem 0,2 < Dl < 0,29: eau trac nghiem i ed dp p h i n biet trung binh - Sd 30 thing 3/2016 KHOA HOC D A Y NGHE [23] 0,3^ Dl £ 0,39; cau trac ngiem i cd dd phan biet kha tdt 0,4 < Di: e i u trie nghiem i ed dd phan bi§t tdt Yeu cau ve chi sd dp p h i n biet bao nhieu l i hpp ly?Thdng thddng, bai trac nghiem theo chuan cd dp phan biet td 0,3 trd len la tdt Cic b i i trie nghiem danh gia hpc phan (theo tieu ehi) thl nhQng e i u hdi ed tinh chat phan loai SV mdi can Di > 0,3, cic cau hdi cdn lai chi can ed dd phan biet Di > 0,2 NhQng eau hdi cd dd phin biet la i m thi can p h i i xem xet chinh sda hoac loai bd 3) MUc ldi cuon vdo cdc phUdng dn tra ldi Ddi vdi c i u trie nghiem khieh quan loai eau nhieu Ida chpn, ngoai hai chi sd ve dp khd va dp phan biet, cdn cd mdt chi sd nda can quan t i m phan tfch, dd la mQe dp ldi eudn vao cac phdang an tra ldi Neu mdt phuang an nhieu [2] eiia eiu nhieu Iga chon lai khdng ed SV t r i ldi hoac cd rat it SV Iga chpn thi chdng td eae phuang an dd la sai hien nhien, khdng cd sdehapdangi.Vfdu: P/Attiloi So luong Gia trip Bo U i sot r°"8 75 13 204 295 0,00 0,25 0,04 0,69 A B C D» Ghl chO: * ky hieu phuang an tra ldi dung Vi dy tren cho thay, phuang i n A khdng ed SV nao chpn, nhU v i y phdang an A sai q u i Id lieu Tuong t u nhu vay phuang i n C ed P 0,04 chi danh Ida ddpc mdt sd it SV, can p h i i ehinh sda lai phdpng an A va D Trong trddng hpp mot phuong an nhieu cd q u i nhieu sinh vien Iga ehpn, tham chf han nhieu so vdi phuong an dung dieu ehdng td cd sU hieu lam nao gida phdang i n dung v i phdang i n nhilu Vfdu: P/Aticaloi A* Soluong Gia trip 123 128 23 21 0,41 0,43 0,07 0,07 B C D Bo T6ng sot: 295 Ghi chU: * ky hiiu phuang an tra ldi dUng Nhu vay, mac dii dap an dung ciJa c i u hdi tren cd dp khd Pi d ngudng chap nhin ddpc l i 0,41 nhung phuang i n nhieu B lai cd nhieu SV Iga chpn han phuang i n dung 0.4, v i y can p h i i chinh sda lai c i u hdi Nhdng phdang i n nhieu cd ehi sd P khoang 0,07 den 0,2 la hpp ly Qua p h i n tfch tren eho thay ddi vdi c i u hdi trac nghiem nhieu lUa ehpn can p h i i phin tich tf ml tdng phuflng i n t r i Idi dga tren he sd P de ed the chinh sda cho c i u hdi ngiy eing hoan thien Ket luan TQ nhdng phan tich vdi sd lieu cu the tren cd the ket luan viec i p dyng ly eie phdang p h i p chuyen gia v i dinh iQpng de phan tich danh g i i chat lupng NHCH va DTTN l i tUang ddi chinh x i c va hieu q u i Cac phdang p h i p tren khdng nhdng l i cdng eu giiip cho giang vien x i y dgng eac NHDT va DTTN cd chat Idpng m i edn giup giing vien danh du doan duac diem manh, diem yeu ciia sinh vien, t d dd cd nhdng bien phap kjp thdi de giup dd sinh vien q u i trinh hoe t i p D Tai lieu tham khao 1, Pham Xuan Thanh, (2013), Bdi giang mdn Ly thuyit ludng Vien D i m b i o chat lupng giao due, Dai hoc Qudc gia Ha Ndi 2, Pham Xuin Thanh, (2012), Bai giang mdn Md hinh Rasch va Phan tich dU lieu bdng phdn mem QL/£S7, Vien D i m b i o chat IdOng giio due, Dai hoe Qude gia Ha Ndi 3, Lam Quang Thiep, {2012), Do lUdng va ddnh gia hogt ddng hoc tap nha trUdng Nxb Dai hoe Su pham 4, Hoing Trpng, Chu Nguyen Mdng Ngpe {2008), Phdn tich dO lieu vdi SPSS - Vol.H, Nxb Hdng DUc 5, Bruce Lav/rence, LUNE How/ard (2013), Qualitative research methods for the social sciences Paperback 6,Kelley,TrumanL.,/ntemaf/ona/fncyc/oped/a of the Social Sciences ^ 968 Encyclopedia.com Osterlind, S J., {1989) Constructing test items Boston: Kluwer Academic Publisher [24] KHOA HOC D A Y NGHE Sd 30 thing 3/2016 - ... h g i i theo chuan (so sanh thi sinh n i y vdi thi sinh khie) thi de thi can cd nhOmg c i u hdi khd de phan loai thi sinh thi c i u hdi thi can cd Pi cd gia tri nhd TrUdng hop n i y cd the ehpn... eau hdi thi Viee p h i n tfch tdng cau hdi thi va toan bd de thi phu thudc v i o mue dfch ciia ky thi, dd cac die trung thdng ke phai p h i n i n h duac muc dfch Khi p h i n tfch eau hdi thi, hai... research methods for the social sciences Paperback 6,Kelley,TrumanL.,/ntemaf/ona/fncyc/oped/a of the Social Sciences ^ 968 Encyclopedia.com Osterlind, S J., {1989) Constructing test items Boston: