JOURNAL OF SCIENCE OF HNUE Educational Sci , 2009, Vol 54, No 8, pp 153 159 N G H I E N CLfU X A Y D U N G T H A N G DO D A N H GIA BAI TAP N G H I E N CLfU KHOA HOC C U A SINH VIEN C H U Y E N N G A[.]
JOURNAL OF SCIENCE OF HNUE Educational Sci., 2009, Vol 54, No 8, pp 153-159 N G H I E N CLfU X A Y D U N G T H A N G D O D A N H GIA B A I T A P N G H I E N CLfU K H O A H O C C U A S I N H V I E N C H U Y E N N G A N H Q U A N LI GIAO D U G Nguyen Vu Bich Hien Trudng Dai hoc Su pham Hd Ndi Md dau Trong giao due, ddnh gid Id bO phan hpp r i t quan trpng, mOt khdu khdng t h i tdch rdi eua qud trinh gido due - dao tao Niu cei qud trinh giao due Id mpt he thdng, thi danh gid la phin hdi cua he thdng, cd vai trd tfch cQc viec diiu ehinh he thdng, la ed sd cho viec ddi mdi giao due Ddnh gid ngudi hpc lai la trpng tdm eua mpi boat dOng ddnh gid nhd trUdng, bdi vi kit qui cudi ciing cua qud trinh dae tad t h i hien d kit q u i hpc tap eua ngudi hpc Sinh vien hpc he vQa hpc vQa ldm, ehuyen ngdnh Quin If Gide due (QLGD) trudc thi tdt nghiep cin thuc hign mOt bdi tap nghign cQu khea hpc Bdi tap nghign cQu khoa hpc cd gid tri tUPng tU nhu ludn vdn tdt nghigp eua sinh vign chinh qui, giup ren luyen va ddnh gid ndng IQC nghign cQu khea hpc (NCKH) cua ngudi hpc trinh dO cQ nhdn TQ trQdc tdi nay, viec ddnh gia bai tap NCKH dirpc tiin hanh bdi hai gide vign chim dOe lap Tigu chi ddnh gid eo t h i khdng hodn todn cu thi vd trung Do vdy, kit qua ddnh gid giQa hai ngQdi chim cd thi co su chgnh lech va cd nhung trudng hpp ehgnh lech khd cao, khd phan biet dupc trinh dO ngirdi hpc Bin thdn ngudi hpc cung ehi biit diim cudi cung, khdng dupe thdng bad eu thg minh da dupe danh gid sac, khdng biit minh da ldm tdt mat ndd, chua tdt mat ndo va mudn lam tdt hdn nQa thi phai nhQ thi ndd TrQdc thQc trang dd, viec ddnh gia kit q u i hpc tap cua ngQdi hpc thdng qua bai tap NCKH cdn phai dQpc cai tiin bang edch thiit ki mOt thang gdm nhQng tieu chi danh gia thdng n h i t vdi ede mQc dO iQdng eu thi TQ ehung ta co the dat ngudi hpc vao nhQng ndc thang phdt triin, giup ngUdi hpc biit dupe minh dang d dau, se tiin len bdng each ndo Ddng thdi thang ndy eung se gop phin lam tdng tinh khdch quan cua kit q u i danh gid 153 Nguyen Vu Bich Hien 2.1 Noi d u n g n g h i e n ciJu Danh gia di:fa tren tieu chi Noi din danh gid dua tren tigu chf thdng thQdng ehung ta hay nhdc tdi mOt he thdng cac tieu chuan vd tieu chi, nghia la, nhQng dae trQng migu t i mQe dO ve chit iQdng cua mOt sin phim gido due lam cd sd che nhung nhan dinh cd tfnh gid tri Griffin va mOt sd nhd nghien cQu khae [4] eho ring: Tieu chudn md td diem (ngUdng) md chiing ta quyit dinh thiic the thay ddi tit trang thdi ndy sang trang thdi khde hay di chuyen tii m'dc ndy sang mite khde Tieu chudn Id ngudng ciid de dinh nghia ranh gidi giUa cdc miic Tham chieu nhiing ngudng hay tieu chudn, tieu chi ndy se cho thdy mpt sU thay ddi cua thuc trang [4] KhOng gidng ddnh gid theo chudn, nghia la ddnh gia ea nhdn dQa trgn mQc dat dirpe eua ede ed nhan khde eung mOt bdi canh, dieu kien ddnh gid Ddnh gid theo tieu chf dQa vao nhQng minh chQng, hay nhung yen ciu lam eO ,, sd eho nhQng nhan dinh mang tfnh gid tri Vin d i ludng theo tigu chf b i t ngudn tQ phong trao danh gia theo tieu ehuin vdo nhung nam 1960 vd 1970 (xem eong trinh cua Glaser, 1963; Popham, 1978) Tuy nhign, each tiip can treng thdi gian dd bi anh hudng manh me bdi phUdng phap ludng dua tren hdnh vi Nhu vay tieu ehi ddnh gid sin phdm boat dOng giao due va sQ phat triin ndng hre thirdng dQpc dinh nghia dQdi dang nhQiig nhiem vu rigng biet md ngudi hpc thQe hien Cho din nhQng nam 1980, khdi niem ddnh gid theo tigu ehf mdi dupc dinh nghia dudi dang mOt chudi ede mde phat triin Glaser [3] cho r i n g ddnh gid theo tieu ehi cin phai: Th,u.c ddy tiin trinh phdt triin bdng cdeh ddnh gid ndng luc dUa tren nhiing giai doan phdt trien lien tiip cua ndng lUc dd Ndng luc dudi goc nhin va edch tiip can ddnh gia dQa tren tieu chi cd muc dich chi sU tiin bO vdi mOt loat nhQng nhung giai doan di tQ mQe t h i p din nhQng mQc cao hon Nhu vdy, danh gia ndng IQC dQa thee tigu ehf la qua trinh chi nhQng diu hieu thue t i nhdm md t i mQe dO dat dupe vi chit lupng, tQ dd dQa quyit dinh vi giai dean phdt triin ndng IQC cua mOt cd nhan cu t h i thdng qua boat dOng 2.2 X a y dtfng t h a n g su* d u n g li t h u y i t d o lifdng h i e n dai Thang la mOt cdng cu ddnh gid dua tren nhQng tieu ehf khd phd bien vd dupc sQ dung di danh gid sin p h i m giao due,chdng han cae bai van viet Khde vdi viec nhan xet bdi lam cua ngudi hpc bdng ldi van, thang eho phep giao vign dua nhQng nhan dinh eua minh theo mOt trinh tu cd can true ThOng thudng, thang bao gdm mOt he thdng ede dac diim, p h i m chit can danh gid vd mOt thudc dc d i mQc dO dat dQpc d mdi p h i m chit eua ngudi hpc Gia tri cua thang viec danh gid hoat ddng hpc tap cua ngudi hpc phu 154 Nghien cUu xdy dung thang ddnh gid bdi tap ngliien cUu khoa hex: ciia sinh vien thuOc vdo viec nd cc dupc xdy dQng tdt hay khdng va ed dupc sQ dung hpp If hay khdng Cung gidng nhu mpi cdng eu lUdng khde gido due, thang de cin phii dupe xay dung dua trgn nhung muc tieu giing day Nd chi ngn dung ngudi sQ dung cd diiu kien thu thdp diy du thdng tin ghi trgn thang Niu nhQng diiu kien dirpc dap Qng, thang de se cd r i t nhiiu ich lpi ddnh gid: - Thang dinh hirdng che ngQdi chim bai nhim tdi nliQng diu hieu cu thi biiu hien sQ nhdn thQc, ndng IQC cua ngudi hpc - Nd eung cip mOt bing tham chiiu ehung d i so sanh kit qui ddnh gid cua nhQng ngQdi chim bdi khde - Nd eung cip mOt phudng phdp thuan tien d i ghi chep nhung danh gid cua ngudi chim bdi Thang de ed nhiiu Idai, nhung nhin chung cd mOt sd loai thang sau day: - Thang dang sd: Ddy la mOt nhQng loai thang ddn gian nhit NgQdi sQ dung danh diu hddc khoanh vdo mdt cen sd chi mQe dO biiu hign cua mOt phim chit d ngudi hpc Ngudi sQ dung thang co thi dupe ehi din ring cen sd to nhit la chi niQc dO eae nhit, sd nhd n h i t Id chi mQc dO t h i p nhit, nhQng sd d giQa Id ehi ede gid tri trung gian Thang dang sd dupe sQ dung nhQng ddc diim, phdm chit dua cd thg dupe phdn loai met sd lupng nhit dinh eae mQe dO (nhiiu nhit la niQc dp) va CO SQ thdng n h i t vi gia tri md mdi sd dai dien Tuy dQpc sQ dung phd biin nhQng nhung sd thang thirdng khdng dupe dinh nghia rd rdng, vi vay mdi ngudi cd the cd edch giii thich rigng va vay tinh chinh xac khdng cae Vl du vi thang dang sd di danh gid ndng luc NCKH eua sinh vign thdng qua bai tap NCKH se cc m i u nhu sau: Hudng din: Hay chi mQe dO ma ngudi hpc thQe hien dupc bdi tap NCKH bang edch khoanh trdn vdo nhung sd tuong Qng Trong dd - Gidi, Kha, - Trung binh, - Dudi trung binh, - Khdng dat yen ciu Bdng Thang dang sd ddnh gid ndng li/c NCKH cua sinh vien Ll c h o n dh t a i 3 LUdc Sl} n g h i e n ciJu van de 4 5 - Thang dang so cd md td: Thang sQ dung nhQng cum tQ md ta dudi mdi eon sd Su md t i chi nhQng khac biet treng biiu hign hanh vi ciia ngudi hpc d nhQng mQc dO khde MOt sd thang chi md t i diim diu, diem giQa vd diem cudi MOt sd thang de khac md t i dudi mdi cen sd tren thude Ddi ngudi ta di mOt khoing trdng d dudi mdi tigu ehi d i ngudi chim diim cho thgm y kiin vi each lua chpn mQe dO eua minh 155 Nguyin Vu Bfch Hiin Vl du vi thang dang sd cd mo ta di ddnh gid ndng luc NCKH cua sinh vign thOng qua bai tap NCKH se eo m i u nhu sau: Hudng din: Hay ehi mQe dO ma ngQdi hpc thQc hien dQpc bdi tap NCKH bdng each khoanh trdn vao nhQng sd tQOng Qng O p h i n nhan xet hay ghi them nhQng gi giai thfch cho each ddnh gia cua giao vien Ll chon de tai Bdng Thang dang sd co md td vien ddnh gid ndng li/c NCKH cua sinh Diy du If Thiiu 11 Rat kem: Cd 11 If If luan va ll luan, hoac luan, thQC Thiiu va tliQc tiin, thQC tiin, tien, tinh b i t hpp 11, t h i hien ehua ndi bat cip thiet khdng cip tfnh c i p tinh cip chQa cao thiit thiit thiit Trinh bay pheng phu, cd tinh thuyit phuc r i t cao Nhan xet khde Viit r i t so sai bode qua xa chu de Ngu dupc mOt sd ten tdc gii, tac phim Chua that gin vdi chu de nghien cQu Ngu dupe hirdng nghien cQu cua mOt sd tdc gia Gdn vdi chii d i nghien cQu LUPC sii' nghier CU'U KhOng trinh bay vin di Ngu dupc nhQng hudng nghien cQu chfnh, va ngoai nudc Sat vdi chu de nghign cQu Nhan xet khae Bgn canh dd, di cd t h i van dung thang tren vao danh gia nhung vin de cu t h i khae, chung ta nen dua vao mOt tgn d i tai eu t h i va vf du each danh gia cho tQng mQe dO d mdi tieu chi Dd se la each ddnh gia m i u d i ngudi sQ dung thang ddnh gia theo Nhin chung day la loai thang tdt eo t h i sQ dung d i danh gia bai viit cua ngudi hpc Nd giii thich rd cho giao vien va ngudi hpc nhQng biiu hien cu thg tQOng Qng vdi nhQng mQc dO dQpc danh gid va hQdng tdi biiu hien tdt n h i t cin phai dat tdi Viec mO ta cang chi tiit, cdng d i quan sat thi viec ddnh gia cang chfnh xac Tuy nhign, mOt sd nhQng ban che d i nhan t h i y eua thang la nd d i 156 Nghien ciiu xdy dung thang ddnh gid bdi tap nghien cUu khoa hoc cua sinh vien bi anh hudng bdi nhQng biin sd ngQdi tham gia danh gid khdng hieu rd cae tieu chf [6; 84] Ndi each khde, sQ sai lech x u i t hien hai bode nhiiu hon nhQng ngQdi tham gia danh gia cd cdeh hiiu khde vi eung mOt mQe dO cua mOt tigu chf Hdn nQa, mOt vin d i khde da dupc xde dinh bdi Oppenheim [6] la hieu Qng quing (halo effect) - xiy nhdn xet cua ngUdi ddnh gid bi inh hudng bdi cim gide chu quan (bao trum len t i t ca) thfch hay khdng thfch Ngay nay, nhd ed If thuyit mdi vi tam If lupng hpc, tQc la md hinh ddp Qng edu hdi Item Respend Thedry (IRM), vin di khac bigt vi quan diim giua nhQng ngudi chim khde da dupe giai quyit Ung dung IRM eung eho phep ngUdi danh gia dua quyit dinh dudi su diiu khiin mang tinh chit chuygn gia chQ khdng dQa qua nhiiu vao cdc cong eu ed tfnh kl thudt SQ dung IRM khdng chi giup ta diiu khiin tdt hdn nhQng inh hudng bgn ngodi ldm sai lech diim sd giQa nhQng ngudi ddnh gid md cho phep dua kit ludn ehung vi sin phdm gido due Li thuyit eho ta gid tri nhiiu hdn ddnh gid vi nd che phep phat hign nhQng tdc ddng khdng dinh trQdc vd bdi vdy, tao diiu kien che viec xay dQng cdng eu lirdng cd dp tin cay va dO gia tri hPn Md hinh dap Qng edu hdi gia dinh rang ndng IQC eua thi sinh lam bai kiim tra CO t h i dQ dean dQpc bdng each xac dinh cdc ddc tinh ndng lue cua ngUdi hpc Vi nhQng ddc tinh nang iQc khdng t h i de ludng dupc mOt edch trQc tiip, nd dupc gpi la ddc tinh hay k h i nang tiem tdng Tuy nhign nhQng dac tinh cd thg ude lupng thdng qua nhung biiu hien co thi quan sat dupe dQa vdo mOt hg thdng cac cau hdi (hoac cdc tigu chf) Md hinh Qng ddp edu hdi chi mdi quan he giQa nhQng biiu hien hanh vi cua thi sinh vd ndng tiim tang dupc coi Id i n chQa ddng sau nhQng hanh vi eua ngudi hpc [5] Miu dap Qng cau hdi eua Guttman la mOt nhQng mdu phu hpp vdi muc dich nghign cQu cua bdi bdo, dd la ddnh gia nang IQC NCKH cua sinh vign qua bai tap NCKH Ygu ciu cua thang hoan h i e Guttman la nhQng ngudi co ndng luc t h i p ludn dat dupc cae mQc dp d i trgn thQdc de vd khdng thi dat dQpc nhQng nhQng mQe dO dQpc che la khd hdn ndng iQc cua hp Ngupc lai nhQng ngudi cd ndng lue cae se ludn dat dupc c i mQc di vd inQc khd (khdng bad gid co trudng hpp ngudi gidi lai khdng dat dupe mQc di) MOt ngQdi dd dQpc xde dinh d mOt cip dp nhit dinh tren thang dd thi ed nghia la hp da dat dQpc eac cip dp t h i p hdn khde [2] Md hinh thang dd Guttman Id t i t cJinh, t i t yiu vd cdeh tiip can mang tinh xac suit Guttman chi ring: Chung ta cd thi goi mdt nhdm cdu hdi (item) cua thang Id cd tinh thing nhdt ndi tai niu mdt ngiidi dat miic dp cao han, nhUng ngudi khde tren thang cd sd diim ting cdc cdu hdi bdng hade cao hOn nhung ngUdi khd (Guttman, 1950, tr.62, trfch [7; 4]) Tuy nhien md hinh thang dd hddn hid cua Guttman khdng thudng thiy thuc te [5] 157 Nguygn Vu Bich Hiin Thay vi sQ dung thang hoan hao cua Guttman, nghien cQu hudng tdi viec xay dimg eae mQc dO biiu hien tren thudc theo md hinh Rasch Mo hinh Raseh mOt nha todn hpc ngudi Dan Mach tgn la Geoge Rasch de xUdng (1979) Me hinh ndy eho rdng mpi ngUdi vdi ndng iQc b i t ki diu cd xu hudng d i dat tdi nhQng mQe dO t h i p hOn la nhung mQc dO cao tren thang (bode cd nhieu k h i nang lam dung nhQng edu hdi d i hdn la nhQng edu hdi khd d i thi) Vdi mOt can hdi ed dO khd b i t ki (hoac mOt mQc dp lirdng trgn thang vdi dO khd b i t ki) thi ngQdi gidi se cd xu hudng lam dung (bode dat dupe) nhiiu hen ngUdi kem Mdi quan he dupe todn hpc hda bdng nhiiu edng thQe toan hpc phQc tap Tuy nhien p h i n m i m QUEST [1] ddi, viec Qng dung md hinh Raseh d i thiit ki cae bai kiim tra bdng hinh thQc trdc nghiem hay thiit ke thang dc giao due trd nen ddn giin hdn Md hinh Rasch tranh dupc cdeh tiep can hoan hao eiia Guttman bdi vi trgn thue t i vin ed t h i xiy trudng hpp ngirdi kem lai dat dQpc mOt sd mQc dO khd eua thudc do, ma ngUdi gidi ddi lai khdng dat dupe mOt mQc dO t h i p ndc dd trgn thudc dd 2.3 Cac bi:fdc x a y dtfng t h a n g d a n h gia bai t a p n g h i e n ciJu khoa hoc Thang dd sau dupe phdc thio, dQa trgn nghign cQu If thuyit vi xay dQng thang do, cin dQpc dQa vao sQ dung thii nghiem Phdn tieh kit q u i thQ nghiem bdng phin mim QUEST se cho ta thiy dO tin cay va dO gia tri cua thang NhQng mQc do iQdng nao bi loai sau phan tfch cin dupc xem xet ein than d i ehinh sQa hoac thay thi K i t q u i cua qua trinh se hinh dupe mOt thude de d i m bao tinh khdch quan d i ddnh gia ngudi hpc thdng qua sin p h i m gido due cua hp la bdi tap nghign cQu khoa hpc Cac budc eu t h i eo t h i dupe tiin hanh nhu sau: Bude 1: Chpn mOt sd lupng bdi tap NCKH quan II gido due d i ldm ddi tupng phdn tfch, (Sd lupng cang nhiiu cang tdt; Tgn cae bai viet cin dupe ma hoa) BQdc 2: Phdc t h i o thang do, nhdm ehdm diim eac bai viet da ndi d trgn Thang mdi dQpc sQ dung song song vdi thudc cu ma cdc giao vien da sQ dung d i chim bai tap NCKH trudc dd Muc dfeh la d i cd su so sanh tUdng quan ' diim sd giQa hai Idai thQdc dc cu va mdi Budc 3: Dung p h i n m i m QUEST d i phan tfch kit qua diim sd thu dupe tQ thang dc mdi xay dirng BQdc 4: Chinh sQa, hodn thien thang Cd t h i ndi ring, bQdc ehua phii la budc kit thue Day cd t h i dupe coi nhu la mOt qui trinh xdy dQng cdng cu danh gid Sau thang dupc ehinh sua va dua vao sQ dung chfnh thQe, nd lai dQpc tiip tue phdn tfch d i hoan thien Mat khac, mdi chung ta cap nhdt nhQng tigu chf mdi vao thang do, mOt qui trinh phan 158 Nghien cUu xdy dung thang ddnh gid bdi tap nghien cUu khoa hoc ciia sinh vien tich mdi lai bdt diu Ket luan Thang la mOt edng cu phd biin vd phu hpp d i ddnh gid mOt bdi tiiu ludn Ap dung II thuyet xay dQng thang va phuPng phap phdn tich thang bdng md hinh Raseh eho phep ta xdy dung mOt thang d i m bio dO gid tri vd dO tin cdy Thang giup gido vign ddt ngirdi hpc trgn mOt thude ndng IQC tQ t h i p tdi cao vd trgn cd sd dd, ngudi hpc ed k h i ndng dinh hudng, tu td ehQe heat ddng hpc tap eua minh Lf thuyit vd cdc budc tiin hanh xdy dUng thudc cd t h i dupc Qng dung di danh gid nhQng tigu ludn cua cdc chuj^gn nganh khae, ngodi chuygn ngdnh quan II giao due Tuy nhign mdi gido vign phii tU thiit ki dupe cdc tigu chf ludng phu hpp cho mdn hpc eua minh TAI LIEU T H A M K H A O [1] Adams, R J., k Kheo, S T., 1993 Quest: The interactive test analysis system Hawthorn, Victoria: Australia Council for Education Research [2] DeVellis, R, F., 1991 Scale development - Theory and Applications (Vol 26) Newbury Park, California: SAGE Publications [3] Glaser, R., 1981 The future of testing: A resea.rch, agenda for cognitive psychology and psychometrics American Psychologist, 36, pp 923-936 [4] Griffin, P., Poynter, G , Nguyin Phuong Nga, Vu Trpng Ry , 2000 Development of Prototype Teaching Standards for Primary Teachers in Vietnam [5] Hambleton, R K., k Swaminathan, H., 1990 Item Response Tfieory Boston: Pluwer-Nijheff Publishing [6] Oppenheim, A N., 1966 Questionnaire design and attitude measurem,erit New York: Basic Books Publishers [7] Wright, B D., k Masters, G N., 1982 Ra,ting Scale Analysis Chicago: MESA Press ABSTRACT Design rating scale to assess scientific research essays of students for Educational Management The article proposes to use rating scales te assess scientific research essays of students who study bachelor of Educational Management Rating scales are a useful and convenient tool which help to assess precisely educational products and advance students from lower to higher ranks of capacity Applying theory of constructing rating scale and Rasch model, teachers may design rating scales with high validity and reliability to mark essays of other different majors 159 ... cua ngudi chim bdi Thang de ed nhiiu Idai, nhung nhin chung cd mOt sd loai thang sau day: - Thang dang sd: Ddy la mOt nhQng loai thang ddn gian nhit NgQdi sQ dung danh diu hddc khoanh vdo mdt cen... nhdt nhQng tigu chf mdi vao thang do, mOt qui trinh phan 158 Nghien cUu xdy dung thang ddnh gid bdi tap nghien cUu khoa hoc ciia sinh vien tich mdi lai bdt diu Ket luan Thang la mOt edng cu phd... Tuy nhign, mOt sd nhQng ban che d i nhan t h i y eua thang la nd d i 156 Nghien ciiu xdy dung thang ddnh gid bdi tap nghien cUu khoa hoc cua sinh vien bi anh hudng bdi nhQng biin sd ngQdi tham