Sharing on AUN-QA Implemenmtation at Programme Level

Sharing on AUN-QA Implemenmtation at Programme Level Assoc.Prof Dr Kunyada Anuwong Lead Assessor, AUN-QA Srinakharinwirot University kunyadaj@gmail.com References: Guide to AUN-QA Assessment at Programme Level Version 2.0 and Version 3.0 8th AUN-QA Workshop for Accomplishing Programme Assessment (Bangkok, 27 – 30 April 2015) ELOs • Apply content of AUN-QA criteria and process to QA practice at programme level • Self-assess the current QA practice • Identify gaps in QA practice Background Bangkok Accord 2000 AUN-QA AUN-QA Guidelines Manual 2004 2006 AUN-QA Assessments AUN-QA Revised Manual Guide to AUN-QA Assessment Version 3.0 2007 2011 2015 Initiation Implementation Learning and Improvement Guide to AUN-QA Assessment at Programme Level Version 3.0 • Model, Criteria and Assessment Process of AUN Actual Quality Assessment at Programme Level • Associated resources (templates and samples) • Effective October 2015 - on voluntary basis • Fully implemented in January 2017 Evolution of AUN-QA PDCA Approach to AUN-QA Implementation at Programme Level Plan PDCA Approach to AUN-QA Implementation at Programme Level (Adapted Approach) Act • Improve QA • Finalise SAR • Communicate SAR • Get ready Check • Verify SAR • Gather feedback on SAR and QA practice Plan • Communicate intent • Organise team • Develop plan • Understand AUN-QA criteria & process Do • Self-assessment • Collect data & evidences • Close gaps • Write SAR • Review SAR Self-Assessment (Gaps Analysis) Improvement Plan to close “gaps” Do PDCA Approach to AUN-QA Implementation at Programme Level SAR writing is very helpful for gap analysis Act • Improve QA • Finalise SAR • Communicate SAR • Get ready Check • Verify SAR • Gather feedback on SAR and QA practice Plan Plan • Communicate intent • Organise team • Develop plan • Understand AUN-QA criteria & process Do • Self-assessment • Collect data & evidences • Close gaps • Write SAR • Review SAR Criteria Sub-criteria Expected Learning Outcomes Programme Specification 3 Programme Structure and Content Teaching and Learning Approach Student Assessment Academic Staff Quality 7 Support Staff Quality Student Quality and Support Facilities and Infrastructure 10 Quality Enhancement 11 Output Total Evolution of AUN-QA 50 (V.2 - 68) Example: AUN-QA Criterion – Check List Expected Learning Outcomes 1.1 The expected learning outcomes have been clearly formulated and aligned with the vision and mission of the university [1,2] 1.2 The expected learning outcomes cover both subject specific and generic (i.e transferable) learning outcomes [3] 1.3 The expected learning outcomes clearly reflect the requirements of the stakeholders [4] Overall opinion How to Write SAR? AUN Criterion 12 Staff Development Activities 12.1 There is a clear plan on the needs for training and development of both academic and support staff 12.2The training and development activities for both academic and support staff are adequate to the identified needs Plan/APPROACH (WHAT, WHY, WHO and HOW) Name of process(es) Training and Development Process of Academic and Support Staff Purpose/goal Identify training needs, deployment of training activities and evaluation of training effectiveness Relate to other AUN Academic Staff Quality criterion Support Staff Quality Person(s) Responsible  Director of Human Resource Department Key steps (Input, Process,  At the end of each calendar year, the HR Department will initiate the training Output) needs identification process Each HOD will identify the training needs for the coming year with each individual as part of the university, faculty and individual needs The training plan for each individual is then collated to form the faculty training plan The faculty training plan is submitted to the HR department for approval Once the training plan is approved, appropriate training programmes are identified and scheduled, and made know to staff for registration Staff who have selected the training programme will attend the training as planned After the training, an evaluation is made by the staff and submitted to the HOD and HR department for report Insert a flowchart of the process Do How to Write SAR? Do/DEPLOYMENT (WHERE and WHEN) Process deployment The training process for academic and support staff was established in 2008 and implemented university-wide in 2010 to all schools, faculties and support departments    Check/RESULTS Measures Results for the last years   Number of training hours per staff   Number of training places per staff   Percent of training places utilised   Training budget as % of total budget    Act/IMPROVEMENT Date and description of The training process for academic staff was established in 2008 and implemented at improvements major schools/faculties covering only post-graduate programmes for academic staff In 2010, the process was extended to support staff as part of the “People” strategy Today, the process is applicable to all schools, faculties and administrative departments covering all training programmes in leadership, curriculum development, pedagogy, IT skills and soft skills The training budget has been increasing at a rate of 2% per annum since 2008 Number of training hours per staff has also been increased from 10 in 2008 to 20 in 2011 Do 106 Workshop: SAR writing and Gap Identification Criterion Checklist Current Practice Available Data/ Gaps in Practice Evidences Data Needed Areas for Improvement (Improvement Plan) Relationship of 11 criteria Relationship of 11 criteria Lesson Learned • AUN-QA implementation and assessment is a learning process (to improvement) 110 Rationale for AUNQA AUN-QA Assessment Results (by Ratings) QA in Higher Education 111 AUN-QA Assessment Results (by Years) 2010 2011 2012 4.7 5.0 5.0 5.0 4.2 4.9 4.7 4.9 5.0 4.5 4.5 4.8 5.0 4.1 4.8 5.0 5.0 4.8 Student Assessment 4.9 4.8 4.7 4.6 4.9 4.9 Academic Staff Quality 5.0 4.8 4.9 4.8 5.0 5.0 Support Staff Quality 4.0 4.0 4.4 4.0 4.0 4.3 Student Quality 5.0 4.5 5.0 5.0 5.0 4.8 Student Advice and Support 5.0 4.3 5.0 5.0 5.0 4.9 10 Facilities and Infrastructure 4.0 4.8 4.4 4.0 4.0 4.0 5.0 5.0 5.0 5.0 5.0 5.0 4.0 5.0 5.0 4.0 11 QA of Teaching and Learning Process 4.7 4.5 4.5 4.7 4.7 4.2 12 Staff Development Activities 4.0 4.3 4.1 4.5 4.0 4.0 13 Stakeholders Feedback 4.0 4.0 3.3 4.5 4.0 4.0 14 Output 5.0 5.0 5.1 5.0 5.0 4.8 15 Stakeholders Satisfaction 5.0 4.5 4.4 5.0 5.0 5.0 Overall 4.7 4.5 4.6 4.6 4.7 4.6 Overall 2007 2008 Expected Learning Outcomes 5.0 4.8 5.0 Programme Specification 4.8 4.9 Programme Structure and Content 4.9 Teaching and Learning Strategy AUN-QA Criteria 2009 Medians 5.0 4.0 5.0 5.0 5.0 5.0 112 ถถ ถ ถถถ ถถถถถถถถถ ถถ ถถถถ ถถถถถถ ถถถถ ถถถ ถถถ ถ….ถถถถถถถถ ถถถ ถถถถถถถถ ถถถถ ถถถถถ ถถถ ถ ถถถถถถ ถถถถถถ ถถ • ถถถถถถถ ถถถ ถถถถถถ ถถถ ถถถ ถถถถถถ ถถถถถถ ถถถ • ถถถ ถถถถถถถ ถถถถถถถ ถถถถถ ถถถถถ ถถถถ ถถถถ ถถถถถถ • ถถถ ถถ ถ target ถถถถถ ถถถถถถถถถถถ ถ AUN-QA • ถถถ ถถถถถ ถถ ถ target ถถ ถถถถ ถถถถถAUN-QA ถถถถถ ถ ถถถ ถถถ ถถ ถถถถถ ถถถถถถถถถถถถถถถABET ถถถ ถถถ ถถ IC ถถถ ถถ ถถถถถถถถ ถถถถถถ ถถถ ถถถถ ถถถถ • ถถ ถถถถถ ถถถ ถ ถถถถถถถถถถถถ ถถถถถถ ถถถถ ถถถ ถถ • ถถถ ถถถถถ ถถถ ถถถ ถถ ถถถ ถถถถถถถถ ถถถ ถ ถถถถถถถถถ ถ EQA ถถถ ถถถถถถถ ถถถ ถ • ถถถ 113 114 115 ถถ ถถถถ ถถถถถถ ถถถถถถ ถถถถถถถถถถ • ถถ ถถถถถถถถถถถถ ถถถ ถถถถถถถถ ถถถถถถถถถ ถถถถถถถถ ถถถ ถถถถ ถ • KSF: ถถ ถถถถ ถถถถถถถถถถถถถถถถถถ ถถถถถ ถถถถถ ถถถ ถถ ถถถถถถ ถถถถถถ ถ(ถถ ถถถถถถ) ถถถถถถถ ถถถถถถถถถถ ถถถ ถถถถ ถถถ ถถถถถถถ ถถถ ถถ • Pedagogical training and sharing really help! • ถถ ถถถ ถ ถถถถ ถถ - ถถถ - ถถถ ถถถถถ - ถถถถ – ถถถถถถ – ถถถ ถถ ถถถ ถถถถถถถถถ ถถถถถถ ถถถถถถ ถถถ ถถถถถถถ ถถถถถถ ถ ถถถ ถถถ ถถถถถถ ถถถถถถ ถถ • ถถถถถถถถ ถถ ถถถ ถถถถ • ถถถ ถถpassion ถถถถถถถถ 117 118 119