SIDP Evaluation Report final June 2014

REPORT FINAL EXTERNAL EVALUATION OF SOMALI INSTITUTIONAL DEVELOPMENT PROJECT, UNDP, SOMALIA P MADHAVA RAO MICHAEL PALMBACH KERRY ABBOTT ACKNOWLEDGEMENT Evaluation of Somali Institution Building Project that was launched by UNDP under some noble compulsions is not an easy task A project that was formulated for Institution Building for a Nation with large budget estimate and HR component really needs to be evaluated with sincerity and commitment considering the circumstances and conditions under which it was formulated and launched The evaluation team sincerely, thanks all those who have honestly supported the team to accomplish this otherwise tough task The comments offered by Mr David Akopyan the deputy country director, Mr Albert Soer, the Chief Technical Advisor, Mr Franco Sanchez, the Rule of Law and Governance programme, Mrs Christine Fowler the acting project manager till February 2014, Mrs Bushra Hasan, the UNDP M&E Officer, , were of great importance and added value to the report But for their insights into the conditions under which the project formulated and implemented, the evaluation finding could have been incomplete The team members thank them from the core of their hearts The technical, secretarial, and logistical support provided Mr Sergei Pushkarov and Ms Samira Hassan, the SIDP project team at Hargeisa; hospitality and insight into project management provided by Mr Stephen Kinloch Pichat, the head of sub office at Hargeisa; Mr Musa Duale, SIDP Project Officer at Garowe; Mr Mohamed Barre SIDP Senior Advisor at Mogadishu has been immensely helpful, and the evaluation team places on record its heartfelt appreciation of the support extended by them And in the home-office the assistance of Ms Keziah Kuria and Mehmood Hassan has greatly facilitated the work of the team The team owes them a lot The team thanks all those Ministers, Deputy Ministers, Vice Ministers, Director Generals, and senior functionaries in the line Ministries, Civil Service Commission, and Civil Service Institute, Offices of Auditor General, and the donors who have shared their candid opinions about the implementation of the project without any hesitation The report could have not gone to the root of the project implementation without their keen observation and understanding of the project results The information shared by the National Staff teams at Hargeisa, Garowe, and Mogadishu has been of great value Their perspective on future direction of the project has been deeply appreciated Team takes pride in thanking the support extended by the transport team, travel unit, finance team, and security team of UNDP Somalia who made the living of the team members comfortable, trouble free, and memorable Finally, the evaluation team thanks those all who have been instrumental in giving a shape to this evaluation, and requests the pardon of those whose names are not found in this acknowledgement Non-mention of the names here is a space constraint but not deliberate Thank you all ii P Madhava Rao Michael Palmbach Kerry Abbot iii Contents ACKNOWLEDGEMENT .ii Contents iii ACRONYMS AND ABBREVIATIONS v EXECUTIVE SUMMARY vi 1.0 Introduction 1.1 Evaluation Themes and Evaluation Questions 1.1.1 Public Sector and Civil Service Reform .10 1.1.2 Public Financial Management 10 1.1.3 Development Planning and Aid Coordination 11 1.1.4 Evaluation objectives and combined questions: 11 1.2 Brief Description of the Project 12 1.3 Methodology of Evaluation 14 2.0 Findings .16 2.1 Review of the project document 16 2.2 Review of Implementation Arrangements 17 2.2.1 Project Successes .19 2.2.2 Project Shortfalls 22 3.0 Evaluation of three themes 24 3.1 Public Administration and Civil Service Reform- Overall findings 24 3.2 Public Financial Management 27 3.2.1 SIDP attempted to too many things in PFM 28 3.2.2 SIDP results in PFM were only partially achieved .28 3.2.3 Public Financial Management - Findings specific to Somaliland, Puntland, and South-Central Somalia 29 3.3 Development Management and Aid coordination .34 3.3.1 Project Design 34 3.3.2 Project Analytical Framework 35 3.3.3 Implementation Review of SIDP .38 3.3.4 Development Planning and Aid Coordination Objectives 40 3.3.5 SIDP Assistance to Development Planning .41 iv 3.3.6 SIDP Assistance to Aid Coordination 44 3.3.7 Challenges facing SIDP .47 3.3.8 Evaluative Development 48 3.3.9 Findings on Development Planning and Aid Coordination 49 4.0 Overall Relevance, Efficiency, Effectiveness, and Sustainability of the Project 51 4.1 Relevance of project 51 4.2 Effectiveness .51 4.3 Efficiency .52 4.4 Sustainability 53 5.0 Lessons learned 55 6.0 Moving Forward 58 6.1 Opportunities 58 6.2 Conclusions 59 6.3 Recommendations 62 Annex I - TOR 69 Annex – Report and Documents 75 Annex - List of Persons consulted and Field Visits 79 Annex - Meeting Schedule for the Evaluation Mission 82 Annex – Evaluation objectives and questions answered 87 v ACRONYMS AND ABBREVIATIONS AGO BCPR CD CoA CSC CSI DAD DCD EC ETA EU EY GFS GGC HQ ICT IOM JLPG&SD LoA M&E MIDA MoF MoLSY MoPIC MoPND NCSC OAG OPM PAR PFM PL PSU QUEST SC SCMSP SICAD SIDA SIDP SISP SL SUP TA ToR UN UNDAF UNDP USAID USD Accountant General Office Bureau for Crisis Prevention and Recovery Capacity Development Chart of Accounts Civil Service Commission Civil Service Institute Development Assistance Database Deputy Country Director European Commission Emergency Technical Assistance Project European Union Earnest and Young Government Financial Statistics Somaliland Good Governance Commission Head Quarters Information and Communication Technology International Organisation for Migration Joint Programme of Local Governance and Service Delivery Letter of Agreement Monitoring and Evaluation Migration for Development in Africa Ministry of Finance Ministry of Labour, Social Affairs and Youth Ministry of Planning, and International Cooperation Ministry of Planning and National Development National Civil Service Commission Office of Auditor General Office of the Prime Minister Public Administration Reform Public Financial Management Punt Land Puntland State University Qualified Somali Technical Support South Central Somali Constitutional Support Project Somali Institutional Capacity Development Project Swedish International Development Agency Somali Institutional Development Project Somali Institutional Support Somali Land Start Up Project Technical Assistance Terms of Reference United Nations United Nations Development Assistance Framework United Nations Development Programme Unites States Agency for International Development United States Dollar vi EXECUTIVE SUMMARY The Somali Institutional Development Project (SIDP) was an initiative by UNDP launched during 2009 and extended up to the end of 2013, while during 2014 still a number of smaller activities are finalised A number capacity development support projects operated by UNDP up to 2008 were merged to give birth to SIDP The project initially proposed to mobilise and spend about USD 55M over a period of three years However, the project could not mobilise these funds and hence the overall scope of the actual implementation was smaller than the initial intentions In accordance with the provisions contained in the project document, SIDP is mandated to conduct an end of the project external evaluation, which is done to provide value for future activities and to offer findings on the extent to which the project met its objectives Accordingly, three international consultants with expertise in public administration and civil service reforms, public financial management, and development planning and aid effectiveness were engaged by UNDP to conduct an evaluation However, apart from the formal requirement to evaluate the project, UNDP embarked on this evaluation to document the achievements and challenges the project faced and to draw the lessons for the implementation of the future activities The evaluators have taken 28 days from 25th April to 22 May to evaluate the project and submit this report The Somali Institutional Development project worked under great stress due to security issues, changing governments, and inadequate staff and financial resources Despite being understaffed, and underfunded, the project has been able establish itself as project which has provided support in a volatile security and governance environment in Somalia The project significantly contributed to making the civil service commission and civil service institution in Somaliland functional; the Ministry of Labour and Office of the Auditor General of Puntland are now working in a reformed environment The project has produced about 50 advisory, policy, and strategy notes and guidelines requiring follow-up There is a momentum towards overall institutional development in all the three regions after the launch of this project vii The project simultaneously suffered because of under-performance of activities taken up, non-recruitment of required staff in all regions, insufficient monitoring of progress, and not enough follow-up with all the stakeholders Government ownership issues, sustainability of advice given, development of relations with all the stakeholders, ineffective reforms have been the areas of criticism Considering the conditions under which the project operated, the following conclusions and recommendations are made Conclusions:  Partial achievement of goals: there was partial attainment of goals,  Supply oriented product delivery: too many of the project deliverables were supply oriented, and not tied into the existing systems, i.e manuals were delivered which did not take into account the current status of the systems which were meant to be improved,  Project ownership: the impression is wide-spread that reforms were UNDP driven, and that the role of the government was to sign-on to the initiatives designed by UNDP consultant The created issues of ownership,  Staffing recruitment and retention: all required staff were not deployed, retention was an issue,  Capacity Development became secondary: focus was on capacity substitution & equipment not capacity development (this also was partially due to the requirements met on the ground),  Follow-up and in-depth technical assistance: deliverables were often trainings and manuals, which introduced the topics but follow-on actions were often missing,  Unclear vision and operational plans: project objectives, inputs, outputs, and outcomes were not clearly stated,  SIDP/UNDP response to issues: recognized short-comings, and took steps to remedy them Recommendations  Project formulation, communications, refinements: Invest in extensive communications, interaction, and continuous dialog to ensure that the project is/and remains demand oriented,  Donor coordination and communications: develop synergies with other donors in their programs, establish and follow more formalized communication mechanisms, viii  Local alignment: align the project with Somali Compact, New Deal, and the National Development Plans of the regions,  Public administration reform alignment: stronger alignment with public administration reforms (those planned and underway locally),  Utilization of Somali expertise: cultivate, invest in, and utilize Somali experts wherever possible,  Sub-offices to service each State/Region: develop specific work plans for South-Central, Somaliland, and Puntland, establish offices with some delegated authority in each region,  Intensive rather than extensive approach: selected limited number/prioritised line ministries for deeper involvement, fewer things better, learn to say “no”  Do not undertake reform of PFM systems: not undertake systems-development in PFM (development of budget format, standards, law writing, etc.), leave much of this for specialists,  Cooperate with PFM initiatives: engage in PFM activities when they interact with policy, governance, capacity development issues (i.e assisting ministries in planning and budgeting),  Improve quality of technical assistants experts: develop a pool/roster of institutional development experts (invest in the experts, so that they may be called on repetitively),  Develop strong management systems: develop strong management systems and procedures, make the Project document the controlling instrument, amend it formally as required,  Complete and/or follow-up SIDP activities: follow-up action on the activities initiated by SIDP (continue to invest/complete initiative begun) where it serves new project objectives,  Strong communication and monitoring systems: sub-offices, clients, donors require both formalized and informal communications, this should be a two-way channel and utilized to influence the implementation and directions of the project,  Joint programming: joint programming with other actors with a rights based approach,  Inter-Ministerial coordination: establishment of Inter-Ministerial coordination mechanisms These recommendations are elaborated in the main document These are for the future direction of any project of support that may be designed for Somali Institutional Capacity Development ix 1.0 Introduction The Somali Institutional Development Project (SIDP) was signed by UNDP on 27th October 2008 with an estimated resource requirement of US $ 55 million for project duration of three years from 1st January 2009 to 31st December 2011 The project document envisaged an end of project external evaluation at 36 months, to evaluate the project against overall intended outcome However, as the project has been extended twice, the end of project evaluation is being conducted now (May 2014) by three independent consultants The focus of the evaluation is mainly on public sector and civil service development, public financial management systems, and development planning and aid coordination These three areas encapsulate four pillars of institutional development namely, Development of systems and processes of making and implementing policy and law; Development of Human Resources; Improvement of public financial management (PFM); and Development of physical infrastructure as promised in the project document Following experts were contracted by UNDP for the purpose of evaluation:    P Madhava Rao Team Leader and Public Sector and Civil Service Reform expert Michael Palmbach Public Financial Management expert Kerry Abbott Development planning and aid coordination expert The evaluators present this evaluation report after conducting available literature review, field interviews, and discussions with focus groups in Somaliland, Puntland, and South-Central Somalia A comprehensive evaluation has been conducted by European Commission (EC) during 2012, and a comprehensive draft1 progress report was submitted by UNDP to European Union on 10th March 2014 These reports present a good deal of facts about the project To avoid undue duplication, this evaluation report has limited itself to a few important issues and facts The report has been implemented according standards of evaluation enlisted in the UNDP/DAC/UNEG standards of evaluation, ethical issues, transparency, and fairness At the time of implementing the present evaluation, the draft progress report was submitted to the European Union However, the report had not yet been formally endorsed or approved      Day 1-3: Kick-off meeting with UNDP and SIDP Donors Meetings and video conference (as required) with UNDP and project teams Review of documentation in Nairobi, meetings with relevant stakeholders, preparation of field work Presentation of inception report (3 person/days); Day 4- 14: Field visits to Somalia (10 person days); Day 15-18: Follow-up discussions with UNDP and presentation of preliminary findings to the UNDP and donors donors; Preparation and submission of draft report (3 person/days); Day 19 – 21: Within 14 days after receipt of consolidated SIDP donors and UNDP feedback; Final editing and submission of final report (3 person/days) Location(s) of assignment: Kenya and Somalia 11 COST Fees: The assignment will be contracted on a fee –based price basis Shortlisted candidates will be contacted to provide a financial proposal along with a technical proposal It is expected that the Contractor will make available an appropriate management and backstopping mechanism, quality control system, secretariat and any other support staff (editors, proof readers, etc.) that it considers necessary in order to implement the Framework 12 KEY DOCUMENTATION (PRESENTED IN CHRONOLOGICAL ORDER)  Evaluation of the UNDP Somali Institutional Development Programme, Alain S Thery/Andrea Amici, February 2012  Bureau for Crisis Prevention and Recovery (BCPR) 2011 Draft Report on UNDP Governance  Programme  McLure, Douglas “Monitoring Report: Support to the Governance Sector (Overall)”, Ref 140303.01, 06.06.2011 (a.k.a RoMS Report)  Somaliland Civil Service Reform Strategy (Concept Paper) 2011  Accord 2010, Policy Brief 21 “What peace is it anyway? Connecting Somali and international peace making”  Interpeace 2010: Peace Mapping Study (5 volumes)  Renders, M And U Terlinden (2010) “Negotiating Statehood in a Hybrid Political Order: The Case of Somaliland.” Development and Change 41(4): 723-746  Joint Strategy Paper 2008-2013  OECD 2007 “Principles for Good International Engagement in Fragile States & Situations”, http://www.oecd.org/dataoecd/61/45/38368714.pdf  Cabdiraxmaan Jimcaale (2005) Consolidation and Decentralization of Government Institutions  Rebuilding Somaliland: Issues and possibilities W S Programme Lawrenceville, N.J., Red Sea Press: 49122  EuropeAid “Institutional assessment and capacity building”, September 2005  UNDP/CMI (2004) Governance Interventions in Post-War Situations: Lessons Learned Conference on  Governance in Post-Conflict Situations, Bergen, United Nations Development Programme/Chr Michelsen Institute  DANIDA “Capacity development evaluation”: Methodology for evaluation of Capacity development”, October 2003  EC Communication (2003) 615 “Governance and development”  War-torn Societies Project (2001) Rebuilding Somalia: Issues and Possibilities for Puntland London, HAAN Associates 80 Annex – Report and Documents Ali, Abdirisak Mohamed Puntland Monitoring and Evaluation Policy for the Public Sector Garowe: Government of Puntland 29p Chowdhury, Jahan Draft Monitoring, Review and Evaluation Manual for Projects, June 2013 Civil Service Institute, Center of Excellence Brochure Hargeisa: 2013 13p CSI Policy and Procedures 42p CSI Report on Training Impact Assessment Hargeisa:June 2013 17p deMel, Eric Guidelines for Project Formulation Assessment and Evaluation Nov 2013.214p de Renzio, Paulo and Sarah Mulley Managing Aid Dependency Project: Donor Coordination and Good Governance March, 2006 University College Oxford 29p Elhawary, Samir “UN Integration and the Humanitarian Space in Somalia.” London: ODI and the Stimson Centre 2011 Federal Republic of Somalia Provisional Constitution Mogadishu: August 1, 2012 66p Federal Republic of Somalia Economic Recovery Plan 2014-2015 126p Federal Republic of Somalia The Somali Compact Brussels, Sept 2013.44p Federal Republic of Somalia Vision 2016:Framework for Action Mogadishu: Feb 2014 31p Fourth High-Level Conference on Aid Effectiveness A New Deal for Engagement in Fragile States Bussan 2011 http://www.g7plus.org Framework for Capacity Development of the Public Sector in FG Somalia August 2013 7p NA Good Governance and Anti-Corruption Commission National Corruption Perception Survey, 2013 Round 40p Government of Puntland Aid Coordination Policy Draft 11p Government of Somaliland New Deal Somaliland Special Arrangement 2013-2016 19p International Dialogue on Peace building and State building Peace building and State building Indicators —Progress, Interim List and Next Steps Document 03 for discussion Presented at conference “The New Deal: Achieving Better Results and Shaping the Global Agenda.” Wash.D.C April 2013.23p Ministry of Planning Profile Garowe 11p 81 Ministry of Planning and International Cooperation Puntland Government of Somalia Aid Policy July 2013.9p Mohamoud, Said Farah Puntland Five Year Development Plan2007-2011): Review Report Puntland State of Somalia, Ministry of Planning and International Cooperation Garowe: June 2012 71p Morley, Emma SIDP Redesign Process documents New Deal Somaliland Special Arrangement 2013-2016 Draft Sept 2013 19p Norad Review of the Norwegian Support to Somalia through UNDP Oslo:June 2013 67p OECD DAC Working Party on Development Finance Statistics Progress in Implementing the Busan Common Standard for Aid Information Paris:2013 9p Puntland Civil Service Commission Internship Evaluation Survey 6p Puntland M&E Policy 4p Puntland State of Somalia, Ministry of Planning and International Cooperation Progress Report on the formulation of the Second Five-Year Development Plan July 2013 4p Puntland State of Somalia, Ministry of Planning and International Cooperation Puntland Policy toward the International humanitarian organization 15 Dec 2010 8p Puntland State of Somalia, Ministry of Planning and International Cooperation.Strategic Plan(20122014)revised by Abdirisak Ali, M&E Consultant Garowe: Feb 2012 31p Puntland State of Somalia, Ministry of Planning and International Cooperation Puntland 2nd Five Years Development Planning(2014-2018): Development for All Garowe, Dec 2013 QUESTS-MIDA Narrative Reports (5) Success Stories Republic of Somaliland Good Governance and Anti-Corruption Commission Establishment Act of the GGACC 2012 10p Republic of Somaliland Good Governance and Anti-Corruption Commission Narrative Reports (4) Republic of Somaliland Good Governance and Anti-Corruption Commission National Corruption Perception Survey 2013 43p Republic of Somaliland Good Governance and Anti-Corruption Commission Strategic Plan 2013-2015 72p Republic of Somaliland Ministry of National Planning and Development.National Development Plan 2012-2016.Dec 2011 348p 82 Republic of Somaliland Somaliland National Vision 2030 Hargeisa:MNPD.Dec 2011.20p Riva, Althea-Maria Migration for Development in Africa(MIDA) Somalia Program Program Evaluation for IOM Nov.2013 53p Taylor, Alan J Assistance to Ministry of National Planning and Development in the area of Monitoring and Evaluation (Mission report).August 2013 28p Taylor, Alan J Mission Main Outputs Nov 2013, (11 documents) Policy on Monitoring and Evaluation, Proposed Training Strategy Proposed Amendments to the Standard Letters of Agreement, Form for Renewal of Registration, Form of a Simplified Logframe, Form and Guide for Monitoring and Review, Form for an Annual Disbursement Report, Guide to Evaluation and Learning, Checklist Readiness for Monitoring and Evaluation, Checklist Ad hoc Monitoring and Evaluation, Monitoring and Evaluation Manual Thery, Alain S And Andrea Amici EU Evaluation of the UNDP Somali Institutional Development Project Feb 2012 71p.plus annexes Transitional Federal Government of the Somali Republic Aid Coordination and Management Office Workplan 2011-2012.3p UNDP Assessment of Evaluation Results.Evaluation of UNDP Contribution: Somalia.NY: UNDP Evaluation Office, July 2010 102p UNDP Donor Joint Action Plan for SIDP.July 2012 8p UNDP Framework for Capacity Development of the Public Sector in Somalia.(Draft) August, 2013 7p UNDP Garowe Sub-Office Overview of Development Trends Jan 2011.10p UNDP Garowe Sub-Office.(?)Proposed PSIP Format 61p UNDP Garowe Sub-Office Weekly Programme Meeting April 2014 5p UNDP The Mission, Goals and Functional Structure of Aid Coordination Unit ND.Garowe 7p UNDP Public Sector Investment Program(PSIP) Project Proposal Preparation Guideline(PL) 50p UNDP Ministry of Planning and International Cooperation Puntland Macroeconomic Framework 20122021 August 2011 22p UNDP Somalia Handover Notes: Karolien Casaer-Diez, Emma Morley, Jahan Chowdhury UNDP Somalia Participatory Community Census for Poverty Assessment and Mapping: Bari Region Working Document Garowe.2008 81p UNDP Somalia Participatory Community Census for Poverty Assessment and Mapping: Nugaal Region Working Document Garowe.2008 86p 83 UNDP Somalia Somalia Institutional Development Project Final Narrative Report April, 2014.45p UNDP Somalia Somalia Institutional Development Project 2008-2010.August, 2008.103p UNDP Somalia UNDP Peacebuilding Marker 2013.3p UNDP Somalia Somali Institutional Development Project 2014 Somaliland Quarter Report 12p UNDP Somalia, SIDP Annual Progress Report 2013 UNDP Somalia, SIDP Annual Project QA Assessment 2013 7p UNDP Somalia, SIDP Progress Update Federal Level Quarter 1, 2013.4p UNDP Somalia, SIDP Quarterly Progress Reports (6) 2013 UNDP Somalia Strengthening Institutional Performance (SIP) Somaliland Project document.Draft April 2014 51p UNDP Somalia Towards a just and sustainable peace in Somalia, 2012-2015.(programme document) 2013 65p UNDP Somalia United Nations Country Team Policy Discussion Paper.Topic: Capacity Development July 2013, 4p UNDP Somalia Somaliland 7p UNDP Somalia Strengthening Governance and the Rule of Law in Somalia, 2012-2015 91p UNDP Somalia Human Development Report:Empowering Youth for Peace and Development 242p UNDP UNDP Somalia Annual Report, 2012 27p UN and World Bank Somali Reconstruction and Development Programme: Deepening Peace and Reducing Poverty.Volume I January 2008 108p Maps: Somalia EC Development Programme.Ongoing Mult-annual Projects April 2014 EU.(excluding ECHO) Somalia: Cluster activities and response April 2014 OCHA Somalia:Clan Distribution Map OCHA Somalia Adminsitrative Map OCHA 84 Annex - List of Persons consulted and Field Visits Nairobi A.H.Haji, Private Sector Development and Growth Adviser, DfID Somalia Ahmed al-Hammal, UNDP Asst Country Director, Planning and Partnership Coordinator Albert Soer, UNDP, Chief Capacity Development Advisor Alireza Abdollah Zadeh, Country Economist-Somalia, World Bank Anna Walters, Programme Coordinator, DfID Somalia Bushra Hassan, UNDP Monitoring and Evaluation Officer Dahir Jorow, Somalia Programme Manager, Swiss Embassy Daphine Hunter, Information Management Officer, OCHA David Akopyan, UNDP Deputy Country Director, Programmes Elizabeth Kariba, UNDP SIDP Programme Associate Ignatius Takawira, former UNDP Head of Sub-Office, Hargeisa (email) Jessica Price, former UNDP Development Planning Officer (Skype) Jonathan Brooks, UNDP Poverty Reduction Programme Officer Karolien Casaer-Diez, former UNDP Aid Coordination Officer (Skype) Marcin, UNDP, Nairobi Mehmood Hassan, UNDP, SIDP, Nairobi Par Skold, First Sec, Sr Progr Mgr, Somalia Section, Embassy of Sweden Stephan Massing, Sr Public Sector Governance Expert, World Bank Urban Sjostrom, Aid Coordination, Embassy of Sweden Valentina Auricchio, Head of Section, State-Building/Security Sector Hargeisa Abdirahman Youssuf, Civil Service Commission Abdirashid Muse Ismail, Dir of Admin and Finance, GGACC Aden Ali, University of Hargeisa, Professor of Peace Studies Ahmed Abdillahi Nadif, Direction of Planning, MNPD Alan Taylor, former SIDP M&E Consultant MNPD (email) Anthony Njue, Team Leader, Somaliland Development Fund Hassan Dahir Dimbil, Vice Minister, MNPD Hassan Omer Hoorri, General Director, GGACC Hirsi Abdillah Ismail, Director of Administration and Finance, CSI Hussein Abillahi Jama, Deputy Commissioner, GGACC Jens Rubner, UNDP Functional Review Consultant Mohamed A Warfame, Academic Directorate, CSI Mohamed Boqareh, Director General, Civil Service Institute Mohamed Fawsi Abdi, Director of Good Governance Dept, GGACC Mowlid Elmi Osman, IT, CSI Mr Abdinasir Osman Mohamoud, Dir of Planning, House of Rep Muhammed qaasim, Directoion of Coordination, MNPD Mustafa Ahmad Mohamud ACCA Assistant, CSI Nouh Sh Muse Du’aleh, Chairman, Civil Service Commission Rima Das Pradhan-Blach, Special Adviser, MNPD Saad Shire, Minister, Min of National Planning and Development(MNPD) Sergei Pushkarev, UNDP SIDP Programme Manager 85 Samira, UNDP, Programme Officer, SIDP Shukri Haji Mohamoud, Min of Environment and Rural Development Soren Skou Rasmussen, Head of Office, DANIDA Stephen Kinloch-Pichat, UNDP Head of Sub-Office Garowe Abdirisak Said Nur, Advocacy and Lobby Officer, PUNSAA Abdirisaq, Director General, Ministry of Finance Abshin Mohamed Abshine, Advisor, Ministry of Finance Abshir Mohamed Hirsi, PUNSAA Project Officer Ahmed Awok, State Minister, MoPIC Ahmed Harir, NGO Database Manager, ACU, MoPIC Ahmed Jama Hassan, General Secretary, Ministry of Finance Ahmed M, Accountant General, Ministry of Finance Ahmed Yasin, Vice Minister, Ministry of Finance Ali Ahmed Farah, Minister of Planning and International Cooperation Ali Warsame Farah, Intern, MoPIC Barhan Abdilahi, Head of Human Resources, MoLSA Barni Isse Jabar, Personnel Director, Min of Labour and Social Affairs Gavin Roy, UN Resident Coordinator’s Office Hassan, Vice Accountant General, Ministry of Finance Ibrahim Hussein, Programme Coordinator, CARE Mohamed Haji, Director of External Relations, Ministry of Finance Mohammed Ali Ismail, Director General, MoPIC Musa, Du’aleh Aden, SIDP Programme Coordinator Omar Selim Aboud, Head of Puntland Area Office, UNSOM Osman Jama, Head of Aid Coordination, MoPIC Philippe Durand, Field Officer, European Union Said Farah Mohamoud, Deputy Min., Min of Planning/Intl Cooperation Said Farah, Planning/Statistics Consultant, MoPIC Shire Haji Farah, Minister, Ministry of Finance Vikas Singh, Social Policy Specialist, UNICEF Mogadishu Abdilahi Sheikh Ali, Deputy Min of Planning Abdilahi Sheikh Mohamed, Director General, Ministry of Planning Abdilhakim Farah, UNDP Programme Specialist, Office of the PM Abdirashid Muse Said, Webmast to New Deal Communication Abdirashid, New Deal Communications Abdiweli Mohamed Daud, Commissioner, National Civil Service Commission Ahmed Adan, former New Deal Communication Coordinator Ahmed Ainte, Director, Aid Coordination Unit, Ministry of Finance Ahmed, SIDP Technical Adviser, Ministry of Information Ali Mohammed Ibrahim, Chairman, National Civil Service Commission Ali Moumin Mudey, Commissioner, National Civil Service Commission Barre Mohammad, UNDP, Somalia Burhan Iman, Chief of Protocol, Office of the Prime Minister Christine Fowler, UNDP former SIDP Programme Manager Franco Sanchez, UNDP Rule of Law Programme Manager Hussein Abdi Elmi, Legal Advosor, OPM 86 Isam Babiker, Programme Officer, WFP Mitch Dufresne, Chief, UNDP Joint Justice and Corrections Section Mohamed Jama Magan Mohammed Azouqa, Programme Officer, FAO Mr Mohamed A Jama , Policy Adviser, Office of the PM Sagal Ahmed, SIDP, New Deal Communications Desk, Office of PM Shair Guled Hared, Director General, National Civil Service Commission Ubah Nur, Finance/Admin Support Staff Dalmar Larson, Coordinatir in Capacity Development Field Visits Hargeisa UNDP SIDP Office Civil Service Institute Civil Service Commission Good Governance and Anti-Corruption Commission Garowe Ministry of Planning and International Cooperation Punt Land State Univeristy Office of the Auditor General Civil Service Commission Ministry of Labour, Social Affairs, Youth and Sport PUUNSA Coalition of Non-state Actors CARE International Mogadishu UNDP office in UNSOA/UNSOM compound for meeting with Deputy Minister of Planning, Director-General Ministry of Planning UNDP compound for meeting with National Civil Service Commission Villa Somalia meeting with UNDP Technical Advisers in the Office of the Prime Minister Villa Somalia meeting with Ahmed Ainte, head of ACU Villa Somalia meeting with Auditor-General 87 Annex - Meeting Schedule for the Evaluation Mission (25th April– 24thMay) Workin g Day Date 25th April 2014 26 or 27 April 26th and 27th April 28th -30th April 2014 28th April 2014 28th April 2014 28th April 2014 28th April 2014 29th April 2014 Proposed Meetings Arrival Time Location TBC Tentative Plan Hotel check-in Option to Hotel meet Albert Soer, CTA project Evaluation Hotel team meetings Monday, Tuesday and Wednesday Meeting with SIDP staff 9:00 am SIDP Office in Nairobi Meeting with George Conway and David Akopyan Meeting with PPU+ Bushra Hassan 11:00 am George’s Office 13:00 am PPU Office Meeting with Christian Fowler, former project manager Meeting donors and partners: EC Donor (Anna Schmidt), Norway, () Swede (Urban) Swiss ( IOM (Franzt Celestin) Donor meetings 15:30 pm Christine Office 9:00 am -17:00 pm Taxi arrangemen ts to be put in place 9:00 am – 16:00 pm Taxi arrangemen ts to be put in place 30th April 2014 May May -18th May Field Mission Responsible Person / Contact Person Consultant Consultant Discuss approach, schedule and logistical matters CD and DCD Mehmood Hassan To meet with the head of PPU and M&E Specialist discus SIDP and scope of evaluation Discuss project achievements during her tenure Mehmood Hassan Mohamed Barre and Mehmood Mehmood Hassan Mehmood Different location/calling them to the office? Mehmood May 10 May 11 May 12 May Workin g Day Date 13 May 14 8th May 15 May 16 10 May Travel to Hargeisa Meeting with SIDP Hargeisa team and putting meeting arrangement s Partner meetings Partner meetings Partner meetings Proposed Meetings Partner meetings Travel to Garowe Meeting with SIDP Garowe team and arrangement s of the meeting with partners Partner meetings Partner meetings TBC 12:00 pm UNCC, meeting with partners UNCC compound Time Location Tentative Plan TBC 18 11 May 12 May Partner meetings Partner meetings UNCC guest house check-in Sergei Pushkarev Responsible Person / Contact Person Musa Aden UNDP Office FRIDAY 8:3010:30 Ministry of Planning Ministry of Labor, Youth and Sports Office of Auditor General Civil Service Commission 10:3011:40 Ministry of Finance 16:00 – 15:00 9:0010:00 Puntland State University Tender Board Office Puntland State University Musa Duale Tender Board Office Musa Duale 10:1511:00 IOM-Garowe IOM/SIDP- Office Musa Duale - 8:30 10:00 10:0012:00 16:0018:00 17 Hotel check-in 89 Ministry of Planning team Ministry of Labor Musa Duale Office of Auditor General Musa Duale Civil Service Commission Musa Duale Musa Duale Musa Duale 19 13 May 2014 Partner meetings 20 14 May 21 15 May 22 16 May 23 17 May 24 18 May Travel to Mogadishu from Garowe as per UNHAS flight schedule Meeting arrangement s for the team Partner meetings Partner meetings Partner meetings Travel to Nairobi from Mogadishu 25 19 May 26 20 May 27 21 May 28 22th May 2014 Debrief and sharing outcomes of the mission with the senior management and Project management Drafting report Drafting report Team Departure Travel to Mogadishu TBC MIA guest house check-in AbdulhakimMohamed Barre TBC Hotel Check-in Consultants responsibilities Meeting with different Senior Management, PPU and Project Management Mehmood and Albert Soer UN Girgiri TBC Keziah Evaluation MISSION 4th – 8th May 2014 Date & Time Activity Location Sunday 04/05/2014 Arrival to Hargeisa 90 Focus Status Ambassador Hotel Check-in TBC 11:00 - 12:00 Meeting with SIDP Staff in Hargeisa and Head of Sub-Office 13:10-14:00 UNCC Compound/SIDP office Samira Confirmation of bookings and reservations Brief background of partners and project Sergei and Samira LUNCH BREAK 14:00-14:40 Security Briefing 16:10-18:00 Discussions with CSI Senior management (the whole team) UNDSS CSI offices Samira Civil Service Institute Samira Monday 5/05/2014 8:30-10:30 Discussions with Civil Service Commission senior management (the whole team) CSC offices 10:40-12:40 Discussions with the Accountant General Office Mr Mohamed Bade ( Michael Palmbach) AGO Office Accountant General Samira + Sergei 10:40:12:40 Discussions with the Ministry of Planning (Kerry Abbott) MoNP&D Ministry of National Planning and Development Sergei 13:00-14:00 14:00-16:00 Samira+ Sergei LUNCH BREAK Discussions with the Parliament (Speaker, Deputy Speakers and Secretary General) House of Representatives Work done by the Parliament under SIDP Samira+ Sergei Auditor General Office Auditor General work done during SIDP engagement Samira+ Sergei GGACC Office Good Governance work done with SIDP UNDP/SIDP Office UNCC ( the whole team) Tuesday 6/05/2014 8:30-10:00 Discussions with Auditor General Office (Michael Palmbach) 09:10-11:40 Discussions with Good Governance and Anti-Corruption Commission (the whole team and later will be joined by Michael) 11:50-13:00 Team to consolidate their notes 13:00-14:00 LUNCH BREAK 91 Sergei 14:00-16:00 Work on the report Wednesday7/05/2014 07:30 – 16:00 Work on the report Thursday8/05/2014 09:30 Departure to Garowe 92 Annex – Evaluation objectives and questions answered Question #1 :Achievement of Intended Outputs: to examine to what extent the project has achieved the intended outputs and in what specific areas the project excelled or failed in progress toward intended outputs The project has an ambitious agenda and short supply of resources- both human and financial Nevertheless, the project has been able to establish an identity for itself and has been able to institutionalise recruitment, training, employee data base, customs collection, audit, and certification of accountancy Question #2: Achievement of Intended Impacts/Outcomes: to indicate whether or not intended project impacts and outcomes are being met and/or for specific outcomes whether satisfactory progress was made In this area the project has been able to contribute substantially, however a lot has to be done Details are given in the main document Question #3:Factors Influencing Project Outputs and Impacts: to analyse underlying factors that are influencing project impacts and outputs Many factors influenced the project delivery like changing governments seven times, changing project managers, less resources than planned, not deploying full complement of staff, security, relocation of office, bombing all impacted project delivery Question #4:Barriers and Constraints Delaying Implementation: to identify and analyse barriers and constraints that have delayed implementation including challenges emanating from internal and external sources Internally it was recruitment and procurement of personal, changing project leadership, and non-deployment of required staff Externally, ownership issues, internal conflicts within the line Ministries, security and changing governments 93 Question #5:Lessons Learned: To identify a list of ’lessons learned’ and make recommendations for corrections including in relation to i) the specific CD services provided by the project (are they appropriate for the client and they respond to the demands and felt needs of the client?); and ii) the sourcing of capacity (what is the general experience and are steps be taken to source capacity from institutions and networks beyond those considered under the project?) A list of lessons learned is elaborated in the main document More, particularly, partnership development, alignment with national development agenda, ownership issues, and deployment of experts need consideration Question #6: Future Directions: Extract the lessons learned and best practices that can be considered in the planning and design of future support activities for government and recommendations for future direction and areas of focus for the next phase of project Detailed in the document For example, Ministry of Labour, Puntland, Civil Service Institute, Somaliland, Office of the Auditor General Puntland, Customs collection at Bosaso port are some of the examples Question #7:Sustainability of Current and Planned Outputs: To state whether or not targets are being achieved and whether current and planned outputs can be sustained including determination of measures needed to ensure continued sustainability of results in the future Answered document in the main Question #8: Issues of Security in Relation to Project Implementation: Review the project progress recommendations and action plan in light of the prevailing security situation in South and Central Somalia Somaliland and Puntland Answered document in the main 94 ... duplicate the report The evaluation report of EC of 2012 is not disputed by the evaluators The EC report has considered the situation prevailing during the period under their evaluation This evaluation. .. the present evaluation, the draft progress report was submitted to the European Union However, the report had not yet been formally endorsed or approved 1.1 Evaluation Themes and Evaluation Questions... results and data as far as possible The report follows the standard format of evaluation reports Evaluation questions are answered for each of the thematic area of evaluation, better appreciation of