Building a system to manage project and performance for ngos

Proceedings the 10th students scientific research conference Building a system to manage project and performance for NGOs Group sciences: Lê Ngọc Nhung Nguyễn Thị Thu Hoài Văn Thị Hoài Thương Nguyễn Quang Huy Lê Hà Trung Class: MIS2015A Science Dr Phạm Thị Huệ advisor: Ms Trần Thị Hải 40 Proceedings the 10th students scientific research conference LITERATURE REVIEW Introduction The concept of project management emerged in the 1950s when organizations put technical systems into practice to manage complex technical projects This milestone marked the beginning of the project managers have been developing until at present Project management is the practice of initiating, planning, executing, controlling, and closing the work of a team to achieve specific goals and meet specific success criteria at the specified time (Wikipedia) There are some ways to approach the project management such as: Phased, Lean, Interactive, and Incremental Expanding project planning based on outcome (impact) or activities (progress-based) According to a successful research of Mesly in 2017, a successful project is based on four factors, called “four P's” The first is a smart plan, to judge the circumstances that may occur in the future The second is progress with a holistic approach for both staff and managers based on activities The third is people, the effectiveness of human resource management in the project along with the responsible enthusiasm of the staff The last is power from finance, policy (Mesly, 2017) Any successful in project activities or project management success is demonstrated through outcome and impact The approach is based on target, timeline and cost to define the responsibilities roles of participants and stakeholders Key Performance Indicators (KPIs) and four key performance areas in an NGO To enable effective management, “collecting the right information” is the crucial first step to manage in order to create insights for management actions In order to that, Key Performance Indicators (KPIs) need to be identified KPI is a type of performance measurement which evaluates the success of an organization or of a particular activity It will answer the question “what information should be looked for?” A Management dashboard usually contains many KPIs highlighting complementary aspects of an organization to enable management action Ideally, dashboard should be automated and fed with regular new input data Together with policies and procedures of the organization, a dashboard, which is a strategic visualization of the progress against the KPIs help to ensure that tasks are completed 41 Proceedings the 10th students scientific research conference timely and effectively to achieve the goal (FitSM Part 0: Overview and vocabulary, 2015) An NGO is typically run with most of their resources on implementing projects, funded either through direct individual donations and public funding from both public (government aid and private sector funding) Supporting functions, depending on the size and scale of the NGOs, can include from Finance & Administrative function (where IT can be separated or as a part of administration service), Human Resource Management, Marketing and Communications, Fundraising and Partnership, Monitoring and Evaluation and Learning/Research These different aspects of an organization management can be grouped into four typical dashboards ● A Financial KPIs dashboard to prove the profitability and development of an organization or a business Their stockholders, investors, and customers will use the financial dashboard to assess the performance and viability of the organization (Financial Metrics and KPIs, 2018) ● An Human Resource Management Dashboard looks at “How functional or supporting departments are doing?” and “Whether staffs have achieved the targeted or planned performance?” Human Planning and Resource is a key component in Operation KPIs (What is operational dashboard?, 2004) ● A Progress dashboard reflects on the performance of the different projects in It is a great asset to keep portfolio managers aware of the schedule or completion across the organization (Karola, 2015) ● An Impact/outcome dashboard highlights the achievements relating to changes to society as a result of all the above mentioned organizational management efforts and funding supports from donor These results might only be available after a long time of interventions by the organization (Impact Dashboard, 2017) Necessity Public scrutiny has become more demanding to grant receiving organisations like NGOs Organizations need to show both credibility to public via communicating their results and making their business performance more visible via annual report or other forms of accreditation process This is even more a crucial matter where the funding source to these NGOs are become stricter and increased competition between 42 Proceedings the 10th students scientific research conference NGOs and even Government organization applying for aid funding or public and foundation grants Gaining trust from both public with persuasive presentation of project outcomes are increasingly important WWF Greater Mekong has embarked on the process of building an organizational wide management information system since 2010 whereas other NGOs in Vietnam, given their small size of organization and lack of OD funding, information on different functions are still fragmented and take time to aggregate for management However, even with a dedicated function, M&E set up, it is a steep learning curve for the organization in evolving their tool to a truly organizational wide application, where cost is a major push back and the deployment issues Advantages and disadvantages of popular tools Out of these needs and gaps in tool for organizational wide management information system, this research aimed to find out a solution that a typical IT person or business controller of an organization would be able to customize to set up a solution to collect and analyze organization performance data with low cost The currently popular online applications such as Commcare and ODK, and Google Spreadsheet versus the traditional, offline tools of Excel were considered 4.1 ODK Open Data Kit (ODK) is developed by the University of Washington Computer Science and Engineering department as an open source suite of tools Mostly popular for collecting data via mobile devices and data submission to an online server, even without an Internet connection or mobile carrier service at the time of data collection Data then can be hosted Then, host your data online using Google's powerful hosting platform, Google AppEngine, and visualize your data as a map using Google Fusion Tables and Google Earth ODK would be especially suitable for the need of collecting large survey and eliminate the administration of records in paper forms The questions need to be predesigned The option of sequential linking to a previous response is not possible to set up Hence, ODK would only best suitable for a particular task of collecting data in a project or a department in an organization, but would not be suitable as a platform to integrate various organization information to produce even a simple version of 43 Proceedings the 10th students scientific research conference dashboards with various organization KPIs In addition, the fact that ODK is not a hosted solution means it would be only available for organization with a server set up 4.2 Commcare Commcare is a commercial solution, building on the idea of ODK and thus has been able to make it more user-friendly for those who need to set up a solution to collect information via forms of surveys The ability to track or monitor a case over time is particular relevant for the need of organization KPI tracking For example, monitoring the performance of a staff over time, or of the impact changes of a particular site11 While Commcare offers different pricing options to use, including a free 30-day trial, the dashboard feature is not ready until a plan is paid Due to this requirement, we are not able to complete the whole exercise of demonstrate a complete system on Commcare to collect and analyze and show the results of KPIs However, it showed that technically, it is more user friendly than ODK 4.3 Excel Excel is one of the tools we tried and it showed that it is possible to collect data and visualize KPIs at organizational scale on Excel, utilizing various features such as calculations, charting, data filtering, etc However, the inability to collaborate online without Office 365 is the biggest drawback to this solution The option of using free Dropbox account would mitigate this but it is very likely that someone would misuse the tool, e.g accidentally delete, or the problem of handling conflict versions when two users access forms at the same time One possible solution to work around with Excel is to create forms and integrate data via Microsoft Access However due to the knowledge and time limitation of the research group, we have not been able to test this solution Our solution We aimed to produce a completely free solution to use for an NGO to collect and manage and analyze their data for analysis of organizational level KPIs We used inputs and real experience of WWF Vietnam and WWF Greater Mekong to shape our solution Particularly, in the interviews with WWF, our question mainly focused on the system they are using, and its drawbacks and what management questions they use as 11 Commcare, https://confluence.dimagi.com/display/commcarepublic/Case+Management 44 Proceedings the 10th students scientific research conference well as kind of data being collected It is clearly mentioned that NGOs staff prefers a light system which does not require IT knowledge to use and set up, but with analytical and online collaboration features because users of such system are working from various geographical places Thus, a platform that can address the need of both reporting staff and senior managers and being cloud-based and multi-device accessibility is essential We demonstrated in this research a free solution addressing the above requirements with integrating four Google services and tools: Google Form, Google Spreadsheet, Awesome Table, and Google Site This solution meets various immediate needs for organizational data management First, it is free and allows multiple editors while keeps track of all changes made to a document Collecting information online by using Google Form hence becomes easier, saves time and money than traditional paper data collection., which helps us easily create surveys to gather information from employees The inputs from Google Form will be stored automatically to a Google Spreadsheet, which has a lot of functions like Excel such as data filtering, charting Manager of a form will also be automatically updated when there are any changes We use Awesome table feature to publish monitoring information from google spreadsheet and embed it to a Google Site This allows users with correct right setting, can edit information if there are errors, rather than having to notify the admin and cutting the waiting time The novelty and creation We develop a prototype of a free solution for organization data collection and analysis based on a set of suggested KPIs Although this topic is very necessary, there is little information available on such tool Rather, what we have found are commercial solutions that requires investment on servers and subscription fee, which would be a luxury for a small NGO or it requires some IT expertise to set up and customize METHODOLOGY Case study The case study research method is the most widely used qualitative research method in information systems research and is well suited to understanding the interactions between information technology 45 (IT)-related innovations and Proceedings the 10th students scientific research conference organizational contexts Much of the discussion of case study research within information systems has centered on the different philosophical perspectives, which may be adopted (in particular, the positivist and the interpretive approaches), and their particular implications for data collection and analysis methods and for research outcomes (Izak, David & Melissa) The case study is an up-close, in-depth, and detailed study of a particular situation rather than a sweeping statistical survey to narrow down a very broad field of research into one easily researchable topic It examines a phenomenon in its natural setting, employing multiple methods of data collection to gather information from one or a few entities (people, groups, or organizations) The motivation for the use of theory in the earlier stages of interpretive cases studies is to create an initial the theoretical framework which takes account of previous knowledge, and which creates a sensible theoretical basis to inform the topics and approach of the early empirical work (Walsham) Moreover, the case study is particularly well suited to IS research because the technology is relatively new and interest has shifted to organizational rather than technical issues, and case studies can provide the organizational context for the study of the relationship between strategy and information technology (Izak et al.) In the information system, the case study is ‘an empirical inquiry that investigates a contemporary phenomenon within its real-life context, especially when the boundaries between phenomenon and context are not clearly evident’ and it ‘relies on multiple sources of evidence’ (Yin, 1996) Case study research can be used to achieve various research aims: to provide descriptions of phenomena, develop theory, and test theory Case study research has often been associated with a description and with theory development, where it is used to provide evidence for hypothesis generation and for exploration of areas where existing knowledge is limited (Cavaye, A.L.M & Cragg, P.B., 1995) For our research, we studied our case study at WWF - one of the largest and the most prominent NGOs in the world For more than half a century, WWF has been working to protect world’s species and natural places, pushing for the more sustainable world WWF has a presence in over 100 countries across the world, and their efforts have involved from localized efforts in favor of a single species and individual habitats to ambitious strategy to 46 Proceedings the 10th students scientific research conference preserve biodiversity and achieve sustainable development across the planet WWF has a long- established presence in the Mekong region, starting in Vietnam in 1990 Since then, WWF operations have grown to four Country offices based in Cambodia (Phnom Penh), Laos (Vientiane), Thailand (Bangkok) & Vietnam (Hanoi), including a Regional team in the Hanoi, Vientiane and Bangkok offices WWF is one of the leading NGOs in the world, with many years of experience in managing an international project at a variety of locations Therefore, with a topic we chose, WWF is extremely suitable Furthermore, our team has been offered directly guidance from senior management on information systems managers at WWF During our internship, we have been familiarized with, and gained the insights on how a management system is used for management purposes as well as the need for improvements of such system 2.System development life cycle (SDLC) Another methodology we use is “System Development Life Cycle” to build and develop our application The systems development life cycle (SDLC), also referred to as the application development life cycle, is a term used in systems engineering, information systems, and software engineering to describe a process for planning, creating, testing, and deploying an information system The systems development lifecycle concept applies to a range of hardware and software configurations, as a system can be composed of hardware only, software only, or a combination of both It is a methodology used to describe the process for building information systems, intended to develop information systems in a very deliberate, structured, and methodological way, reiterating each stage of the life cycle The systems development life cycle, according to Elliott & Strachan & Radford (2004), "originated in the 1960s, to develop large-scale functional business systems in an age of large-scale business conglomerates Information systems activities revolved around heavy data processing and number crunching routines (Wikipedia) In “the system development life cycle, there are six steps, including planning, analyzing, designing, implementing, testing and maintaining Our product is created based on these steps The first step in SDLC is planning Without the perfect plan, calculating the strengths and weaknesses of the project, development of software is meaningless 47 Proceedings the 10th students scientific research conference Planning kicks off a project flawlessly and affects its progress positively (Tyagi, 2016) Therefore, we have started with a detailed plan of what to do, how long it took, how to it, and divided the work for the team members After planning, the next step is analysis In Tyagi’s report shows that: “This step is about analyzing the performance of the software at various stages and making notes on additional requirements Analysis is very important to proceed further to the next step.” In this step, we also analyzed the necessity for developing this application This helped everyone involved in the project clear of the expectation We have analyzed a number of different popular tools In this report, we showed the strengths and weaknesses of these tools After all the above analysis, we decided on one solution, Google Applications, including Google Forms, Google Spreadsheets, Awesome Table, and Google Site to take the next steps The third step in SDLC is designing Once the analysis is completed, the step of designing takes over, which is building the architecture of the project This step helps remove possible flaws by setting a standard and attempting to comply with what was set (Tyagi, 2016) This step has taken most of our time The first thing we did was building KPIs in four components: finance, human resources (HR), progress, and impact There is a strong link between these components since information flows across the functional areas of finance Project or progress we designed with detailed instructions on our site to collect data from users and to ease the process of filling in information for users Our tools were designed for managing and analyzing information in all four components with a visual interface and easy-to-use functions The next step is developing and implementing According to Tyagi, “The actual task of developing the software starts here with data recording going on in the background Once the software is developed, the stage of implementation comes in where the product goes through a pilot study to see if it’s functioning properly.” After we finished designing, we continued to build and develop the forms with sets of indicators Forms are created to get information from employees with clear description in each information box, e.g information about new and old projects, basic employee information, employee performance evaluation, or project progress, etc Testing is one of the most important steps in SDLC after we designed, developed, and implemented the system The testing stage assesses the software for 48 Proceedings the 10th students scientific research conference errors and documents bugs if there are any (Tyagi, 2016) We had to test many times to get the final product During the testing process, there were many problems, so we had to fix those errors from the redesign of the forms to the export of information from the forms to the tables, calculations, statements Final yet important step is maintaining the process Once the software passes through all the stages without any issues, it is to undergo a maintenance process wherein it will be maintained and upgraded from time to time to adapt to changes (Tyagi, 2016) Maintaining is an extremely important step for a software product A product is good but it still needs maintenance, and upgrades to be able to operate longer However, testing the prototype developed with a variety of organization is beyond the scope of our research Data collection Multiple data collection methods are typically employed in case study research Ideally, evidence from two or more sources will converge to support the research findings The goal is to obtain a rich set of data surrounding the specific research issue, as well as capturing the contextual complexity (Izak et al) The data we collected was from interacting with current WWF systems, desk research, interviews and expert consultation with key WWF Greater Mekong and Vietnam staff We collected data from various sources documents not only in WWF website (wwf.panda.org) but also in some other organizations that have the similar organizational goals with WWF, such as WCS (Worldwide Conservation Society), FFI (Fauna and Flora International), and so on The documents were annual reports about finance, HR, progress, and impact, forms, tables, dashboards etc to show how those organizations work and how their jobs, projects impact nature, especially the forest This information is important for us to construct key functions of our systems and be informed of the KPIs used in NGOs For example, in the finance, we designed and developed features to manage cash flows, income, fundraising, types of investors, etc The purpose of the research interview is to explore the views, experiences, beliefs, and/or motivations of individuals on specific matters (Gill, Stewart, Treasure & Chadwick., 2008) We interviewed a professional manager of forest projects in Vietnam at WWF and collected more specific and realistic information about what the business does, the strengths, and the weaknesses of the project management system 49 Proceedings the 10th students scientific research conference - Timeliness: This is to make sure that projects are completed on time—and if it’s not, tracking where it’s off-target is important This is a measure to ensure an estimated completion date It is important KPIs that can present how effective projects and departments are Because time is always one of the significant factors which directly affect to project progress and departmental work progress Each phase completes on time, each activity completes on time that leads to the project will complete on time and this is similar to departmental work cases Timely completion of projects not only saves time and money for the project, but also affects directly to the whole community, both the organization and the society where are received benefits from that project - Quality or Effectiveness: This answer for those question: How well has the project progressed? Are those working on it or benefitting from it satisfied? Are you spending your time and money appropriately, or could you be managing the project more effectively? Besides time problem, quality plays a key role in project activities or department works All staffs and managers have to balance time and quality of works and activities because both of them are a very important factor to evaluate the performance of department and performance of project as well Moreover, this KPI also helps the top managers assess how effective and beneficial which project brought to society more efficiency Thus, they can decide what next step and oriented for later projects (15 important project management KPIs) 2.4 Impact 2.4.1 What is an Impact? “An impact concerns long-term and sustainable changes introduced by a given intervention in the lives of beneficiaries Impact can be related either to the specific objectives of an intervention or to unanticipated changes caused by an intervention; such unanticipated changes may also occur in the lives of people not belonging to the beneficiary group Impact can be either positive or negative, the latter being equally important to be aware of”’ (Blankenberg, 1995.) 2.4.2 Impact for NGOs Impacts in an NGO commonly understood as the changes related to society, environment, etc that a NGO creates through their activities 74 Proceedings the 10th students scientific research conference Unlike other departments with clear KPIs such as HRM with staff performance, Finance with Expenditure KPI, impacts are often difficult to measure and predict Different projects carry different goals Each project aims for different impacts or objectives, hence requires different KPIs to evaluate For example, an education project in disadvantaged areas will require the KPI such as the number of children in attendance in the area of a project on sea water that will require the intake of trace elements in the water Impact KPIs thus need to be set according to the goal or ambition set out by a particular project It is affected by many factors such as natural conditions, weather, natural disasters or human factors, habits, culture and political context In addition, it is hardly possible to isolate the project's impact from any other influence and there are no specific rules Lastly, measuring impacts normally require intensive costs Typically, a project is designed using a result chain logic, which sets out a logical pattern of how successive and conditional inputs, activities, and outputs that an intervention can directly affect, could lead to more distant outcomes and impacts (Energypedia).KPIs or performance indicators are developed for each level of result chain With the desired impact, the NGOs can add their desired KPIs to create a set of KPIs for each project However, within an organization or a group of organization working on the same issue, it is possible that they adopting different strategies to achieve the same development goal Thus, it is possible to devise a few common impact indicators, which are long term and worthy to track to see changes over time 2.4.3 Data point 75 Proceedings the 10th students scientific research conference Figure 28: Impact Data point For the purpose of demonstration, we set up the forms to collect and visualize impacts for the following areas: ● Restoration, collecting data related directly to forest ● Beneficiaries, indicators of the people getting both benefits in financial and capacity increase from the project These indicators or impact KPIs can be easily renamed, dropped or added, depending on the context of the NGOs Particularly, in this case, it is set up so that under Beneficiaries KPIs, it is tracking number of people trained, number of volunteer and total money paid In total, there are: - One Google sheet, named Impact summary, summaries key achievements per location and can be associated with each grant or a number of grants - Two Google forms, Restoration and Beneficiaries where project staff can update the actual achievement by each reporting period and the corresponding Google Sheets Restoration and Beneficiaries containing responses each time a staff update the respective Google form - One tab on the Google sites for viewing details data 76 Proceedings the 10th students scientific research conference Location name is a drop-down box with options are pre-defined from Parameter sheet Project name, Grant is linked with data from Finance department At beginning of a year, the admin will obtain information from a project manager, including project location, target for each reporting period A Google sheet, Beneficiaries so that there is a row for each location or site per reporting period When it is time for reporting, staff will go to the Impact section on Google site, filter by Time period, on the visualization generated by Awesome table By clicking on the URL, the staff will take to an pre-populated Google form where he or she can update the required information fields such as number of people trained planned, number of people trained actual, number of volunteer and total money paid Similarly, a staff in charge of Restoration will provide information on target of seedling produced, seeding growth, restoration area and cost of seedling per each location for each reporting period (time period) A Google sheet, Restoration will be set up so that there is a row for each location or site per reporting period When it is time for reporting, staff will go to the Impact section on Google site, filter by Time period, on the visualization generated by Awesome table By clicking on the URL, the staff will taken to an pre-populated Google form where he or she can update the required information fields such as actual seedling produced, actual seeding growth, actual restoration area and actual cost of seedling per each location for each reporting period (time period) The Impact Summary is a Google Sheet that aggregates the two most key information from the Beneficiaries and Restoration, per location, or per project or per grant 2.4.4 The finding and development of KPIs Following the result chain methodology, in this example, restoration and beneficiaries indicators can be divided into categories: goals and outcomes - The effectiveness of Restoration:This KPI is calculated as the area with forest tree actually planted divided by the area of forest tree should be planned in the target This tells the manager whether the project is going to exceed the expectation When comparing between projects, a manager will be able to see which project is doing better than other Alternatively, similar comparison by locations can be done depending on what insight the NGO wants to know 77 Proceedings the 10th students scientific research conference - The percentage of seedlings grown and survived compared to the number of seedlings planted shows the degree of effectiveness of the restoration technique training and care It shows that the planting and care are effective - Beneficiaries: In addition to direct forest restoration, changing practices and participation of beneficiaries are important in forest protection.The number of volunteers dividing the number of trained people demonstrates the effectiveness of such training Again, the comparison of actual results with the target or plan of providing an overall view of the effectiveness of each project or can be zoomed in for each location Alternatively, the KPI can be absolute actual amount, being some specific indicator itself, in order to show the outcome of the project or on what they have achieved - The effectiveness of each project on the amount spent impact or outcome of each project as expected by the donors: By linking the grant information with the impact data on beneficiaries and restoration, the correlation between the two information, the actual achievement of percentage of beneficiaries in each grant compared to target versus the size of the grant, to see if size of grant matters RECOMMENDATION & CONCLUSION This research proposed and prototype an online free solution that an NGO can use to collect, visualize and present its data using available free technology based on a set of most critical KPIs to assess the performance and effectiveness of an NGO Specifically, the solution leverage Google Drive as a free, cloud hosting solution, Google forms to collect data, Google Sheet for storing raw data and analyzing, Awesome table as an example of available Google Apps Script to query, filter database and Google sites as a visualization landing page and communicate the results of the data collected and insights Strength A software or system is considered completed and perfect only if it is easy to use, easy to maintain, maximized cost and time to build and develop but still meet the needs of customer requirement Therefore, the product which is developed based on 78 Proceedings the 10th students scientific research conference the results of this study partly met the requirements that organizations are lacking and offering Firstly, the most important strength of this product is free of charge While all systems are commercially oriented, these products are still open-source, and businesses can use this product to meet the needs of the enterprise, especially in NGOs, and small and medium enterprises Most businesses and organizations now use Google applications such as Gmail, Drive, and so on This solution also makes full use of the Google Drive applications, built from useful and friendly applications for users Therefore, users can easily perform functions as everyday tasks It also did not require a highly functional complication setup or costly setup to run Basic installation steps such as form building, site layout design can be made by non-technical skill people In contrast to these Google applications, the design of forms, surveys, reporting in other open source software such as Commcare, as well as ODK, are very difficult if users not have the deep knowledge or training on the use of these two applications Furthermore, this product is developed based on Google support tools as Google sites, Google Form, Awesome-Table, Google Spreadsheet so it finds easy to integrate data and information among projects and departments which have some common kind of data without converting types of suitable data to each tool or application In addition, Google is a great leader in technology, so Google applications will also be upgraded over time Google is still growing, with more and more new applications that are built to meet the needs of the organization Therefore, this product can always catch up with the market demand Another strength is the user-entered information is automatically saved, so it can be prevented the unexpected events Moreover, because of cloud-based products, when a hardware failure because of a fire or a disaster, the data is still stored and not lost Besides, instead of needing a lot of people to enter the data into the system that makes inaccurate, inconsistent or redundant information, this product just needs one person to act as an admin, who will create, build forms an interface for the site based on the available design, and enter basic information 79 Proceedings the 10th students scientific research conference Weakness Anything always has both strengths and weaknesses, and this product is not an exception Such as additional costs, limited data space and user interface customization Since it is a free product on the cloud computing platform, there is still limitations storage For large enterprises with large storage capacity, they need to be upgraded to pay for more storage space; However, the update package has certain limitations This is a major drawback that the researcher cannot yet overcome This makes the product suitable only for medium and small organization The problem may be resolved through updates in future The product is still using the cloud service of third party company, so the security features are still dependent on which platform is being used Therefore, it can be vulnerable and attacked The researcher team highly recommend users to consider upgrading to enterprise cloud service for more secure protection In addition, the product has a friendly interface but is not free for designing deeply and adjusting If users want a professional interface, the paid version provides further fine-tuning of the code that allows customizing the interface Conclusion This research plays a very important role in project management and performance for NGOs and businesses Nevertheless, within the time limits of research, this solution can not meet all the entire business requirements and overcome all the weaknesses The following research will focus more on automation in project information management and performance and the results achieved when putting into real-life 80 Proceedings the 10th students scientific research conference REFERENCES [1] (2017) (n.d.) 15 important project management KPIs Retrieved from https://www.clearpointstrategy.com/ [2] 150 opensource, free and top dashboard software (n.d.) Retrieved from 2018 https://www.predictiveanalyticstoday.com/open-source-dashboard-software/ [3] Kevin Cress (2009) types of information systems (n.d.) Retrieved from https://www.mindmeister.com/37310006/5-types-of-information-systems [4] Cavaye, A.L.M & Cragg, P.B (1995) Factors contributing to the success of customer-oriented interorganizational In Journal of Strategic Information Systems, (pp 13-30) [5] (n.d.) Defining Financial Stability Retrieved from https://www.mnb.hu/en/financial-stability/defining-financial-stability [6] FFI (December 31,2016) ANNUAL REPORT AND CONSOLIDATED FINANCIAL STATEMENTS [7] (n.d.) Financial Flexibility Retrieved from 2018 https://www.moneyzine.com/definitions/investing-dictionary/financial-flexibility/ [8] Financial Metrics and KPIs (2018) (n.d.) Retrieved from https://www.klipfolio.com/resources/kpi-examples/financial [9] (2015) FitSM Part 0: Overview and vocabulary [10] Grant management software (n.d.) Retrieved from https://en.wikipedia.org/wiki/Grant_management_software [11] Griffee, D T (n.d.) Research tips: Interview data collections [12] Impact dashboard (n.d.) Retrieved from 2017 https://www.bepress.com/products/expert-gallery-suite/features/impact-dashboard/ [13] IUCN (2016) Report of the statutory auditor to the Council on the consolidated financial statements [14] Izak Benbasat, David K.Goldstein, Melissa Mead (n.d.) The case research strategy in studies of Information Systems Boston, Massachusetts: Harvard Business School, Harvard University [15] Karlson, K (2016) 29 popular financial KPIs for your financial KPIs Dashboard Retrieved from https://www.scoro.com/blog/financial-kpis-for-financial-kpidashboard/ [16]KPI Dashboard Software (n.d.) Retrieved from https://www.scoro.com/kpidashboard-software/ [17]Leis, M (2017, May 13) 23 Best KPI Dashboard Software & Tools Reviewed Retrieved from https://www.scoro.com/blog/best-kpi-dashboard-software-toolsreviewed/ [18]Lewis, M R (n.d.) How to reduce financial risk Retrieved from https://www.wikihow.com/Reduce-Financial-Risk 81 Proceedings the 10th students scientific research conference [19]Long-term Finance (n.d.) Retrieved from http://www.worldbank.org/en/topic/longtermfinance [20]Mesly, O (2017) Project feasibility - Tools for uncovering points of vulnerability New York: Taylor and Francis, CRC Press [21]P Gill, K Steward, E Treasure, B Chadwick (22 March 2008) Methods of data collection in qualitative research: interviews and focus groups Retrieved from https://www.nature.com/articles/bdj.2008.192 [22]Pepfar Management Dashboard SOP (2015) Medford, Massachusetts 021555741 USA Retrieved from https://www.lmgforhealth.org/sites/default/files/LMG_PEPFARsop_Final_interactivev _0.pdf [23]Peta Darke, Graeme Shanks, Marianne Broadbent (1998) Successfully completing case study research: In Info Systems J (pp 273-289) [24]Top 53 Business Intelligence Companies (n.d.) Retrieved from https://www.predictiveanalyticstoday.com/top-business-intelligence-companies/ [25]Transaction Process System (TPS) (n.d.) Retrieved from https://www.techopedia.com/definition/707/transaction-process-system-tps [26]Tyagi, G (2016) Stages of Software Development Process Retrieved from https://www.synapseindia.com/6-stages-of-software-development-process/141 [27]Walsham, G (n.d.) Interpretive case studies in IS research: nature and method Department of Management Science, The Management School, Lancaster University, UK [28]WCS (2016) 2016 Annual Report [29]WCS (2016) Annual report [30]Karola Karson (November 17, 2015) What is a KPI tracking Dashboard? The complete guide (n.d.) Retrieved from https://www.scoro.com/blog/what-is-kpitracking-dashboard/ [31]What is data dashboard (n.d.) Retrieved from https://www.klipfolio.com/resources/articles/what-is-data-dashboard [32]What is operational dashboard ? (n.d.) Retrieved from 2004 http://www.taskmanagementguide.com/glossary/what-is-an-operationaldashboard-.php [33]Wikipedia (n.d.) Customer relationship management Retrieved from https://en.wikipedia.org/wiki/Customer_relationship_management [34]Wikipedia (n.d.) Data analysis Retrieved from https://en.wikipedia.org/wiki/Data_analysis [35]Wikipedia (n.d.) Executive information system Retrieved from https://en.wikipedia.org/wiki/Executive_information_system [36]Wikipedia (n.d.) Project management Retrieved from https://en.wikipedia.org/wiki/Project_management 82 Proceedings the 10th students scientific research conference [37]Wikipedia (n.d.) Systems development life cycle Retrieved from https://en.wikipedia.org/wiki/Systems_development_life_cycle [38]WWF (n.d.) Retrieved from wwf.panda.org/ [39]WWF (2010) Glossary [40]WWF (2015) WWF-INT Annual Review 2015 [41]WWF (2016-2017) WWF-UK annual report and financial statement [42]Yin, R (1996) Case Study Research: Design and Methods, 2nd edn Sage Publications, Thousand Oaks [43]Energypedia (n.d.) Retrieved from https://energypedia.info/wiki/Millennium_Development_Goals_(MDGs)_and_Result_ Chains) [44](n.d.) http://www.worldbank.org/en/topic/longtermfinance [45] (n.d.) Non-government organization Retrieved from https://en.wikipedia.org/wiki/Non-governmental_organization [46] (n.d.) SDLC Retrieved from http://databasemanagement.wikia.com/wiki/SDLC 83 Proceedings the 10th students scientific research conference APPENDIX Home Figure 29: Home page 84 Proceedings the 10th students scientific research conference HR Figure 30: HR page Impact 85 Proceedings the 10th students scientific research conference Figure 31: Impact page 86 Proceedings the 10th students scientific research conference Finance Figure 32: Financial page 87 Proceedings the 10th students scientific research conference Progress Figure 33: Progress page 88 ... beneficiaries and managers can look at a financial dashboard to assess the performance and viability of a NGO (Financial Metrics and KPIs.) Moreover, using a financial dashboard can help manager making... data, Google Sheet for storing raw data and analyzing, Awesome table as an example of available Google Apps Script to query, filter database and Google sites as a visualization landing page and. .. tool, mainly because the data and information will hold no value to the manager if it not serving its purpose A system must have a way to indicate the data and information that the manager wants