Finland

The Evaluation Management Services (EMS) was a service contract which consisted in the implementation of strategic and policy-level evaluations, meta-evaluations, project-level evaluations and assessments for the Ministry for Foreign Affairs of Finland (MFA). It corresponded to a model that is based on evaluation services commissioned to one service provider rather than outsourcing the implementation of each evaluation as a single assignment. The purpose of this contract was to increase the quality of outsourced evaluations and also to increase flexibility, efficiency and effectiveness of the MFA of Finland in planning and commissioning evaluations. In addition to some decentralised (project level) evaluations and assessments from various geographical units, all MFA centralised evaluations were prepared and implemented through the EMS.

The assignments that were implemented under this service contract are the following:

• Evaluation on Development Cooperation carried out by the Department for Russia, Eastern Europe and Central Asia, Including The Wider Europe Initiative (WEI).
• External Review and Evaluation Services of forest programmes in Tanzania
• Evaluation on the transition towards a new partnership between Finland and Vietnam
• Evaluation on water diplomacy in the context of Finnish development cooperation – lessons for the future
• Evaluation of ICI Projects in Afghanistan, Bhutan, India, and Nepal
• Meta-evaluation of MFA's projects and programme evaluations in 2018-2020
• Evaluation of the Finnish Development Policy Influencing in the European Union
• Evaluation of Finnish Humanitarian Aid
• Assessment on the Response of Finnish Development Policy and Cooperation to the Covid-19
• Final Evaluation of Rural Village Water Resources Management Project (RVWRMP) 2006-2022 and Post-evaluation of Rural Water Supply and Sanitation Western Nepal Project (RWSSP-WN) 2008-2019
• Facilitated assessment of Finnish peace, democratization and sustainable livelihoods support in Myanmar
• Evaluation of Finland’s International Climate Finance
• Evaluation of Human Rights-Based Approach (HRBA) in Finland’s Development Policy and Cooperation
• Review of the MFA’s support to international recruitment
• Evaluation on Development Communications in the Context of the Ministry for Foreign Affairs Finland
• Right to Education, Right to Learn – Evaluation of Finnish Development Policy and Cooperation in the Education Sector
• Evaluation of Finland’s initiatives focused on enhanced domestic resources mobilization (DRM)
• Meta-analysis of Country Programmes 2021–2024

The ultimate purpose of the forward-looking evaluation was two-fold. Firstly, it informed the MFA on the effectiveness, coherence and relevance of climate finance and what kind of results had been achieved with the various development policy and cooperation instruments over the period 2016-22. Secondly, the evaluation provided information and supported the implementation and further development of the Action Plan for Finland’s Public International Climate Finance to maximize the effectiveness and impact of Finland’s climate finance, especially regarding long-term planning and coordination of climate finance as a whole.

The specific objectives of the evaluation were

• To assess the results of Finland’s international climate finance and policy influencing in directing finance, with due consideration of the opportunities and barriers at both national and global levels
• To assess the relevance and coherence of Finland’s international climate finance
• To assess the functioning of partnerships and co-operation in climate change mitigation and adaptation and whether the current balance of partnerships of Finnish influencing is optimal
• To study relevant peer countries’ experiences in order to learn best practices
• To provide well-justified and evidence-based recommendations on how the MFA together with relevant stakeholders could further improve their actions for a more effective, coherent and relevant response to developing countries’ climate finance needs and for funding priorities through the different cooperation instruments

The evaluation examines the role of the Ministry for Foreign Affairs in the development communications and assesses the efficiency and coherence of the current organisational processes and practices. The effectiveness of various development communications means, modalities and channels that are currently at the MFA disposal is assessed. Based on the related findings the evaluation draws justified conclusions and makes recommendations for enhancing the efficiency, effectiveness and coherence of the Ministry’s development communications for various audiences.

The temporal scope of the evaluation covers the years 2015- 2022. The evaluation only covers activities funded by MFA Finland, including those of programme CSOs that received funding for development communication, while the main focus is on VIE-30 communications.

The evaluation is based on two tracks of inquiry. The first inquiry track is descriptive (how has MFA supported and implemented development communication and global education), and the second is evaluative (how effective, efficient and coherent has the MFA been in funding and implementing development communication).

The purpose of this evaluation was to assess the relevance and effectiveness of different types of multilateral influencing activities implemented by the Ministry for Foreign Affairs of Finland (MFA), and to provide guidance on how to further strengthen them.

The evaluation used a theory-based approach which allowed for systematic analysis of multi-causal relationships between influencing activities, effects, and further changes in Multilaterals. Overall, 23 multilateral partner institutions of the MFA were covered, and eight of those were studied in more depth: the World Bank Group (WBG), the United Nations Population Fund (UNFPA), the United Nations Children’s Fund (UNICEF), the World Food Programme (WFP), the United Nations Entity for Gender Equality and the Empowerment of Women (UN Women), the International Fund for Agricultural Development (IFAD), the Food and Agriculture Organisation of the United Nations (FAO), and the International Trade Centre (ITC).

The evaluation’s specific objectives were as follows:

• to assess how Finland has managed to promote Agenda2030 and Finland’s Development Policy objectives in the multilateral partner organisations;
• to assess the influencing activities, means and ways used;
• to provide guidance in elaborating the new influencing plans (work in progress);
• to assess the human and financial resources available for influencing activities;
• to assess the usefulness and feasibility of having the influencing plans;
• to assess various influencing means and Finland’s best opportunities to influence (Headquarters of multilateral organisations, country offices, multi-bi projects etc.) taking into account available resources;
• to assess the Theories of Change of the influencing strategy plan (when available) and give guidance for the possible revision to better meet the objectives of Finnish Development Policy.

The final report is available here: https://um.fi/publications/-/asset_publisher/TVOLgBmLyZvu/content/evaluointiraportti-ulkoministeri-c3-b6-vaikuttaa-monenkeskisten-j-c3-a4rjest-c3-b6jen-toimintaan-1/384998

The Joint Nordic Evaluation of the Nordic Development Fund (NDF) aimed to assess the performance of the NDF in relation to its mandate and the fund’s potential future role as a joint Nordic financing instrument, assessing how strong its added value is from an international perspective. Thus, the study pursued two intertwined aims: i) assessing NDF’s past and current performance (“aim 1”); ii) assessing NDF’s potential future role as a joint Nordic financing instrument for development (“aim 2”).

The evaluation was conducted ten years after the establishment of the NDF’s new mandate – a period sufficiently long to take stock of what has worked and why, and what has been less successful.The analysis covers the period 2009-2018 and NDF’s entire portfolio. Although the NDF has focused on climate change, the analysis also looked at NDF’s potential future role beyond this theme.

In parallel to the NDF evaluation, an evaluation of the Nordic Climate Facility (NCF) was undertaken. With its specific set up and operations, the NCF faces particular challenges and potentials and, in conjunction with the NDF, it was therefore decided to evaluate the facility separately, however by the same evaluation team (Particip GmbH). The results of the two assignments were presented in the same evaluation report. The final report is available online: https://eba.se/en/rapporter/joint-nordic-organisational-assessment-of-the-nordic-development-fund-ndf/11350/

The Nordic Climate Facility (NCF) is a challenge fund set up and administered by the Nordic Development Fund (NDF) to finance innovative climate change projects. The overall objective of the evaluation was to provide NDF with an independent assessment of NCF as a facility.The first aim was to assess the performance of NCF in accordance with the objectives and outputs stated in the most recent NDF Board approval document of NCF 7-9, including assessment of the effectiveness and efficiency of the management of NCF. The second aim was to assess NCF’s relevance and value addition as a challenge fund to NDF, and provide concrete recommendations for potential future directions and development of NCF, including i) assessing the alternative of setting-up up NCF as a trust fund; ii) assessing the use of other types of financing than grants.

In parallel to the NCF evaluation, an evaluation of the Nordic Development Fund (NDF) was undertaken. With its specific set up and operations, the NCF faces particular challenges and potentials and, in conjunction with the NDF, it was therefore decided to evaluate the facility separately, however by the same evaluation team (Particip GmbH).

The results of the two assignments were presented in the same evaluation report. The final report is available online: https://eba.se/en/rapporter/joint-nordic-organisational-assessment-of-the-nordic-development-fund-ndf/11350/

The purpose of the evaluability study was to inform the design of the upcoming evaluation by providing options for evaluation questions, methods, resources and expertise needed. The conclusions and recommendations of this assessment will be used for the planning and preparation of the evaluation, enabling a quick, focused and efficient start.

The evaluability study was mainly carried out as a desk study with some interviews of key informants.

• First, the evaluability study analysed interrelations between different policies, strategies and guidelines related to human rights and HRBA and their coherence.
• Second, it studied and analysed a representative portfolio of evaluations commissioned by MFA (meta-analysis). The portfolio consisted of policy, thematic, and programme evaluations as well as joint evaluations conducted by partner organizations on joint programmes.
• Third, the evaluability study carried out an evaluability assessment laying a special emphasis on human rights as an approach in development policy.