The evaluation comprised a concept comparison and a strategy analysis, based on the assessment of academic literature, official documents, publicly available socio-economic data and interviews. The structures and processes of German bilateral development cooperation were analysed on the basis of internal and public documents elaborating on the procedures for decision-making. The review placed a particular emphasis here on those steps in the process that relate to strategies on development cooperation in fragile contexts or fragility assessments. In order to tailor recommendations to the needs of BMZ, GIZ, and KfW, the evaluation team refer to the procedures as described in BMZ’s Joint Procedural Reform (GVR).
The evaluation team also analysed evaluation quality and project success in fragile contexts, building on a synthesis of evaluation reports by GIZ and KfW. This synthesis links characteristics of the evaluated project and the evaluation with data on the implementation context. In the context of this evaluation, moreover, the evaluation team developed a procedure to automatically retrieve geographical information from evaluation reports in order to locate the evaluated projects. This data can be linked to information about local conflict events to gauge the enforcement of the state’s monopoly on the use of force at a subnational level. Moreover, the analysis of evaluation quality draws on evaluation guidelines from GIZ and KfW and existing meta-evaluations.