Evaluation
This section provides an overview of NFS’s experience with regard to monitoring & evaluation services. Our experience covers the following areas:

      • Complex Evaluations

      • Evaluation of EU Geographical Programmes

      • Evaluation of Geographical Cooperation Strategies

      • Thematic Evaluations

      • Evaluation of EU Policy Sectoral Impact

      • Monitoring Services

      • Evaluation of Proposals for International Organisations

Examples of our work
New Frontier Services recently provided a staff member for the external evaluation of the EC FP7-supported IST “GOLDFISH” project. The GOLDFISH project is focussed on investigating technological means for tracking pollution in remote rivers using sensor network technology. The project employs European ICT research capabilities for designing, development, testing and piloting of a system that aids localization of pollution in watercourses.
Supporting dialogues between the EC/EU and strategic partners countries and regions, to foster cooperation with strategic third country organisations tin collaborative ICT R&D both within the EU’s framework Programmes (FP&, Horizon2020) and under relevant third country programmes.
A staff member of NFS was selected as an independent expert acting as evaluator in the evaluation of research proposals in the Objective 10.3 (b) International partnership building and support to dialogues: Enable partnership building in low and middle income countries.
An FP7-supported project where NFS provided a staff member in an expert role was in the evaluation of the IST Africa project, a strategic collaboration between 1 European partner and 19 African Ministries and National councils responsible for ICT/STI adoption. The IST-Africa Initiative 2012-2013 has six main objectives – (1) support the implementation of the 8th Africa-EU Strategic Partnership, (2) strengthen the research dimension of Information Society policy dialogue between the EU and African stakeholders, (3) organize community building events in Europe and Africa synchronized with policy dialogue meetings regarding R&D priorities, (4) identify and analyse African ICT policy and research priorities in line with EU priorities to advise on future cooperation, (5) strengthen cooperative research links between European and relevant African organizations for strategic partnerships, and (6) support development of NCPs in partner countries.
NFS provided a staff member in the external evaluation of The EuroAfrica-P8 project. This supports policy dialogues & cooperation with Africa to enhance ICT research links in the framework of P8. It seeks to promote collaborative research on ICT in the framework of P8/P3; promotes a more coordinated approach of the European MS towards P8; carries on an update of the identification/analysis of joint ICT research priorities; provides evidence-based recommendations to the EC/AUC for future cooperation initiatives; organises events in both regions synchronised with policy dialogue meetings; strengthens ICT cooperative research links between European/African organisations with the aim of reinforcing P8; supports the activities of the P8 implementation group; enhance the participation of African organisations in FP/ICT collaborative projects; and facilitates the access of EU organisations to third country programmes.
NFS provided a staff member in the external evaluation of AMERICAS: Latin America-Europe ICT Cooperation Advanced Strategies. The project’s core revolves around the organisation of a number of events aimed at different target audience and with different objectives: (i) ICT Fora – aimed at a variety of participants (from policy makers to researchers) with the objective of supporting the ICT policy dialogue in the region; (ii) Interactive Master Classes – aimed at leading researchers from Latin American countries, potential proposals participants, with the objective of triggering the creation of EU-LA collaboration project proposals; (iii) Project Angels Summer Schools – to create new Project Angels, who have an in-depth knowledge and understanding of the ICT Programme, who can, in turn give support to new project proposal participants. The project also aims at exploring potential joint strategies to support LA-EU ICT R&D partnerships.
New Frontier Services, in partnership with IBF International Consulting, carried out the evaluation of the fourth EDULINK Call for Proposals aiming to promote innovation in Higher Education Institutions in the African, Caribbean, and Pacific Group of States (ACP). Launched in 2012, the fourth Call for Proposals follows the positive outcome of the three previous programme Calls. The global objective of the EDULINK programme is to foster capacity building and integration at a regional level in the field of higher education; and to support efficient and quality higher education relevant to the needs of the labour market and consistent with ACP regions’ and member states’ socio-economic development priorities. EDULINK also aims to improve effectiveness, management, and visibility of ACP-EU cooperation, thus leading to an increased impact of this collaboration.
New Frontier Services, in partnership with Particip, carried out the evaluation of the 2nd Call for Proposals aiming to improve science and technology research in order to contribute to African sustainable development. Launched in January 2012, the 2nd Call for Proposals for African Union Research Grants follows up on the success of the 1st Call for Proposals and maintains an objective of improving science and technology research by means of building Africa’s research capacities through direct funding of the African Union S&T Policy, specifically the Consolidated Plan of Action; and to enhance scientific research collaboration and cooperation between regions that contributes to sustainable development in Africa. Target areas of AU Research Grants include post-harvest and agriculture; renewable and sustainable energy; and water and sanitation; all which contribute to poverty reduction, economic growth, and social development efforts.
New Frontier Services, in partnership with IBF International Consulting, carried out the evaluation of the 1st Call for Proposals aiming to improve science and technology research in order to contribute to African sustainable development. The overall objective for the Call for Proposals for African Union Research Grants is to improve science and technology research by means of building Africa’s research capacities through direct funding of the African Union S&T Policy, specifically the Consolidated Plan of Action; and to enhance scientific research collaboration and cooperation between regions that contributes to sustainable development in Africa. Target areas of AU Research Grants include post-harvest and agriculture; renewable and sustainable energy; and water and sanitation; all which contribute to poverty reduction, economic growth, and social development efforts.

June 2013

New Frontier Services, in partnership with Euronet Consulting, participated in the evaluation of grant applications received in the framework of the call for proposals of Sustainable Environment and Natural Resources for Development under the National Development Policy Support Programme (NDPSP) for South Africa targeting environmental issues. NFS provided a team of 3 experts to carry out this assessment work. Launched in 2012 to be implemented over a period of 5 years, the global objective for the NDPSP programme targeting environmental issues is to support South Africa’s environmentally sustainable future, through support of healthy ecosystems and sustainable use of natural resources in South Africa. Actions financed under this call support key South African development policies, strategies, and plans in the area of environment, including those which promote job creation, poverty reduction, and sustainable livelihoods.
Involved reviewing challenges faced by these small island economies and relevance of the programme of assistance, and involved desk review and analysis in many sectors and limited fieldwork. The work included:
      •Review of the programming, formulation and implementation experience (SPDs, PIFs, FPs, FAs, etc.) and experience under the respective EDF aid regimes (budget support and project approval)

      •Review of OCT programmes in diverse sectors (infrastructure, tourism, agriculture, food, health, environment)

The scope of the evaluation spanned the EC’s co-operation strategies and their implementation during the period 1999-2009 and on the intended effects for the period under the current programming cycle 2008-2013, including all activities as well as modalities and in particular the Commission's Country Strategies covering that period. (This includes evaluation of the European Investment Bank Facility). The scope includes reviewing the coordination and complementarities between activities under different mechanisms, modalities and budget lines as well as between activities initiated at regional versus those at national level should be analysed, as well as the experience with aid modality (the experience with budget support versus project approach). The sectoral and thematic focus covered Transport (mainly air and sea); Infrastructures (roads, harbours, water); Trade; Environment; Good governance; Education; and Private Sector Development.
Working as a sub-contractor to KANTOR Management Consultants and European Consultants Organisation, NFS provided the Team Leader for an evaluation for DG JLS of the Judicial Exchange Pilot Programme. The work involved reviewing the performance, lessons learnt and results of 7 pilot projects. A successful Focus Group/workshop was organised involving stakeholders from all pilot projects, the European Judicial Training Network (EJTN) and the European Commission. The final report provided some outline recommendations on strategic issues that needed to be addressed for the development of judicial exchanges and training, including governance structures for such an initiative and the role of the EJTN.
NFS staff were appointed to undertake the Mid-Term Evaluation of the Trans-Eurasia Information Network (TEIN2). This network seeks to become the equivalent of the GEANT success story in Europe. A key part of the EU's vision for a global information society, the network is a highly strategic one and its development is closely followed and supported by DG RELEX, DG DEVCO, DG INFSO and DG RESEARCH, among others. The Trans-Eurasia Information Network has been specifically mentioned in recent EU-ASIAN Heads of State and Government summit meetings, and is one of the EU’s most High-Profile Projects in Asia. Part of the review focussed on TEIN2’s financial sustainability and the EC’s financial support for Asian-led governance scenarios for the network and its user applications. User applications covered telemedicine, e-health, disaster early-warning systems, and seismology.
New Frontier Services provided a 4-person consultant team to undertake a series of detailed monitoring reviews of 16 Development Co-operation Projects in the Education and Schools Sector, using the EC’s ROM-based (results-oriented monitoring) monitoring system. The monitoring work involved fieldwork in 13 countries as well as telephone interviews in Brazil, Czech Republic and Austria. A Team Leader was responsible for overseeing the desk research work, visit programme logistics and fieldwork, and reporting to the client. The team leader also undertook monitoring field work in Belgium, the Netherlands and Germany. The projects involved activities across a variety of sectors, including education activities in secondary schools, schools’ twinning, NGO and Government capacity building, awareness raising of Development Co-operation issues, Decent work and workers’ rights, Immigration, North-South trade dialogue, Agriculture, Cultural Heritage Protection, Sexual and Reproductive Health.
New Frontier provided the team leader for the first ever evaluation of the Customs 2007 Programme, the EU’s customs co-operation programme for the EU Customs Union, and the largest programme of its kind in the world. The evaluation covered the 3 areas of the Customs 2007 Programme, including i) assessment of Working Methods of Customs Administrations (CAs) and Protection of Financial interests; ii) Assessment of Facilitation of Trade, and iii) Assessment of enlargement aspects. Areas covered included Customs Administrations’ working methods (including better detection of forgery, harmonisation of working methods within customs laboratories); CAs management practices and the operational results of customs controls; the programme’s contribution to facilitating trade, and the implementation of the NSTI (New Computerised Transit System).