Research programmes
Evaluations are an important development tool for Academy research programmes and programme funding. These evaluations are conducted closely with other agencies funding the programmes. Evaluations provide information on the attainment of the programme’s objectives, success in generating new knowledge, the value added produced by the programme and its impacts. A further purpose is to gain feedback on programme coordination as well as other information to facilitate science policy planning and decision-making. Furthermore, evaluations are designed to provide feedback to researchers in the field.
Follow-up and evaluation plans are prepared for each research programme well ahead of time. Especially in jointly-funded programmes, these general principles are agreed in advance. Plans are drawn up to specify the aims of follow-up and evaluation, the responsible parties, the methods of evaluation, the timetable, budget and the materials collected for evaluation purposes. A key consideration is to make sure the results of the evaluation have practical application.
Programme evaluations are most typically conducted using the peer review method, with a group of usually foreign experts solicited to assess the success of the programme. Programmes can also be evaluated simultaneously. Many research programmes include objectives of social impact. In this case the assessment of the impacts achieved will include an evaluation of the societal (social, cultural, political), economic and technological impacts of the programme and its results in so far as these have been specified among the programme’s objectives. Evaluations may be commissioned from experts specialising in impact assessments. For purposes of assessing the programme’s short-term impact, impact assessments may also be conducted separately, some time after the completion of the programme.
The recommendations put forward in the evaluations are put to systematic use. The points raised in the evaluation are discussed by the programme steering committee and the Research Councils, who may forward suggestions to the Academy and other funding bodies on recommended practical measures. Programme evaluations are also used in foresight projects to explore future research needs and directions. Research Councils take account of the results of evaluations in their science policy decision-making as well as in their action plans and budgets. Evaluations are also useful for other funding bodies, other research end-users, researchers and the media.