EU conference shows the need to improve quality of evaluations

The Regulatory Scrutiny Board (RSB) of the European Commission presented at its annual scrutiny conference the results of its latest annual report, which this year focuses on ex post evaluations. RSB notes that the quality of Commission evaluations reached an all-time low in 2024.

A common problem is that evaluations do not contain sufficient explanations of assumptions, estimates or limitations of methodology or data. Many evaluations rely to a too large extent on opinion data, often from small, non-representative, self-selected samples of stakeholders. Another frequent problem is that conclusions do not adequately reflect the presented evidence analysis, or lack thereof, which makes it difficult to assess the efficacy of the policy initiative. In several cases, the RSB assesses that the evaluations do not sufficiently describe the potential for reduced regulatory burden.

Among the recommendations in the report can be mentioned that evaluations should be given greater weight in the policy cycle. In this context it is to be noted that unlike impact assessments, that have to be resubmitted on a negative opinion of the RSB, this is not the case for evaluations. Another recommendation to improve the quality of evaluations is to use central functions within the Commission, such as the Joint Research Centre, Eurostat and the Secretariat-General, to a larger extent.

More complex and horizontal legislation as well as collection and analysis of data were difficulties raised at the conference. OECD noted that while impact assessment ex ante is conducted relatively systematically and well in member countries, ex post evaluation is since long a weak spot, which is problematic, and utterly a question of trust. According to a recent survey, fewer than half of the citizens within the OECD believe that regulators make use of best evidence available in policy-making. It is therefore crucial that evaluations both ex ante and ex post is taken seriously and that performance indicators are considered already at the start of the legislative process. We need to be as careful when removing rules as when we are introducing them.

The need for better evaluation capacity in member states, data sharing and consideration of cumulative burdens were put forward, as well as simplification is impossible without evaluation.

In connection to the conference, RegWatchEurope had a separate meeting with the RSB members (see picture).

RSB Conference – programme External link, opens in new window.
RSB presentation Pdf, 537.3 kB.
RSB Annual Report 2024 External link, opens in new window.

Members of the Regulatory Scrutiny Board and RegWatchEurope