Output / Publication

Impact-Oriented Evaluation of Smart City Projects

A Practical Guide for Application in the Evaluation Process

Cities and municipalities find themselves in profound processes of change.

The necessity of transforming municipalities in the areas of digitalization and sustainability is increasingly shaping administrative action — accompanied by rising expectations on the part of politicians and citizens.

The implementation of strategies, the allocation of resources, and the planning and execution of projects and measures are essential elements for driving the desired transformation forward. However, as the number of funded municipal Smart City projects and sustainability initiatives grows, so too do the demands of the various stakeholders: funding bodies expect robust evidence, politicians and residents demand transparency, and municipalities themselves require steering knowledge in order to develop their strategies effectively.

The assessment of whether an implemented project can be considered "successful" frequently focuses on conventional metrics such as technical commissioning, user numbers reached, or cost-benefit analyses. While this is often politically desired and regarded as sufficient, it rarely reflects the actual state of affairs. The findings of such assessments provide important insights into efficiency, but do not answer the central question of whether and to what extent projects are genuinely effective and contribute to overarching strategic goals — such as improved quality of life, social participation, or contributions to global sustainability and digitalization agendas. The systematic measurement of impacts, however, remains rarely established in practice, due in large part to its greater complexity compared to the verification of basic implementation parameters.

This is precisely where the present guide comes in. Its aim is to provide municipalities with practical guidance and to reframe impact-oriented evaluation not as an additional burden, but as a useful steering instrument. In this context, it deliberately builds on existing knowledge from previous guides (see "Further Reading" — helpful additional literature), while extending them with specific practical insights drawn from actual evaluation processes conducted with German cities and their projects.

Practical Guide (in German)

Accompanying this guide, we have developed a first version of an Excel workbook designed to support you throughout the working process and to provide a suitable data infrastructure for impact-oriented process evaluation.

If you are interested in the workbook, please feel free to contact us at the address below with the subject line "Workbook for the Guide" and we will send you the tool: urbandigitainability.ttt@hfp.tum.de

Authors

Andreas Marx

Lead Researcher​

Helene​ von Schwichow​

Project Advisor & Researcher​

Nina Faecks

studentische hilfskraft urban digitainability lab