Understand how the game of knowledge brokering can help your organization.
See what and how you will learn in our game-based workshop
| Time | Content |
|---|---|
| 10 min. | Introduction to the workshop aim |
| 30 min. | Explanation of the rules of the game |
| 20 min. | Training round 1 and clarification |
| 30 min. | Rounds 2-3 |
| 10 min. | Break |
| 10 min. | Presentation of partial results |
| 30 min. | First debriefing session: (1) mini-lecture on knowledge needs and research designs, (2) Q&A, (3) group internal deliberation |
| 40 min. | Rounds 4-6 |
| 30 min. | Break |
| 10 min. | Presentation of partial results |
| 20 min. | Second debriefing session: (1) mini-lecture on types of users and feeding methods, (2) Q&A, (3) group internal deliberation |
| 40 min. | Rounds 7-10 |
| 15 min. | Break |
| 15 min. | Presentation of final results and choice of the winners |
| 30 min. | Final debriefing session & take away points for real-life practice |
| 30 min. | Evaluation of the game – the learning process itself |
Read about the research that provided the scientific basis for our workshop.
| 1. Why does this problem occur? | The problem of the know-do gap is ubiquitous across all policy fields. Research results are only one of the factors in the complex process of policy decision-making. Utilization of studies can be increased when the configuration of factors triggers a positive response from knowledge users - decision-makers. |
| 2. What can we do to address it? | A promising solution is to turn evaluation units into knowledge brokers. Brokers serve as an intermediary between the worlds of research and policy-making practice. |
| 3. How can we learn a new approach? | To become knowledge brokers public professionals need to master a set of specific skills. The best way to learn them is through practice. A game-based workshop provides space for safe experimentation and blame-free learning by doing. |
Find out about the organizations that got immersed in our learning experience.
In June 2018 we visited Washington D.C. to run a one-day workshop for the National Science Foundation. The agency currently develops a multi-annual strategy for its advanced operations. The challenge is to make it evidence-informed. During the workshop we used the Knowledge Brokers game to learn the key concepts that are useful for designing evidence-informed strategy. Then we applied those concepts for NSF strategic effort. For that part we used a specially developed canvas and procedure of Learning Agenda. The workshop contributed to making the new NSF strategy evidence-informed.
In May 2018 we deliver the game session as part of the advanced ARGO Top Public Executive Program, run jointly by Polish National School of Public Administration and IESE Business School of University of Navarra. Our participants were 60 high-level public policy decision-makers – vice-ministers, directors of the departments from ministries and voivodeships offices, and chairmen of government agencies. The goal of the training was to raise their awareness on how they can use analytical insights in making better policy decisions. Thanks to the workshops participants learnt new ways of tapping onto reliable knowledge sources and analytical services within their organizations, as well as in their environment.
We continue our annual tradition of Knowledge Brokering workshop with MPA students at Trachtenberg School of Public Policy & Public Administration, The George Washington University. As in previous years we conducted a workshop that confronted students with real life challenges faced by the personnel of government evaluation units. Thanks to this experience students discovered effective strategies of knowledge brokering in public sector.
Over two weeks of March 2018 we conducted four workshops with 100 policy analysts from all Polish government agencies. Our game inaugurated an elite post-graduate study program – the Academy of Regulatory Impact Analysis. It is a joint initiative of the Chancellery of the Prime Minister of Poland and the University of Warsaw. The goal of the program is to strengthen analytical capacity across Polish government agencies. The top 100 policy analysts learnt during our game how to improve their effectiveness in supporting decision-makers with the findings of their advanced analytical studies.
In October 2017 we delivered Knowledge Brokers workshop to the participants of the international conference „People, Planet and Progress in the SDG Era“. The event was organized by UNDP Independent Evaluation Office, in Istanbul, Turkey. During our workshop participants explored strategies for strengthening evidence-informed policies in developing countries.
In November 2017 the American Evaluation Association once again invited us to deliver the Knowledge Brokers on AEA annual conference in Washington DC. Thanks to the workshop evaluation practitioners from all around the world have been developing innovative ways of turning evaluative learning into actions for our governments and local communities.
In July 2017 we met with directors of regional units of Polish National Statistical Office to explore new ways of reaching policy makers with research. Regional units play crucial role in supporting Marshall offices of 16 Polish regions in running effective EU Cohesion Policy programs. The game-based workshop helped us developing new strategies of feeding high quality analytical work into decision-making process.
This June 2017 we visited London City to assist the work of EBRD evaluation unit. We used the game to build the shared understanding among staff of different EBRD units about the utility of evaluation findings in their work. We also have been helping EBRD to incorporate in their current results framework the behavioral aspects of decision-making. The new, human-centered design of the projects should further increase effectiveness of new investments.
In June 2017 our workshop brought together key staff responsible for strategic planning and implementation of Cohesion Policy in Hungary. The initiative led by Prime Minister Office of Hungary aimed at building effective, evidence-informed cooperation networks and synergies in the complex system of Cohesion Policy implementation.
In April we played a game with MPA students at Trachtenberg School of Public Policy & Public Administration, The George Washington University. Thanks to the workshop students could experience real life challenges faced by the personnel of government evaluation units.
In November 2016 we have opened with our game session an elite study program developed by EUROREG – University of Warsaw and Ministry of Economic Development. Mission of the Academy is to educate Polish civil servants to be knowledge brokers who improve our public polices based on research evidence. Game was used as an introduction to the study program. Following the game experience students will have a whole year to explore in-depth the different aspects of knowledge brokers craft.
This summer, as in previous years, The University of Warsaw has used our game-based workshop at the Academy of Regional Development. This is the 11th edition of the post-graduate studies for public managers from the Polish regions responsible for development policies. They have learnt about role of research-based evidences in running public development programs.
In February 2017, the Ministry of Agriculture and Rural Development of Poland used our game as part of the project „Assessment of monitoring and evaluation system for Rural Development Program 2014-2020”. The workshop brought together leaders of local action groups from all around Poland. They were able to network, exchange experiences, and develop shared understanding of how research results can help improving local communities.
In February 2017, we visited Cracow. Polish National Science Centre has been working with EGO s.c. on developing an evaluation system for NSC scientific grant delivery activities. Thanks to the workshop NSC staff was able to develop ideas on the architecture of the evaluation and monitoring system that could support grant decision-making.
In November 2016 The National Coordination Authority’s Evaluation Unit in the Czech Ministry of Regional Development organized international conference on Evaluating European Structural and Investment Funds. We run the workshop with conference participants – professionals specialized in evaluating Cohesion Policy. We were finding strategies for making evaluation more timely, accurate and useful.
In June 2016, we conducted a workshop with the Marshall Office in the Silesian Voivodeship. The goal was to bring together staff of evaluation units and their colleagues from strategic and management units. Together they were learning how they could cooperate in order to improve the effectiveness of public programs based on research insight.
In May 2016, we were invited by the Marshall Office of the Kuyavian-Pomeranian Voivodeship to conduct a one-day workshop with the evaluation unit in Torun. During the sessions, players and experts shared their experiences and knowledge about the best evaluation and brokering practices that could be implemented in every-day work.
In March 2016 we were invited by PHAC to conduct in Ottawa a one-and-a-half day workshop with public policy professionals from the Office of Audit and Evaluation. On the first day, we explored dynamics of effective knowledge brokering. During the creative session on the second day, we designed a sample regulation using behavioral insight and discussed implications for evaluation business resulting from this new approach.
On 24 of November 2015 we played a workshop with group of public servants from City of Warsaw. City of Warsaw consists of over 35 central departments and number of offices in 18 quartiers of Warsaw. They deliver services to citizens and manage the growth of metropolis. In such a complex structure knowledge management is a challenge. The goal of our workshop was to build a network of experienced civil servants who would serve as knowledge brokers, transferring information and experiences between city offices and gaining knowledge from myriad of social partners that operate in our metropolis. During the workshop participants mastered skills of effective knowledge brokers. They network with each other and they also come up with number of ideas for evidence-based initiatives aiming at the improvement of city services.
The American Evaluation Association had chosen Knowledge Brokers for a professional development workshop at their annual conference: „Exemplary Evaluations in a multicultural world”. The conference was held in Chicago, from 9 till 14 of November 2015. Over five thousands participants came to share their experience in evaluation of public programmes and policies. Use of evaluation findings by decision-makers has been always a challenge for the community of evaluators. Thus, our workshops aimed at exchanging experiences of effective knowledge brokering strategies that increase evaluation use. Participants were experienced evaluators and professional staff of evaluation units from all around the world. During the dynamic full day session we learnt about credible research designs and methods of feeding evaluation findings into policy practice. A surprising finding that emerged from our discussions was that challenges we face in evaluation field are similar across the globe. Also ways of dealing with challenge of evidence use are similar across different cultural and organizational contexts. For more information about conference see: [click here] If you are interested in workshop follow-up materials and access to reader – please contact us at: k.olejniczak@evaluation.pl
On 24 of October 2015 we conducted a workshop with Marshall Office of Sub-Carpathian Region. Office has been preparing for the implementation of regional development program, worth almost 2,5 billion EUR. They decided that management of such a huge investment scheme should be evidence-based.
The goal of the workshop was to bring together analysts from different departments and develop with them knowledge-management system and list of possible research topics for the program. During the workshop participants designed research and learn the principles of knowledge management in public policies. An unexpected discovery for analysts who traditionally work alone was the value of communication and team work.
Our game-based workshop was chosen as an exemplary workshop for the opening of the 11th Polish Evaluation Conference, Cracow, September 27, 2015. The conference is a joint undertaking of the Polish Ministry of Infrastructure and Development and the Polish Agency of Enterprise Development. It brings together practitioners of applied public policy research from academia, research consultancies, ministries and Polish regions. A key challenge discussed this year on number of sessions was use of research results for the better implementation of Cohesion Policy programmes (investment package worth 77 billions EUR for years 2014-2020) Our workshop brought together practitioners from Polish ministries, regional government and academia. Together we have been testing effective knowledge brokering strategies for the better implementation of Cohesion Policy interventions. For more information about conference see:http://www.konferencja-ewaluacja.pl/2015/
The game-based training on knowledge brokering is a joint educational undertaking of a group of international experts on public policy and game design.
KAROL OLEJNICZAK is an assistant professor of management at EUROREG - University of Warsaw, Poland. His research interests focuses on evaluation of public interventions and organizational learning. Karol is a practicing evaluator. He conducted studies for Polish government and European Commission. In 2014, for his extensive applied research he has received from Polish Government a title of the Evaluator of the Year. Karol has 15 years of experience in teaching evaluation. He has been giving lectures in Poland, USA, Japan and Belgium. Since 2008 Karol is the head of the Academy of Evaluation, an elite study program for Polish civil servants.
DOMINIKA WOJTOWICZ holds PhD in Management Science. She graduated from the Koźmiński University (Management) and University of Warsaw (International Relations). She is Assistant Professor at the Chair of Economy of the Koźmiński University. She gives lectures on the methodology of quantitative and qualitative research used in policy analyses during postgraduate studies for public servants. She has been giving lectures in Italy, Spain, Portugal and Georgia. Her research interests focus on the broadly understood effectiveness of public intervention geared towards strengthening the regional and local development. She participated in many research projects focused on specific areas of public policies. She is an author of expert opinions in the field of impact of the EU funds on regional economies in Poland, on behalf of, inter alia, the European Parliament and the European Commission. She was a coordinator of studies on modern evaluation methods for specific areas of intervention and public regulation, studies on the use of evaluation in Poland and Spain, as well as the use of evaluation practices in the Regulatory Impact Assessment.
MARTA ANIELA KOPCZYNSKA is a master student of spatial economy at the Centre for European Regional and Local Studies (University of Warsaw). She holds B.A. in Culture and Media Management. Aniela’s research interests focuses on public spaces, sociology of the city and public policies. She took part in many educational trainings about cities and social change such as Creative Cities School of Excellence in Cracow 2015. Last year, Aniela has been studied the economic, social and racial issues in Detroit during Humanity in Action Fellowship. Since 2017, she works as a researcher at the Evaluation for Governments Organisations.
LUKASZ KOZAK is a graduate of Institute of Sociology at Warsaw University, analytics and statistics specialist, passionate board gamer and technology geek. He is game designer, mechanics developer and algorithm specialist. His ambition is to create tools combining analogue experience with IT solutions. During the game-based workshop Łukasz operates algorithm that provides participants with real-time feedback.
TOMASZ KUPIEC is a doctor of economic science at Kozminski University, Warsaw. He has been working on evaluations since 2007 as a manager of evaluation unit in public sector and as an independent evaluator of public policies since 2010. He is conducting studies and is the author of a number of publications on evaluation use determinants, performance of evaluation systems and the concept of knowledge brokering as a theoretical basis for evaluation units in public organizations. He has given lectures at the Academy of Evaluation, a unique postgraduate course for Polish civil servants.
JAKUB RADOLAK is an landscape architect. Kuba has graduated the University of Warsaw Interdepartemental Economic and Managerial Studies. Kuba has a 3-year experience in the training and business games industry. He has designed gamification tools for schools, training and board games (he has collaborated, among others, with the company Trefl). He works as a consultant in the field of training games and tools. In Pracownia Gier Szkoleniowych he works as games facilitator, conducting numerous games and simulations. Within the frame of The Tree of Life projects, Kuba coordinates events, prepares game agendas and supervises the course of the game. He has collaborated, among others, with the following clients: Deloitte Sp. z o.o., Volvo, Sapiens, Warbud, DNV, EulerHermes, Sobiesław Zasada, Bank Pocztowy.
MACIEJ SMROKOWSKI is a facilitator and game consultant. Maciej has graduated sociology faculty at the University of Warsaw Institute of Applied Social Sciences. He has gained professional experience in the financial and insurance industries. He has worked as games and training tools consultant for 3 years. Maciej advises how to include simulations in existing training programs as well as how to create new programs based on games and simulations. He cooperates with Pracownia Gier Szkoleniowych as games facilitator and conducts various games and simulations. Maciej has worked, among others, for the following companies: Grupa Allegro Sp. z o.o., Deloitte Sp. z o.o., Polkomtel Sp. z o.o., Beneffit Systems and for public administration.
IGOR WIDAWSKI is a head game designer at Pracownia Gier Szkoleniowych. Sociology graduate, he has studied at the University of Warsaw and School of Business & Economics in Maastricht. His games have been already played by thousands of players within corporations, NGOs, public administration and universities. He has designed simulations related to such subjects as project management, negotiations, brand building, public participation, sustainable energy, change management and knowledge brokering. Igor is the chief game designer at Competence Game: an innovative on a global scale competence diagnosis tool in the online environment. During game-based workshop he is game master coordinating game flow.