4th International Conference
on National Evaluation
Mr. Juha Uitto, OIC, Evaluation Office, UNDP
Chair: Ms. Ronette Engela Rapporteur: Mr. Roberto La Rovere
Presention by Mr. Rachid Benmokhtar Benabdellah, President, Observatoire Nationale de Developmment Humain - member of the Advisory
Chair: Mr. Patrick Birungi
Rapporteurs: Ms. Ana Rosa Soares & Mr. Boureima Gado
India "Role of Evaluation in 5 year planning in India"
Ms. Sudha Pillai
Sri Lanka “Role of evaluation in influencing the policy – a Sri Lankan perspective”
Mr. Velayuthan Sivagnanasothy
South Africa “The use question in South Africa: examples and lessons from the Public Service Commission of South Africa”
Mr. Indran Naidoo
Colombia “Effective evaluations: processes to advocate for changes in public policy”
Mr. Walter Mauricio Aguila
Panel 1: Systemic factors contributing to use of evaluation
Chair:Mr. Seydou Yayé Rapporteur: Mr. Marco Segone
Benin "Use of evaluation and development in a national assessment: the case of Benin"
Mr. Aristide Djidjoho
India "Indian Experience with the Performance Monitoring and Evaluation System (PMES) for Government Departments"
Mr. Prajapati Trivedi
Guatemala “Multi-stakeholder participatory evaluation systems in the field of public policy: a case study of Guatemala”
Mr. Henry Morales.
Panel 2: Impact of audits and budgeting in evaluation
Chair: Ms. Thania de la Garza Navarrete Rapporteur: Mr. Dieudonne Mouafo
Brazil “Promoting accountability and enhancing programs and policies through the instrumental use of the evaluations carried out by the Brazilian Court of Audit”
Ms. Selma Maria Hayakawa C. Serpa
Morocco “Gender responsive budgeting as a tool for public policy evaluation”
Mr. Mohammed Chafiki (recording)
Chair: Ms. Nadira El Guermai Rapporteurs: All Day 1 Rapporteurs
display of publications and evaluation materials by participants (running before and in parallel with Cocktail)19
Cocktail hosted by the Office of the Public Service Commission in Village Manor Remarks by the host: Mr. Mashwahle Diphofa, Director General, Office of the Public Service Commission
Mr. Rachid Benmokhtar Benabdellah, President, Moroccan National Observatory of Human Development
Ms. Saraswathi Menon, Director, UNDP Evaluation Office
Ms. Alia Al-Dali, Resident Representative a.i., UNDP-Morocco
Chairperson: Mr. Abhijit Sen, Member, Planning Commission, India,
Opening Remarks by the Chairperson Brief issues paper presentation
Morocco: Moroccan National Observatory of Human Development
Costa Rica: Juan Manuel Cordero González, Vice-Minister for Social Development
Mauritania: Ould Khattar Dah, Head of the Sector Policies service
South Africa: Julie Charmaine, Regional Director of the Western Cape Public Service Commission
Chairperson: Mr. Tony Aidoo Head, Policy Evaluation & Oversight Unit, Office of the President, Ghana
Opening Remarks by Chair Brief issues paper presentation
Brazil: Joana Mostafa, Member Social Policies and Studies Divison, Comission of Monitoring and Evaluation of Public Policies
Uganda: Margaret Kakande, Head Budget Monitoring and Accountability Unit, Ministry of Finance, Planning and Economic Development
RELAC Latin American Network of Evaluation: Pablo Rodríguez, Executive Committee
Niger: Seydou Yayé, Director General, Programme Evaluation and Development, Ministry of Economy and Finance
Group Picture, Traditional attires are welcome
Jorge Chediek (5')
UN Brazil Resident Coordinator
Toast to The EvallYear
Head of CLEAR Secretariat
Toast on behalf of all partners in celebration of joint efforts leading to the proposed 2015 International Year of Evaluation – EvalYear
UNDP Associate Administrator
Presenter: Ray Rist
Ray has had a distinguished career which includes a range of high profile government and academic appointments. He has been a professor at a several prestigious universities, and has been a consultant to many national and international organisations, including The World Bank, OECD, DFID, IADB, and a range of corporations, House and Senate committees in the United States. The focus of much of this consulting has been on public sector performance, especially that of results based management and measurement, and he has been an advisor to senior government officials in more than 50 countries. Ray is co-director of the International program for Development Evaluation Training (IPDET). He has authored or edited 31 books and has authored more than 140 articles and monographs.
Presenter: Jo Puri
Dr Jyotsna (Jo) Puri leads 3ie’s evaluation team and is the deputy executive director. She is a member of 3ie’s senior management team, leads 3ie’s open, thematic and policy related grant windows and is also responsible for fund raising. Jo Puri has over 18 years of experience in evaluation and evidence-based policy and has worked earlier at the World Bank and the United Nations. Previously she was Associate Research Scientist at Columbia University. Jo is also currently adjunct faculty at the School of International and Public Affairs (SIPA), Columbia University.
Presenter: Richard Levin
Presenter: Frederic Martin
Presenter: Linda Morra
Linda currently heads her own consulting firm, acting as an independent consultant to diverse groups including the Independent Evaluation Group of the European Bank for Reconstruction and Development, the Korean International Development Agency, the DPMG Consulting Group, China Ministry of Finance, and others for training and other ECD services. She has thirty years experience in designing, conducting, and managing policy, program and project evaluations, both nationally and internationally; she also has twenty years experience as an advisor and trainer on M & E in both the developing and developed country contexts.
Presenters: Heather Bryant and Ana Rosa Soares
Heather Bryant has been an Evaluation Specialist with the UNDP Independent Evaluation Office (IEO) since 2012. She is currently conducting evaluations of UNDP country programmes called Assessments of Development Results), and recently completed a Joint Evaluation of the GEF/UNDP Small Grants Programme in collaboration with the GEF Independent Evaluation Office. Prior to joining the UNDP IEO, Heather worked for UNDP Nepal as the head of the Strategic Planning and Development Effectiveness Unit, where she was responsible for planning, monitoring and evaluation tasks, with a special emphasis on human rights, gender equality and social exclusion issues. Heather has a master’s in geography from the University of Lausanne, Switzerland, and speaks English and French.
Ana Rosa Soares is an Evaluation Advisor in the Independent Evaluation Office of UNDP where she is also the coordinator for National Evaluation Capacity Development. She is responsible for conducting country, regional and global thematic and programmatic evaluations. Prior to working for the IEO, she was a Strategic Planning, Monitoring and Evaluation Officer and the focal point for the Millennium Development Goals (MDG) for UNDP in Brazil. Before joining the UN, Ms. Soares was an International Projects’ Manager at the Center for International Development for SUNY, working with bilateral and multilateral cooperation of international development programmes and projects in Africa, Europe and Latin America. Ms. Soares has a bachelor’s degree in Political Science, holds a Masters’ degree in Public Administration from SUNY Albany and is currently working on her Ph.D on Development Studies at the University of Cambridge in the United Kingdom.
Chair: Mr. Velayuthan Sivagnanasothy Rapporteur: Mr. Roberto La Rovere & Ms. Riitta Oksanen
China Mr. Yonghe Zheng
“The roles of users in enhancing utility of evaluation with special reference to the international evaluation on the funding and management performance of the national Natural Science Foundation of China"
Uganda Mr. Albert Byamugisha
“Giving national direction through evaluation: Uganda’s evaluation of its Poverty Eradication Action Plan (1997-2007)”
Morocco Mr. Mohamed Benkassmi & Mohammed Mouime
“ONDH information system - ONDH for the evaluation of human development public policy”
Mexico Ms. Hortensia Perez
“Key elements of evaluation as a decision making tool: the specific performance evaluation experience in Mexico”
Brazil Ms. Junia Quiroga
“The evaluation system of the Ministry of Social Development and the Fight Against Hunger: strengths and weaknesses in the use of evaluation results in decision making for social programs”
(10:00 break for 15 min)
Panel 3: Monitoring and how it facilitates use of evaluation
Chair: Mr. Armando J. Vieira Filho Rapporteur: Ms. Ana Rosa Soares & Mr. Babacar Mbaye
Dominican Republic Mr. Hernan Rodriguez Minier
“Dominican Republic experience in the design and implementation of a monitoring system as community methodology to measure progress and impacts of the Millennium Development Goals and National Development Strategy”
Malawi Mr. Ronald Mangani
“The use of evaluation in managing for development results: evidence from Malawi”
Niger Mr. Seydou Yayé
“The process of Control in Project Advancement (CAP) of the International German Cooperation (GTZ): the case of the CAP Program to Combat Poverty in Niger (LUCOP)”
Rwanda Mr. James Tumwine
“'Imihigo' performance-based approach: an evaluation tool in Rwanda”
Panel 4: Establishing evaluation systems, taking use of evaluation into account
Chair: Ms. Katongo S.M Chifwepa Rapporteur: Ms. Soma de Silva
Chile Mr. Ryan Cooper
“Compass Commission, Abdul Latif Jameel Poverty Action Lab”
Costa Rica Ms. Melania Nunez
“Evaluation in Costa Rica from the government perspective: the current situation and challenges in the context of implementing the National Development Plan 2011 to 2014”
Malaysia Ms. Shahrazat Haji Ahmad
“Use of evaluation: Malaysia experiences”
Mauritania Mr. Mohamed Fade
“Using evaluation in decision making for public policies and development programs: the case of Mauritania”
Tajikistan Mr. Bahodir Eshboev
"Strategic development goals and priorities of the Republic of Tajikistan: national monitoring and evaluation system for their achievements"
Tanzania Mr. Ekingo Magembe
“The importance of monitoring and evaluation in achieving national development policies and programmes’ targets”
Mongolia Mr. Darinchuluun Bazarvaani
“Evaluation of the MDG-based comprehensive National Development Strategy (NDS) implementation and utilizing the evaluation results”
Kazakhstan Mr. Farkhat Kassimov
“Government performance evaluation, the Kazakhstani case: experience, challenges, immediate outcomes and future prospects”
Chairperson: Ms. Carla Morales, Vice Minister, Ministry of National Planning and Economic Policy, Costa Rica
Opening Remarks by Chair Brief issues paper presentation
Chairperson: Mr. Eric Shitindi, Deputy Permanent Secretary, President's Office - Public Service Management, Tanzania
Opening Remarks by Chair
Brief issues paper presentation
DIALOGUE ON THE IMPORTANCE OF EVALYEAR
Facilitator: Marco Segone, EvalPartners co-chair
EVALYEAR – WHAT IS THE EXPECTED GOAL IN TERMS OF NATIONAL EVALUATION CAPACITY DEVELOPMENT BY THE YEAR 2015?
Presenter: Asela Kalugampitiya (Sri Lanka), Secretariat of EvalYear on behalf of EvalPartners
HOW CAN GOVERNMENTS, PARLIAMENTARIANS AND VOPES WORK TOGETHER TO STRENGTHEN THE DEMAND AND USE OF EVALUATION?
Commentators: Government, MP and VOPE
INNOVATIVE SOLUTIONS TO CHALLENGES LINKED TO USE OF EVALUATION
Moderator: Juha Uitto, UNDP- Evaluation Office
HOW HAS EVALUATION INFLUENCED THE BRAZIL WITHOUT POVERTY PLAN (PLANO BRAZIL SEM MISÉRIA)?
(no simultaneous translation provided)
EVALUATION CAPACITIES TO ENSURE USE OF EVALUATION
Facilitator: Xiaojun Grace Wang, UNDP Bureau for Development Policy
(Session in English only no interpretation)
INNOVATIVE APPROACHES OR SOLUTIONS TO ENSURE USE OF EVALUATION FINDINGS AND IMPLEMENTATION OF RECOMMENDATIONS
Facilitator: Inka Mattila, UNDP Panama Regional Center
NATIONAL EVALUATION SYSTEMS AND INCENTIVES TO PROMOTE USE OF EVALUATION
Moderator: Vijayalakshmi Vadivelu, UNDP Evaluation office
WHAT ARE SOME OF THE INNOVATIVE SOLUTIONS TO DEAL WITH CHALLENGES LINKED TO USE OF EVALUATION?
Moderator:Ana Rosa Soares, UNDP Evaluation Office
Presenters: Juha I. Uitto and Rob D. van den Berg
Juha I. Uitto is the Director of the GEF Independent Evaluation Office charged with evaluating the results and performance of the Global Environment Facility. Over the past decade and a half, he has conducted and managed a large number of evaluations of international cooperation at the global, regional and country levels, in particular related to environmental management and poverty-environment linkages. The book Evaluating Environment in International Development edited by Juha was published by Routledge in 2014. He holds a PhD in Social and Environment Geography.
Rob D van den Berg studied contemporary history at the University of Groningen in Netherlands. He is a Visiting Professor at King’s College, London and a Visiting Fellow at the Institute of Development Studies, University of Sussex, as well as a member of the Faculty of the International Program for Development Evaluation Training. His past positions include Director of the Independent Evaluation Office of the Global Environment Facility (2004-2014), Director of the Policy and Operations Evaluation Department of the Dutch Ministry of Foreign Affairs (1999-2004), Senior Advisor on Research at the European Commission and various positions in Dutch development cooperation. From 2002 to 2004 he was the chairman of the OECD/DAC Network on Development Evaluation. He has published more than 25 articles on development, research and evaluation and has co-edited four books.
Presenter: Michele Tarsilla
Michele Tarsilla has been designing and conducting evaluations and capacity development programs funded by a variety of international development organizations (the World Bank, FAO, WFP, DfiD and USAID) in a variety of sectors (including education, health, agriculture and food security) for over ten years. Thanks to his extensive field work (over 35 countries) and his fluency in six languages, Dr. Tarsilla has a unique appreciation of cultural competence in international development work and, as a result, a keen commitment to promote the use of innovative and progressive concepts and practices within the global evaluation community. A prolific blogger (@MIEval_TuEval), Dr. Tarsilla is a former International Rotary and Fulbright Scholar who received his Ph.D. in Interdisciplinary Evaluation from Western Michigan University and a one-year graduate diploma in Public Policy and Program Evaluation from Carleton University in Ottawa. An IPDET graduate (2008), Michele joined the IPDET faculty in 2014.
Presenter: Marco Segone and Ada Ocampo
Marco Segone is Director, Independent Evaluation Office, at UN Women; Chair, United Nations Evaluation Group (UNEG), the network of Evaluation Offices of 46 UN agencies; and co-founder and co/chair of EvalPartners, the global partnership for national evaluation capacities. Previously, he was responsible for the decentralized evaluation function as well as the national evaluation capacity development portfolios at the UNICEF Evaluation Office; Regional Chief, Monitoring and Evaluation in the UNICEF Regional Office for Europe and Central Asia; Regional Office for Latin America and the Caribbean; Brazil Country Office, and Niger Country Office. Previously, he worked in international NGOs in Albania, Pakistan, Bangladesh, Thailand and Uganda. He has authored numerous publications including Evaluation for Equitable Development Results and How to Design and Manage Equity-Focused Evaluations.
Ada Ocampo is a Peruvian sociologist working in the UN system since 1990 with UNICEF, UNDP, UNFPA and IFAD in different countries of Latin America, Africa and Asia. During her career, she has mainly focused on evaluation capacity development and on networking. She is the author of several articles and publications. She has lectured at Carleton University, Claremont University, The Indian School of Business (ISB) and at BRAC University. She has managed and led several evaluation training programs; and is one of the founders of the International Organization for Cooperation in Evaluation (IOCE). She represents UNICEF at the Management Group of EVALPARTNERS. Currently, she holds the position of Sr. Evaluation Specialist at UNICEF’s Evaluation Office in New York.
Presenter: Elliot Stern
Elliot Stern is a practicing evaluator and an active member of the international evaluation community. He is Emeritus Professor of Evaluation Research at Lancaster University (UK) and currently Visiting Professor at University of Bristol. Elliot edits the journal Evaluation: the international journal of theory, research and practice published by Sage (UK); and was founding President of both the UK Evaluation Society and the International Organisation for Cooperation in Evaluation (IOCE). He was President of the European Evaluation Society; and a founding Academician and until recently a Council member of the UK Academy of Social Sciences. Elliot has worked extensively in the international development field with a particular interest in methodology and the institutionalisation of evaluation. He led the team that designed the impact evaluation of the Paris Declaration for OECD; was team leader for the ‘independent external evaluation’ of UNESCO; and in 2011/2012 headed up an international team for DFID tasked with reviewing a broad range of impact evaluation methods and designs to be used when experimental methods were not appropriate. Elliot has been evaluation advisor to the Regional Development Directorate of the European Commission; UN Women; the UK’s Department for Energy and Climate Change; and the CGIAR.
Presenters: Shiva Kumar and Bishwa Nath Tiwari
A. K. Shiva Kumar is a development economist and evaluator who works on issues related to human development - poverty, health, nutrition, basic education, and the rights of women and children. He has served as senior policy advisor to UNICEF India and as the Director of the International Centre for Human Development in New Delhi, India. He is Co-Chair of the Know Violence in Childhood – a global learning initiative that is synthesizing evidence to advocate for ending violence. Shiva Kumar was a founding board member of the International Development Evaluation Association (IDEAS) and has undertaken several evaluation assignments for IDRC, IFAD, the Rockefeller Foundation, UNDP, UNICEF and other agencies. He has been a regular contributor to UNDP’s Human Development Reports and National Human Development Reports. He has been a member of several high level committees of the Government of India including the National Advisory Council and has been associated with the formulation of social policies and legislation in India. He has served on the Governing Council of the Centre for Science and Environment, the Public Health Foundation of India and the International Center for Research on Women. Shiva Kumar is a Visiting Professor at the Ashoka University, Indian School of Business, and Harvard’s Kennedy School of Government where he teaches economics and public policy. Shiva Kumar has done his Masters in Economics from Bangalore University, Post-Graduate Diploma in Management from the Indian Institute of Management, Ahmedabad, and Masters in Public Administration and a Ph.D in Political Economy and Government, both from Harvard University.
Bishwa Nath Tiwari Programme Specialist, HDR, Inclusive Growth, UNDP Bangkok Regional Hub. Bishwa Tiwari works as Programme Specialist at the UNDP Bangkok Regional Hub (BRH) where he engages in the preparation and production of flagship analytical products on human development, ensures the quality of national human development reports working with UNDP country offices of the Asia-Pacific Region, and undertakes substantive technical and policy research. Prior to his reassignment at the BRH, he performed mostly these functions at Regional Bureau for Asia and the Pacific (RBAP), New York during August 2013 – January 2015. Bishwa worked earlier as Deputy Regional Programme Coordinator of Human Development Report Unit at the Asia-Pacific Regional Centre, Bangkok from January 2011 to July 2013, where he was engaged in writing the Asia-Pacific Human Development Report, planning and managing regional HDR project, undertaking capacity development measures, and providing country support. Prior to this, he served as M & E advisor of the UNDP’s UPPR project in Bangladesh (2009-10), and Manager of two Government of Nepal/UNDP projects – Poverty Monitoring for PRSP and National HDR (2002 – 2009). He also served as Vulnerability Analysis and Mapping Officer in WFP (2000-2001), with the responsibility of assessing food insecurity & vulnerability, and monitoring & evaluation of WFP programmes. Bishwa started his career as a teacher in Tribhuvan University in 1981 and continued until 1999 where apart from teaching Economic Theory he worked as Advisor/consultant for more than two dozens of government, non-government organizations and civil society. Born in Nepal, Bishwa holds PhD in Economics from Rajasthan University, MA in Economics from Tribhuvan University, and MSc in Environmental and resource Economics from University of London. Apart from writing regional and national HDRs, he has authored 2 books, co-authored/written a chapter in 7 books and published more than a dozen of research articles in national and international journals.
Presenter: Zenda Ofir
Zenda Ofir is a South African evaluation and KM specialist who has conducted M&E assignments in more than 30 countries in Africa and Asia for more than 40 major organisations. She has worked from local to global levels in many diverse areas of development and research evaluation. She is a former AfrEA President, IOCE Vice-President and AEA Board member, and frequently serves in advisory capacities for global, multilateral and regional organisations, among others GAVI, UNDP, WHO, CGIAR, AGRA, CLEAR-AA and the Rockefeller Foundation. With a PhD in Chemistry, Zenda was Director of Research at Pretoria University and senior manager at a South African Science Council before moving into evaluation. She has been a visiting professor at the University of Hiroshima and presented for several years the Aid Effectiveness module of the United Nations University in Tokyo. She is currently an honorary professor at the School for Public Leadership, University of Stellenbosch.
Zenda prefers to work with development interventions that strengthen the capabilities of individuals, organisations and institutional systems, and that make a real, long-term difference in society.
Chair: Mr. Juan Manuel Cordero Rapporteurs: Ms. Hortensia Perez & Ms. Ana Rosa Soares Recap of emerging issues and lessons from Day 1 & 2 by Session Chairs and Rapporteurs
Discussion on implications for country cases and way forward
MCs: Ms. Azusa Kubota & Mr. Indran Naidoo
Mr. Mashwahle Diphofa, Director General, Office of the Public Service Commission
Mr. Ernest Fausther, OIC, UNDP Johannesburg Regional Service Center
Mr. Juha Uitto, OIC, Evaluation Office, UNDP
Chairpersons report back to the roundtable discussion
Rapporteurs: Oscar Garcia, Evaluation Advisor, Alexandra Chambel, Evaluation Specialist, UNDP Evaluation Office
Rapporteur: Professor Sonia Ospina NYU Wagner Graduate School of Public Service