Evaluation Consultant in Montréal

The International Civil Aviation Organization (ICAO) is a specialized agency of the United Nations and the global forum through which its 193 Member States cooperate on international civil aviation. Guided by its vision of achieving the sustainable growth of the global civil aviation system, ICAO develops policies and international Standards, undertakes compliance audits, conducts studies and analyses, provides support, and strengthens aviation capacity in cooperation with Member States and other stakeholders.

The Office of Internal Oversight (OIO) is responsible for the systematic evaluation and internal audit of ICAO's programmes, projects, and activities, with a view to assessing whether the Organization's stated objectives and impacts have been achieved, and resources have been expended in accordance with applicable rules and regulations and with due regard to economy, efficiency and effectiveness.

Major duties and Responsibilities:

• Under the general guidance of the Chief, Office of Internal Oversight (OIO), and reporting to the Evaluation Specialist, the consultant will contribute to the independent mid‑term evaluation of ICAO’s 2026–2028 Business Plan.
• The evaluation will assess the Plan’s relevance, coherence, effectiveness, efficiency, emerging results and prospects for sustainability; examine the adequacy of its design, alignment with ICAO’s Strategic Plan, governance, resourcing, monitoring, risk‑management and reporting arrangements; and generate timely evidence, lessons and actionable recommendations to strengthen implementation during the remainder of the planning cycle and inform future corporate planning.

Function 1: Prepares the inception report, evaluability assessment and evaluation design

• The Consultant, with the support of the Evaluation Specialist, will prepare an Inception Report that operationalizes the TOR.
• The work will apply a theory‑based, utilization‑focused and mixed‑methods design.
• Reconstruct and validate the Business Plan theory of change, results chain, assumptions, dependencies and external factors.
• Assess evaluability, including the completeness and quality of baselines, targets, indicators, data sources, financial linkages, reporting frequency and disaggregation.
• Map Strategic Goals, High‑Priority and Supporting Enablers, outcomes, outputs, programmes, projects, activities, resources, accountable entities and corporate risks.
• Finalize the evaluation matrix, judgment criteria, sampling strategy, stakeholder map, methods, data‑quality plan, ethics protocol, limitations, work plan and report outline.
• Design and pilot data collection instruments and interview or focus‑group protocols.

Function 2: Collects, validates and analyses quantitative and qualitative evidence

• The Consultant will review the Business Plan, Strategic Plan, Operating Plans, Results and Resource Frameworks, Governance and Risk Documentation, Performance and Financial Data, Prior Evaluations and Audits, Assembly and Council Documentation, and other relevant sources.
• The team will combine portfolio‑wide analysis with a purposive, risk‑based sample covering the six strategic goals, enablers, regions, funding and implementation status, delivery modalities, data quality and strategic significance.
• Compile and validate a source and data inventory linking Business Plan elements, indicators, resources, accountable entities and risks.
• Collect evidence through document review, analysis of ICAO systems and datasets, interviews, focus groups, surveys, process walkthroughs and selected comparative case studies.
• Prepare accurate summary interview notes and case‑study or portfolio analytical files that provide an auditable evidence trail.
• Triangulate evidence, assess its strength, analyse progress against baselines, milestones and expected trajectories, and distinguish verified findings, stakeholder perceptions and evidence gaps.
• Prepare and present emerging findings for validation and OIO quality assurance.

Function 3: Prepares the draft and final evaluation products and formulates prioritized, actionable recommendations

• The Consultant will synthesize the evidence into a concise, balanced and decision‑oriented evaluation report that responds to the evaluation questions and links findings, conclusions and recommendations.
• Prepare a draft report organized by evaluation criterion, with evidence‑based findings, conclusions, lessons, good practices and prioritized recommendations.
• Develop recommendations specifying rationale, priority, responsible entity, indicative timeframe, resource implications and proposed closing criteria.
• Present the draft findings and facilitate validation with relevant stakeholders while safeguarding the evaluation’s independence.
• Finalize the evaluation report, executive summary, recommendation tracking table and presentation materials for senior management, EAAC and/or the Council, as required.

Function 4: Performs Other Duties, As Assigned

Result of Service:

• Inception report, including reconstructed theory of change, evaluability assessment, evaluation matrix, sampling strategy, stakeholder map, methods, data collection instruments, data-quality and ethics protocols, limitations, work plan and report outline – draft and final.
• PowerPoint presentation on emerging findings or validation workshop materials.
• Mid‑term evaluation report following OIO outline and template, normally not exceeding 50 pages excluding annexes – draft and final.
• Comment matrix recording the disposition of stakeholder comments.

Qualifications And Experience:

• An advanced level university degree (Masters’ degree or equivalent) in management, evaluation, economics, social science, an aviation‑related field, or any other related field is required.
• A first‑level university degree in combination with additional years of qualifying experience may be accepted in lieu of the advanced university degree.
• A minimum of ten years of progressively responsible professional experience in evaluation, including experience leading complex corporate, strategic, policy or organizational evaluations.
• Demonstrated expertise in theory‑based, utilization‑focused and mixed‑methods evaluation, including evaluability assessment, theories of change, contribution analysis, portfolio analysis and purposive sampling.
• Strong quantitative and qualitative analytical skills, including assessment of results and resources frameworks, indicators, baselines, targets, financial and performance data, governance, risk and reporting systems.
• Experience conducting evaluations in the United Nations system or another multilateral or international organization, with sound knowledge of UNEG Norms and Standards.
• Excellent facilitation, presentation and report‑writing skills in English.
• Demonstrated ability to deliver high‑quality, evidence‑based products within strict deadlines.

Conditions of Employment:

• The consultant will be held to the highest ethical standards and will be required to sign a Code of Conduct and declarations covering independence, conflicts of interest and confidentiality upon acceptance of the assignment.
• The evaluation will be conducted in accordance with UNEG Norms and Standards and applicable ICAO evaluation requirements.
• The selected consultant is expected to be employed within the period of 2 December 2026 – 30 June 2027 for 55 working days.