United Nations Development Programme (UNDP)

Lead Evaluator (Terminal Evaluation)

United Nations Development Programme (UNDP)

Job Description

  In accordance with 2016 UNDP Evaluation Policy, UNDP Country Office in Malaysia is commissioning a terminal evaluation upon completion of a UNDP-supported Government-financed project implementation under the Country Programme Action Plan (CPAP) 2016 – 2020. This terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the project titled Implementingthe National Sustainable Consumption and Production Blueprint through Government Green Procurement (SCP-GGP).

The details of the SCP-GGP project to be evaluated are as follows: Project Summary Table ATLAS Project ID: 00094672 at endorsement (US$) at completion (US$) ATLAS Output ID: 00098761 Government financing (government cost-sharing): 374,920 To be confirmed (TBC) during TE Country: Malaysia UNDP TRAC: 25,080 TBC during TE Region: Asia Other: 250,000 (in-kind contribution) 100,000 (donors/private sector) TBC during TE CPAP Outcome: 2.0 Implementation of a national development agenda that enables green growth through climate-resilient measures, sustainable management of energy and natural resources, and improved risk governance.

Total co-financing: 350,000 TBC during TE 11th Malaysia Plan Linkage: Strategic Thrust 4: Pursuing Green Growth for Sustainability and Resilience Focus Area B: Adopting the Sustainable Consumption and Production Concept Strategy B1: Creating Green Markets Total Project Cost (government + UNDP): 400,000 TBC during TE Implementing Partner: Environment and Natural Resource Economics Section, Economic Planning Unit, Prime Minister’s Department Malaysia Project Document (ProDoc) Signature (date project began): 6 July 2018 (Operational) Closing Date: Proposed: 31 December 2020 Actual: 31 December 2020 Duties and Responsibilities

Objective and Scope

The project was designed to provide incremental support that will lead to the full adoption and implementation of the National Sustainable Consumption and Production (SCP) Blueprint, particularly through SCP Pathway 1 Government Green Procurement (GGP); to achieve the 11th Malaysia Plan’s target of 20% of selected groups of products and services in government procurement to be green procurement by year 2020. The project has three main outputs namely:
  1. Enabling policy and institutions institutionalized for National SCP Blueprint and GGP implementation.
  2. Technical and institutional capacity for SCP and GGP built and enhanced, particularly government procurement practitioners and industry players such as Small and Medium Enterprise (SME).
  3. Best practices of GGP are demonstrated by developing and piloting product criteria, guidelines and standard operating procedures in construction sector, and monitoring & evaluation system.
These outputs will in turn contribute to the achievement of the 11th Malaysia Plan Strategic Thrust 4 Pursuing Green Growth for Sustainability and Resilience, and Country Programme Action Plan 2016 – 2020 between Government of Malaysia and UNDP – Outcome 2 Enhancing national resiliency to climate variability and change.

The TE will be conducted according to the guidance, rules and procedures established by UNDP as reflected in the UNDP Evaluation Guidelines.

The objectives of the evaluation are to assess the achievement of project results, draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming, in addition to an assessment of the National SCP Blueprint to determine the current status of proposed action plans and to identify potential gaps for further improvement.

Evaluation approach and method

An overall approach and method[1] for conducting project terminal evaluations of UNDP supported projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Evaluation Guidelines (http://web.undp.org/evaluation/guideline/) and UNDP Guidance for Conducting Terminal Evaluations of  UNDP-supported, GEF-financed Projects. The National Consultant cum Evaluator is expected to prepare, amend, complete and submit a set of questions covering each of these criteria in consultation with UNDP Malaysia Country Office; as part of  an evaluation inception report, and shall include it as an annex to the final report.

The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular, Economic Planning Unit – the implementing partner, UNDP Country Office, project team, and key stakeholders. Interviews will be held with the following organizations and individuals at a minimum:
  • Environment and Natural Resource Economics Division, Economic Planning Unit at the Prime Minister’s Department
  • Ministry of Finance Malaysia
  • Ministry of Environment and Water (KASA)
  • Ministry of Energy and Natural Resources (KeTSA)
  • Malaysia Green Technology and Climate Change Centre (MGTC)
  • Public Works Department (JKR)
  • Universiti Technology MARA (UiTM)
  • Institute of Strategic and International Studies (ISIS) Malaysia
The evaluator will review all relevant sources of information, such as the project document, project reports – including Mid-Year Progress Report, Annual Progress Report, project budget revisions, project files, national policy and strategic documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex A of this Terms of Reference.

Evaluation Criteria & Ratings

An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework in the Project Document (which is available at https://open.undp.org/projects/00094672), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary.   The obligatory rating scales are included in Annex B.

1. Monitoring and Evaluation rating

2. IA& EA Execution rating

M&E Design at entry Quality of UNDP Oversight and Quality Assurance (QA) M&E Plan Implementation Quality of Implementing Partner’s Execution Overall quality of M&E Overall quality of Oversight & QA and Execution 3. Assessment of Outcomes  rating

4. Sustainability rating

Relevance Financial Resources: Effectiveness Socio-political: Efficiency Institutional framework and governance: Overall Project Outcome Rating Environmental: Overall likelihood of sustainability: Project finance / co-finance

The Evaluation will assess the key Financial Aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures.  Variances between planned and actual expenditures will need to be assessed and explained.  Results from recent financial audits, as available, should be taken into consideration. The evaluator will receive assistance from the Country Office (CO) and Project Team to obtain financial data in order to complete the co-financing table below, which will be included in the terminal evaluation report.

Mainstreaming

UNDP supported projects are key components in UNDP country programming, as well as regional and global programmes. The evaluation will assess the extent to which the project was successfully mainstreamed with other UNDP priorities, including poverty alleviation, improved governance, the prevention and recovery from natural disasters, and gender.

Impact

The evaluator will assess the extent to which the project is achieving impacts or progressing towards the achievement of impacts. Key findings that should be brought out in the evaluations include whether the project has demonstrated: a) verifiable improvements in the implementation of the National Sustainable Consumption and Production Blueprint through government green procurement, and b) demonstrated progress towards these impact achievements.

Conclusions, recommendations & lessons The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons.

Implementation arrangements

The principal responsibility for managing this evaluation resides with the UNDP Country Office (CO) in Malaysia. The UNDP CO will contract the evaluator and ensure the timely Coordination of meeting arrangements within the country for the evaluator. The Project Team will be responsible for liaising with the Evaluator to set up stakeholder interviews, arrange meetings, coordinate with the Government etc.

Evaluation timeframe

The total duration of the evaluation will be 30 days according to the following plan: Preparation including TE Inception Report with detailed work plan

5 days 30 April 2021 Evaluation Mission (online/physical)

20 days 30 June 2021 Draft Evaluation Report & SCP Blueprint Assessment Report

17 days 31 July 2021 Final Reports

8 days 15 August 2021 Evaluation deliverables

The evaluation team is expected to deliver the following: Inception Report including detailed work plan

Evaluator provides clarifications on timing and method No later than 2 weeks before the evaluation mission.

Evaluator submits to UNDP CO Presentation

Initial Findings End of evaluation mission To project management and UNDP CO Draft Final Reports

Full report, (per annexed template) with annexes Within 3 weeks of the evaluation mission Sent to CO for review Final Reports*

Revised report Within 1 week of receiving UNDP comments on draft Sent to CO for uploading to UNDP ERC.

*When submitting the final evaluation report, the evaluator is required also to provide an 'audit trail', detailing how all received comments have (and have not) been addressed in the final evaluation report.

[1] For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163 Payment schedule

20% Following submission and approval of the detailed work plan and inception report by UNDP CO 50% Following submission and approval of the 1st draft terminal evaluation and SCP Blueprint assessment report by UNDP CO 30% Following submission and approval of the final terminal evaluation and SCP Blueprint assessment report by UNDP CO Competencies

The National Consultant shall have prior experience in evaluating similar projects.  Experience with UNDP-supported projects is an advantage. The evaluator selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities. The evaluator must present the following qualifications: Corporate competencies
  • Commitment to UNDP’s mission, vision, values and ethical standards
  • Sensitivity to cultural, gender, religion, race, nationality and age differences
  • Treat all stakeholders fairly and without prejudice
  • Maintains objectivity and impartiality in handling evaluation processes
Functional competencies
  • Experience in project development, implementation and evaluation particularly in directly managing results-based monitoring and evaluation methodologies
  • Demonstrated experience in conducting evaluation of multi-year and multi-component programmes and projects
  • Familiarity with the norms and issues in sustainable consumption and production
  • Demonstrated strong coordination and facilitation skills
  • Strong interpersonal skills and the ability to initiate discussions with national/local governmental officials, Civil Society Organizations and communities
  • Demonstrated ability to function in a team environment and to deal with complex multi-stakeholder environment
  • Demonstrated ability to prepare and present comprehensive reports

Required Skills and Experience

Education:

  • Minimum 10 years of relevant professional experience in the field of environment (10 points);
Experience:

  • Minimum 5 years of experience with results-based monitoring and evaluation methodologies (25 points);
  • Technical knowledge in the sustainable consumption and production, sustainable and/or green procurement, circular economy, green economy/growth, etc. (25 points);
  • Knowledge of UNDP and Government of Malaysia (10 points).
Language:

Language required for this assignment is English and Malay.

EVALUATOR ETHICS

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex C to be provided by UNDP) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations' DOCUMENTS TO BE INCLUDED WHEN SUBMITTING THE PROPOSALS

Interested individual applicants must submit the following documents/information to demonstrate their qualifications:
  1. Document 1 :Letter of Confirmation of Interest and Availability at  https://www.my.undp.org/content/dam/malaysia/docs/Procurement/Template%20of%20Letter%20of%20Interest.docx;
  2. Document 2: Technical Proposal: on how your qualifications, experience and list of track records can lead to successful deliverables of this assignment within the required timeframe, and provide a methodology and approach on how you will approach and conduct the assignments; and
  3. Document 3:Financial Proposal at https://www.my.undp.org/content/dam/malaysia/docs/Procurement/Financial Proposal Template (Daily Fee) - MYR.doc .All inclusive and takes into account various expenses the candidate expects to incur during the contract, including:
    • The daily professional fee;
    • The cost of travel from the home base to the duty station (UNDP Office, Putrajaya) and vice versa;
    • Communications, utilities and consumables; and
    • Life, health and any other insurance.
  4. Document 4: Personal CV or P11 including areas of expertise and past experiences in similar projects and at least three (3) references at https://www.my.undp.org/content/dam/malaysia/docs/Procurement/P11%20for%20Consultant_Optional.docx
  5. Please submit this information in one file as Document 1, 2, 3 and 4.The system will only accept one attachment , please merge all documents and submit as one file.
  6. Applicants must reply to the mandatory questions asked by the system when submitting the application.
  7. Candidates who fail to submit all the information requested above will be disqualified.
How to Apply:

  • Kindly download the Letter of Confirmation of interest and availability, Financial Proposal Template and General Terms & Conditions mentioned below;
  • Read and agree to the General Terms & Conditions (refer to below link);
  • Click the ‘apply’ icon and complete what is required;
  • Scan all documents into 1 pdf folder and then upload;
  • For clarification question, please email to procurement.my@undp.org. The clarification question deadline is three (3) days before the closing. When emailing for clarification questions, please put "MyIC/2021/012"as the subject matter.
General terms & conditions to be downloaded:

  • The General Terms & Conditions for Individual contract is available at: https://www.my.undp.org/content/dam/malaysia/docs/Procurement/AC_AntiFraud_General%20Conditions%20of%20Contract%20for%20Individual%20Contracts%20(2).pdf
Reimbursable Loan Agreement (RLA): A legal instrument between UNDP and a Company/institution, according to which, the latter makes available the services of an individual delivering time-bound and quantifiable outputs that are directly linked to payments
  • The General Terms & Conditions for Reimbursement Loan Agreement is available at:https://www.my.undp.org/content/dam/malaysia/docs/Procurement/Reimbursable%20Loan%20Agreement%20_%20Terms%20&%20Conditions.pdf
Incomplete proposals may not be considered. Only short-listed candidates may be contacted, and successful candidates will be notified.

ANNEXES 

1.  Annex A: List of Documents to be received by the Evaluators, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex A List of Documents to be revieced by the Evaluators.pdf 2.  Annex B: Rating Scales, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20B%20Rating%20Scales.pdf 3.  Annex C: Evaluation Consultant Code of Conduct and Agreement Form      http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex C Evaluation Consultant Code of Conduct and Agreement Form.pdf 4.  Annex D: Evaluation Report Outline,  http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20D%20Evaluation%20Report%20Outline.pdf 5.  Annex E: Evaluation Report Clearance Form. http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20E%20Evaluation%20Report%20Clearance%20Form.pdf EVALUATION METHOD AND AWARD OF CONTRACT

  • Only those applications which are responsive and compliant will be shortlisted for technical evaluation;
  • Offers will be evaluated according to the Combined Scoring method – where the technical criteria will be weighted at 70% and the financial offer will be weighted at 30%;
  • The technical criteria including education, experience and written test will be based on a maximum 70 points. Only the top 3 candidates scoring 50 points or higher from the technical proposal review will be considered for financial evaluation;
  • Financial score (max 30 points) shall be computed as a ratio of the proposal being evaluated and the lowest priced proposal of those technically qualified;
  • The financial proposal shall specify an all-inclusive fee and including breakdown per deliverable and all costs components required to perform the deliverables identified in the TOR, including professional fee, in-country travel costs, living allowance and any other applicable cost to be incurred by the National Consultant in completing the assignment.  In order to assist the requesting unit in the comparison of financial proposals, the financial proposal must additionally include a breakdown of this daily fee (including number of anticipated working days and all foreseeable expenses to carry out the assignment);
  • Applicant receiving the Highest Combined Score and has accepted UNDP’s General Terms and Conditions will be awarded the contract.
UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, aboriginal groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.

Apply Now