External Final Evaluation (TOR)

Country Office: People in Need (PIN) Armenia
Project Name: EU4Shirak: Wool for Jobs
Project Length: March 1st 2018 – September 30th 2020
Duration of Final Evaluation: 25 days
Estimated Start Date: As soon as possible


 
  1. Introduction
  2. 1.1 PIN Background
People in Need (PIN) is an international, non-profit organization established in early 1990s in the Czech Republic. Since then, PIN has grown to be the biggest relief and development organization of its kind in post-communist Europe and currently provides humanitarian and development assistance in 24 countries worldwide.
People in Need established a country program in Armenia in 2003. PIN’s goal in Armenia is supporting a strong civil society that takes an active part in poverty reduction and sustainable development.  We work in four interlinked sectoral directions: sustainable livelihoods and environment; education and skills development; good governance at the local level; and human rights promotion through independent media and media literacy. More information on PIN Armenia and its’ projects can be found here: Facebook and PIN Armenia Website
  1. 1.2 Project Summary
“European Union for Shirak: Wool for Jobs” (EU4SWJ) is a 2.5-year EUR 540,000, EU funded Action that was initiated in March 2018. The overall objective (impact) of the Action is to increase employment and economic competitiveness in the crafts sector in Shirak region. PIN, in partnership with Women Development Resource Centre Foundation (WINNET), Shirak Chamber of Commerce & Industry (SCCI), and Amasia Municipality has worked to achieve this through the establishment of Amasia Wool Factory, disbursement of grants to SMEs or wool craft start-ups, and skills training to support job seekers to meet the evolving demands of the emerging business sector. The project has applied a value chain development approach. Through these initiatives the Project has worked towards achieving the following Specific Objectives:
  1. Creation of sustainable jobs for people in Shirak: 60 new FTE, 12 of which are quality jobs
  2. Increased competitiveness of SMEs working along the wool value chain in Shirak: 6 SMEs supported
  3. 1.3 Project Status
As of 30 September 2020, all project planned initiatives have completed and the contractual implementation phase has closed. In line with the objectives of the Project: Amasia Wool Factory is operational and under the management oversight of Amasia Foundation, of which PIN, WINNET, and SCCI are represented as Founding Partners. The supported SMEs and start-ups remain operational and relationships with project beneficiaries remain open and accessible. The project underwent an internal mid-term evaluation in August 2019 and identified its strengths and weaknesses and provided recommendation for the remaining implementation period. The selected Evaluator will be provided with the mid-term evaluation, all official donor reports and other key documents to inform the successful completion of this assignment.

Main Assignment: External Final Evaluation
 
  1. Purpose of the Evaluation
The purpose of this final evaluation is to provide an overall assessment of the project’s performance in relation to achievement of the intended results and in terms of how they have been delivered. The evaluation will identify key lessons and propose practical recommendations that will enable PIN, its partners and other stakeholders to enhance the impact of future, similarly focused projects.
  1. 2.1 Scope
The evaluation will look over the whole life of the project’s delivery period; 01 March 2018 – 30 September 2020, and assess the intended direct results and also consider some of the indirect benefits brought about through the projects work. Specifically, it will focus its scope around the following workstreams:
  • Establishment and management of the wool factory;
  • Direct employment;
  • Viability and competitiveness of the supported SMEs;
  • Public-Private-Partnerships established; and,
  • Advisory support provided to SMEs and the Factory.
The Evaluator will conduct their work  primarily in Shirak region, with the focus in the main activity area of Amasia. Some aspects of the evaluation will be required  to be undertaken in Yerevan.
  1. 2.2 Audience for the Evaluation Results
The evaluation results will be shared with EU, project partners, Ministry of Territorial Administration and Infrastructures, Shirak regional government, Amasia Municipality and other relevant stakeholders, as well as with PIN HQ to consider the findings and recommendations for future programming.     
 
  1. 2.3 Methodology
The evaluator will be responsible for developing the evaluation design and methodology in order to meet the above stated goal and objectives. The methodology should be informed by the Development Assistance Criteria (DAC) of Relevance, Effectiveness, Efficiency, Impact and Sustainability and use a mix of qualitative and quantitative research methods to answer the questions articulated in this TOR. Both qualitative and quantitative methods should be used: document review, field research, etc.  It is expected that the evaluator uses participatory methods including key informant interviews and focus group discussions as well first-hand direct observations. Desk-based review of key project documents including the project proposal, Logframe workplans, reports and procurement documents. A list of key stakeholders that the evaluator will be expected to consult with is provided under Annex A.
Applicants to this assignment are requested to outline the methodology and approach they will use to undertake this evaluation, in their submitted proposal.
    1. 2.3.1 Evaluation Questions to be Answered
The following suggested questions are expected to be answered through this evaluation. Answers should be specific, analytical and evidence driven. Lessons and recommendations should be drawn out against each question and backed up by evidence. Additional questions that the evaluator deems appropriate must be agreed with PIN in advance and as part of the inception report approval process.


If an answer cannot be provided on the foundation of date or evidence, this must be communicated to the nominated PIN Focal Person as soon as possible. Failure to do so can result in decreasing the consultant’s remuneration
  1. 2.4 Specific Tasks to be Undertaken by the Evaluator
The evaluator will be required to undertake the following tasks:
  1. Design and finalise the evaluation methodology, tools and workplan, detailing the resources and support need to complete the evaluation to time and quality, and agree with PIN
  2. Undertake the evaluation activities in the field.
  3. Analyse the data and present findings to PIN and project partners
  4. Prepare first draft of the Final Evaluation Report for review by PIN
  5.  Finalise the Final Evaluation Report considering the feedback provided by PIN.
The report must provide clear, evidence-based and analytical answers to all evaluation questions. It should contain all the necessary raw data information used in the process of data collection and analysis, and any other necessary annexes and references used. Final Evaluation Report template is provided in Annex B.
  1. 2.5. Assignment Deliverables and Proposed Timeframes 
  2. Assignment Terms
  3.  
  4. 3.1 Budget
  5. The maximum budget of the project final evaluation is 6,000 EUR including taxes. Per-diem, accommodation, transportation, translation and other costs should be included in the evaluation fee.
     
  6. 3.2 Management Arrangement

  7. The Evaluator will report to and liaise with the PIN Focal Person on all matters and decisions relating to this assignment. PIN will be responsible for arranging meetings with all relevant stakeholders. To enable this the Evaluator must provide a list and schedule of meetings in good time to ensure all meetings can be arranged in a respectful and timely way. If required, PIN can support the Evaluator with logistics arrangements, but the Evaluator will be responsible for making the respective payments.
     
  8. 3.3 Payment Modality
  9. The Evaluator will report to and liaise with the PIN Focal Person on all matters and decisions relating to this assignment. PIN will be responsible for arranging meetings with all relevant stakeholders. To enable this the Evaluator must provide a list and schedule of meetings in good time to ensure all meetings can be arranged in a respectful and timely way. If required, PIN can support the Evaluator with logistics arrangements, but the Evaluator will be responsible for making the respective payments.
    4. Application Process
  10.  
  11. 4.1 Evaluator Experience
  12. Essential
  • At least 10 years of professional experience in conducting development project evaluations;  
  • Experience of evaluating small scale market systems and SME development projects;
  • Proven experience and knowledge of conducting quantitative and qualitative research;
  • Excellent analytical skills;
  • Significant practical experience in report writing and formulation of recommendations; 
  • Excellent spoken and written English.
  1. Preferred
  • Experience evaluating EC-funded projects;  
  • Understanding of project management principles;
  • Previous experience with results‐based monitoring and evaluation methodologies;  
  • Russian language will be considered an advantage.  

  1. Please note that most targeted beneficiaries and stakeholders do not speak English, so relevant translation services need to be considered in the proposed price of the work and organised by the Evaluator in case of foreign evaluators or organizations.  
     


     
  2. 4.2 Proposal Submission
  3. Interested candidates/organizations whose profile matches the qualification requirements stated above are invited to send their:  
  • Curriculum vitae or organizational profile highlighting relevant experience (max.4 pages);  
  • Cover letter stating how your experience and competencies can best deliver the assignment (mas.1 pages);  
  • 2 samples of previous similar work;  
  • Clear and concise proposal outlining the methodology and questions to be asked (max. 4 pages)
  • Assignment Budget (in EUR) broken down by:
    • Personnel Service fees
    • Direct evaluation activity costs
    • Anticipated logistics, travel and subsistence costs
  1.  
    All interested candidates/organizations who meet the above requirements and are confident that their background and experience qualify them to implement Final Evaluation, should e-mail their complete application packs in English language to: hr.armenia@peopleinneed.cz mentioning “Final Evaluation: EU4Shirak project” in the subject line of the e-mail.

    Incomplete applications will not be reviewed. Only short-listed candidates will be contacted. The final decision will be made after the interview, considering candidates relevant experience, qualification and cost efficiency of the offer. 

    OPENING DATE:   12 November 2020  
    APPLICATION DEADLINE:   29 November 2020  
     

    Annex A: List of Recommended Stakeholders

    Annex B: Final Evaluation Report Specification

The Final Evaluation Report, written in English, will be required to comply with the following standards and specification:

1 Executive Summary (max. 2 pages) 
2 Introduction (max. 1 page) 
3 Methodology (max 2 pages) 
4 Findings and Discussions (max. 10 pages) 
5 Conclusions (max. 4 pages) 
6 Lessons learned and associated Recommendations (max. 6 pages)  
7 Annexes 

  1. The report should be submitted electronically to the PIN Focal Person and Five official hard copies to the PIN Armenia Representatives Office.