Data Engineer

Job Posting Organization:
The World Bank Group is a prominent global partnership consisting of five institutions dedicated to addressing the most pressing development challenges faced by countries around the world. Established with the mission to end extreme poverty and promote shared prosperity, the organization operates in 189 member countries and has over 130 offices globally. The World Bank Group is recognized as one of the largest sources of funding and knowledge for developing nations, leveraging data, research, and technology to implement innovative solutions for sustainable development. The organization emphasizes collaboration with both public and private sector partners to invest in transformative projects that aim to improve the lives of people in developing countries.

Job Overview:
The Data Engineer position at the World Bank Group is a critical role within the Information and Technology Solutions (ITS) Vice Presidential Unit (VPU). This role is designed for individuals who are passionate about data and technology and want to contribute to the organization's mission of ending extreme poverty and boosting shared prosperity. The Data Engineer will be responsible for designing, building, and maintaining the data infrastructure that supports the organization's data-driven decision-making processes. This includes developing ETL processes, optimizing data retrieval performance, and collaborating with various stakeholders to gather and understand data requirements. The position requires a strong understanding of data engineering principles and practices, as well as the ability to work independently with limited supervision. The Data Engineer will play a pivotal role in advancing the Bank's digital transformation by enabling data, AI, information, and knowledge capabilities across the institution, ultimately supporting the organization's data integration and transformation initiatives.

Duties and Responsibilities:
The Data Engineer will have a wide range of responsibilities, including but not limited to:

• Data Pipeline Development: Designing, developing, and maintaining data pipelines for ingestion, transformation, and serving across batch and streaming workloads. Building ETL/ELT workflows to integrate data from diverse sources into enterprise data platforms. Developing data transformation logic using technologies such as Apache Spark, PySpark, SparkSQL, and SQL. Implementing change data capture (CDC) patterns for real-time data synchronization.
• Federated Data Pipelines & Domain Enablement: Supporting federated data pipeline architecture that enables Line of Business (LOB) teams to manage their domain data. Contributing to self-serve data infrastructure that abstracts complexity and allows domain teams to build pipelines independently.
• Templates, Blueprints & Patterns: Developing reusable pipeline templates and Infrastructure as Code (IaC) patterns for common data product types. Creating blueprints for data ingestion, transformation, quality validation, and serving that LOB teams can customize.
• Data Integration: Integrating data from multiple internal and external sources into unified data assets. Building reusable data integration patterns and connectors for enterprise data sources.
• Data Quality & Testing: Implementing data quality checks, validation rules, and automated testing within pipelines. Monitoring data quality metrics and remediating issues proactively.
• Data Observability & Operations: Implementing logging, monitoring, and alerting for pipeline health and performance. Building dashboards to track pipeline execution and data freshness.
• Analytics & AI Enablement: Building data pipelines that enable analytics, reporting, and business intelligence use cases. Preparing and serving data for machine learning and AI workloads.
• Collaboration & Enablement: Partnering with data architects and collaborating with business analysts and data scientists to understand data requirements.
• Coaching & Technical Mentorship: Supporting data engineering delivery with contractor and consultant teams under guidance from senior team members. 1
• Continuous Improvement: Assisting in evaluating emerging data engineering technologies and identifying opportunities to enhance pipeline performance.

Required Qualifications:
The ideal candidate for the Data Engineer position should possess a strong foundation in data engineering principles and practices. Typically, this includes a master's degree with at least 5 years of relevant experience or a bachelor's degree with a minimum of 7 years of relevant experience, or an equivalent combination of education and experience. Core skills and capabilities required for this role include demonstrated expertise in data engineering, strong knowledge of data modeling and integration techniques, advanced experience with modern data lake architectures, and proven experience applying DevOps principles. The candidate should also have experience working within Agile environments and possess excellent stakeholder management and communication skills.

Educational Background:
Candidates are expected to have a master's degree in a relevant field such as Computer Science, Information Technology, Data Science, or a related discipline. A bachelor's degree may be acceptable if accompanied by significant relevant experience. Additional certifications in Data Engineering, Data Analytics, or related fields are recommended and may enhance a candidate's qualifications.

Experience:
The position requires a minimum of 5 years of experience for candidates with a master's degree or at least 7 years for those with a bachelor's degree. Experience should include a strong background in data engineering, including the design, development, and optimization of scalable data pipelines and data processing solutions. Familiarity with modern data lake architectures and experience in Agile environments are also essential.

Languages:
The mandatory language for this position is English. Proficiency in additional languages may be considered an asset but is not required.

Additional Notes:
This position is a local recruitment opportunity with a term duration of 3 years. The World Bank Group offers a comprehensive benefits package, including a retirement plan, medical, life, and disability insurance, as well as paid leave, including parental leave. The organization is committed to diversity and inclusion and does not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability. The role is expected to be full-time, and the organization encourages applications from individuals who are passionate about making a difference in the world.