Associate IT Officer, Data and Information Management (Associate Data Engineer)

Job Posting Organization:
The job is posted by the International Finance Corporation (IFC), which is a member of the World Bank Group (WBG). The WBG is a unique partnership of five global institutions dedicated to ending poverty, increasing shared prosperity, and promoting sustainable development. Established with 189 member countries and over 120 offices worldwide, the WBG is one of the largest sources of funding and knowledge for developing countries. The IFC specifically focuses on the private sector in emerging markets, working with around 2,000 businesses globally. In FY25, IFC's total exposure in developing countries exceeded $70 billion, leveraging its capital, expertise, and influence to help the private sector combat extreme poverty and enhance shared prosperity. The mission of the Corporate Information Technologies Department (CIT) within IFC is to leverage technology to support IFC’s strategic priorities and business operations, providing state-of-the-art information and technology solutions to various sectors including Investment & Advisory Services, Financial Operations, and Treasury. The department aims to design solutions that automate business processes and improve operational efficiency while managing risks effectively.

Job Overview:
The Associate Data Engineer position is a critical role within the growing data and analytics ecosystem at IFC. The successful candidate will be responsible for designing and building modern data pipelines and platforms that support essential business decisions across the organization. This role sits at the intersection of data engineering, cloud technologies, and advanced analytics, transforming raw data into actionable insights. The position requires a hands-on data professional who enjoys solving complex problems and contributing to a global mission. The ideal candidate will operate with a high degree of independence, applying advanced technical knowledge to perform in-depth analyses and develop data engineering solutions. They will address moderately complex technical challenges, propose well-reasoned solutions, and contribute to design and architectural decisions. Collaboration with internal and external stakeholders is essential to align technical solutions with business needs, facilitating informed decision-making. Additionally, the candidate will provide guidance and knowledge sharing to junior team members, enhancing overall team capability and best practices.

Duties and Responsibilities:
The duties and responsibilities of the Associate Data Engineer include:

• Data Pipeline Engineering and Development: Design, develop, and maintain scalable and reliable batch and streaming data pipelines using modern data processing frameworks such as PySpark and SQL. Implement ETL/ELT processes that support the ingestion, transformation, and integration of structured and unstructured data from multiple sources, ensuring pipelines are robust and reusable.
• AI-Enabled Unstructured Data Processing: Build pipelines to ingest and process unstructured and semi-structured content, including text extraction and metadata tagging. Prepare high-quality text datasets to support AI use cases such as search, summarization, and classification.
• Data Modeling and Architecture: Develop and manage data models aligned with modern data lakehouse architectures, contributing to the evolution of IFC’s enterprise data architecture and standards.
• Performance Optimization and Scalability: Analyze and optimize data processing performance, ensuring scalability and cost-efficiency of data solutions within cloud environments.
• Data Governance, security" style="border-bottom: 1px dotted #007bff !important;">Security, and Compliance: Implement data governance practices, ensuring adherence to enterprise standards for data privacy and security.
• Production Support and Operational Excellence: Deploy, schedule, and monitor data workflows in production, troubleshooting pipeline failures and ensuring high availability of critical data assets.
• Collaboration and Stakeholder Engagement: Partner with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable solutions, providing technical guidance and mentorship to junior team members.

Required Qualifications:
The required qualifications for the Associate Data Engineer position include:

• A Master’s degree in Computer Science, Engineering, Data Science, or a related field with at least 5 years of relevant experience.
• Demonstrated experience in designing and implementing data engineering solutions in enterprise environments.
• Strong programming skills in Python and SQL, with hands-on experience in Apache Spark.
• Proven experience with the Databricks ecosystem, including Notebooks, Jobs, Delta Lake, and Unity Catalog.
• Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
• Solid understanding of data lakehouse architectures, data modeling, and distributed systems.
• Strong analytical and problem-solving capabilities with attention to detail.
• Ability to independently manage priorities and deliver high-quality solutions under minimal supervision.
• Effective communication skills to collaborate with both technical and non-technical stakeholders. 1
• Understanding of data governance, DevOps practices, and workflow orchestration. 1
• Experience with real-time or streaming data processing frameworks. 1
• Hands-on experience applying AI/GenAI techniques to unstructured data, including text preprocessing and information extraction. 1
• Understanding of Responsible AI considerations for enterprise data platforms.

Educational Background:
The educational background required for the Associate Data Engineer position includes a Master’s degree in Computer Science, Engineering, Data Science, or a related field. This advanced degree is essential to ensure that the candidate possesses the necessary theoretical knowledge and practical skills to perform effectively in this role.

Experience:
The level of experience needed for the Associate Data Engineer position is at least 5 years of relevant experience in data engineering or a related field. This experience should include designing and implementing data engineering solutions in enterprise environments, demonstrating a strong understanding of data processing frameworks and cloud technologies.

Languages:
The mandatory language for this position is English. Proficiency in English is essential for effective communication within the organization and with stakeholders. Additional languages may be beneficial but are not specified as preferred.

Additional Notes:
The position is a full-time role with a term duration of 3 years. It is part of an international recruitment effort, indicating that candidates from various countries are encouraged to apply. The World Bank Group offers comprehensive benefits, including a retirement plan, medical, life and disability insurance, and paid leave, including parental leave. The organization is committed to being an equal opportunity and inclusive employer, ensuring that all individuals are treated fairly regardless of gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.