Data Engineer

Data Engineer

Job Overview

Key Responsibilities

Data Engineering & Architecture

• Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
• Build and optimize data solutions for processing large volumes of structured and unstructured data.
• Design and implement modern data architectures that support analytics, reporting, machine learning, and business intelligence initiatives.
• Ensure data platforms are secure, reliable, scalable, and maintainable.
• Support real-time and batch data processing requirements.

Data Quality & Governance

• Develop and maintain data validation, data quality, and data cleansing processes.
• Implement monitoring, auditing, and alerting mechanisms to ensure data integrity.
• Identify and resolve data anomalies, inconsistencies, and performance bottlenecks.
• Establish best practices for data governance, lineage, and metadata management.

Platform Development
- Develop and support solutions using:

• Databricks
• Snowflake
• Azure Synapse Analytics
• SQL Server
• PostgreSQL
• Cloud and hybrid data platforms
• Optimize database performance, query execution, and storage strategies.
• Support data migration, modernization, and integration initiatives.

Required Skills & Experience

Technical Skills

• 4 years of experience designing, building, and maintaining data platforms and solutions.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
• Experience with technologies like:

• Databricks
• Snowflake
• Azure Synapse Analytics
• Microsoft SQL Server
• PostgreSQL
• SQL development and optimization
• Experience developing ETL/ELT pipelines and integrating data from multiple sources.
• Strong understanding of data modelling, data warehousing, and lakehouse architectures.
• Experience implementing data quality, validation, cleansing, and reconciliation processes.
• Knowledge of cloud-based data platforms and modern data engineering practices.
• Familiarity with CI/CD, DevOps, automation, and infrastructure-as-code principles is desirable.
• Self-motivated and capable of working independently with mínimal supervision.
• Proven ability to support client initiatives and deliver business outcomes.
• Comfortable working across diverse technologies and adapting to changing technical environments.
• Positive, collaborative, and solutions-focused attitude.