Data Engineer (PySpark)

Abu DhabiOn-site2–5 yrsFull-time

Responsibilities

Design, build, and maintain scalable production data pipelines using Python and PySpark. Optimize Spark jobs for performance and automate workflows using Airflow and Jenkins.

Requirements

Requires strong proficiency in Python, PySpark, and SQL with proven experience in CI/CD and pipeline automation. Mandatory previous experience in deploying and tuning data pipelines in production environments is required.

Key skills

PythonPySparkApache SparkSQLNoSQLApache AirflowJenkinsGitGitHub ActionsCI/CDData Pipeline OptimizationExploratory Data AnalysisFeature EngineeringData ImputationData CleansingUnit Testing

Benefits

Competitive Salary Package

Apply now

You'll apply on the employer's official page.