DataBricks Engineer (Ref 26437)

Responsibilities

• As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing.

• Your day-to-day activities will include creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.

• You are expected to be a subject matter expert, collaborate and manage the team to perform effectively.

• You will be responsible for team decisions, engage with multiple teams, and contribute to key decisions while providing solutions to problems for your immediate team and across multiple teams.

• Advanced proficiency in Data Engineering is required.

• Advanced proficiency in Data Migrations, Data Access, and Data Processing is recommended, while intermediate proficiency in Data Pipelines is suggested.

• Build and operate the core WOG data platform

• Support agencies in integrating with the platform

• Develop data connectors and pipelines to onboard agency datasets efficiently

Requirements

• Degree in Computer Science or related studies

• Minimum 3-5 years of hands-on working experience in Databricks

Licence no: 12C6060

Pay: Up to $10,000.00 per month

Work Location: In person