Data Engineer, GDT, ESG

The Government Technology Agency (GovTech) aims to transform the delivery of Government digital services by taking an "outside-in" view, putting citizens and businesses at the heart of everything we do. We also develop the Smart Nation infrastructure and applications and facilitate collaboration with citizens and businesses to co-develop technologies.

Join us as we support Singapore’s vision of building a Smart Nation - a nation of possibilities empowered through info-communications technology and related engineering.

We are seeking a Data Engineer to join our team.

You will be part of a data team deployed at a government agency, responsible for designing, building, and maintaining reliable data pipelines and curated datasets to support analytics and data science use cases.

The role ensures data quality, accessibility, reliability, and maintainability across multiple data sources and platforms.

The role works closely with analysts, data scientists, product managers and product owners to enable effective use of data for business and operational needs.

What you will be working on

Collaboration with cross functional teams to translate data requirements into technical solutions and support data usage needs.

Collaborate with government agency’s IT teams on technology stack, infrastructure and security alignment.

Build out data product as part of a data team.

Architect and build ingestion pipelines to collect, clean, merge, and harmonise data from different source systems.

Day-to-day monitoring of databases and ETL systems, e.g., database capacity planning and maintenance, monitoring, and performance tuning; diagnose issues and deploy measures to prevent recurrence; ensure maximum database uptime.

Construction, testing, and maintenance of reusable data models and data structures to support downstream analytics and data science workloads.

Design and build secure mechanisms for end users and systems to access data in data warehouse.

Research, propose and develop new technologies and processes to improve agency data infrastructure.

Collaborate with data stewards to establish and enforce data governance policies, best practices and procedures.

Maintain data catalogue to document data pipelines, datasets, metadata, and dependencies.

Execution of data quality checks, validation processes, and basic reconciliation to ensure data accuracy and consistency.

Implement and enforce data security best practices, including access control, encryption, and data masking, to safeguard sensitive data.

Monitoring and troubleshooting of data pipeline performance, reliability, and operational issues.

Strong attention to data accuracy, reliability, maintainability, and operational robustness.

What we are looking for

Deep understanding of system design, data structure and algorithms, data modelling, data access, and data storage.

Demonstrated ability in using cloud technologies such as AWS, Azure, and Google Cloud.

Experience in architecting data and IT systems.

Experience with distributed data technologies such as Spark, Hadoop.

Proficiency in programming languages such as Python, Java, or Scala.

Proficiency in writing SQL for databases.

Familiarity with building and using CI/CD pipelines.

• Familiarity with DevOps tools such as Docker, Git, Terraform.
• Sound understanding of ETL and ELT concepts, data modeling principles, and data warehousing practices.
• Ability to collaborate effectively with analysts, data scientists, product managers and product owners.

Preferred Requirements

Bachelor’s Degree, preferably in Computer Science, Software Engineering, Data Engineering, Information Technology, or related disciplines.

Experience in designing, building, and maintaining batch and real-time data pipelines.

Experience with Databricks.

• Experience with implementing technical processes to enforce data security, data quality, and data governance.
• Familiarity with government systems and government's policies relating to data governance, data management, data infrastructure, and data security.
• Proficiency in SQL and experience with relational databases.

Familiarity with cloud-based data platforms and services.

Familiarity with ETL and ELT tools, orchestration frameworks, and data pipeline monitoring practices.

Familiarity with version control systems and CI and CD practices.

We are an equal opportunity employer and value diversity at our company as we believe that diversity is meaningful to innovation. Our employee benefits are based on a total rewards approach, offering a comprehensive and market-competitive suite of perks. This includes generous leave benefits to meet your work-life needs. We trust that you will get the job done wherever you are, and whatever works best for you – so work from home or take a break to exercise if you need to*. We also believe it’s important for you to keep developing your skill in the constantly-evolving tech landscape, so we provide and support a plethora of in-house a