Job Type: 1-year renewable contract
Cloud Data Engineer(Lead)
Position Summary:
Lead Data Engineer for cloud migration projects (Primarily utilizing AWS, IDMC, Databricks and Tableau). Specializing in AWS, Databricks, and Informatica IDMC is responsible for building and maintaining a robust, integrated, and governed data infrastructure that leverages the strengths of the analytics platforms to extract valuable insights from data while ensuring data security, compliance, and high-quality data management.
Job Requirement:
- Primary Skills: 7 to 10 years of experience as Cloud Data Engineer (AWS, Databricks, and Informatica IDMC)
- Strong Pyspark & AWS commercial platform background
- Tech Manager / Cloud Data Architect
- Secondary Skills: Informatica, OAS
Roles and Responsibilities:
- Cloud Data Engineer (AWS, Databricks, and Informatica IDMC)
- Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Databricks' Delta Lake. Integrate Informatica IDMC for metadata management and data cataloging.
- Create, manage, and optimize data pipelines for ingesting, processing, and transforming data using AWS services like AWS Glue, AWS Data Pipeline, and AWS Lambda, Databricks for advanced data processing, and Informatica IDMC for data integration and quality.
- Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
- Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
- Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
- Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring.
Kindly revert with below details in addition to updated resume to rekha@helius-tech.com
Full Name as per the Passport or IC :
Current Salary
Exp Salary (in SGD)
Notice period (availability)
Residential Status in Singapore
Reason for Change
Thanks & Best Regards
Rekha N
Senior Consultant
Whatsapp : +65 9473 3867
rekha@helius-tech.com
https://www.helius-tech.com/careers/
www.helius-tech.com
Singapore -Malaysia- India - Thailand – Japan