Role- AWS Data Engineer
Location: Atlanta, USA (Day 1 onsite)
Key Responsibilities:
- Design, develop, and maintain batch and streaming ETL/ELT pipelinesusing AWS services (Glue, Lambda, Step Functions, etc.).
- Implement data ingestion frameworksfrom diverse sources (APIs, databases, streaming platforms).
- Ensure data quality, governance, and securityacross all pipelines.
- Build and optimize data lakes and warehousesleveraging Amazon S3, Redshift, Athena, and Lake Formation.
- Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets.
- Monitor and troubleshoot data workflows, ensuring high availability and performance.
- Stay updated with emerging AWS technologies and recommend improvements.
Required Skills & Qualifications
- Strong experience with AWS cloud services: S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS. SQS.
- Proficiency in SQL, Pythonand PySpark
- Knowledge of data modeling, schema design, and performance tuning.
- Familiarity with CI/CD pipelinesand DevOps practices tool (Terraform, CloudFormation).
- Experience with security best practices(IAM, encryption, compliance).