Big Data Engineer

You will design and implement solutions for large-scale data processing challenges.

Responsibilities

• Design, build, and maintain efficient, reusable, and reliable code.

• Drive architectural, design, and status calls with multiple stakeholders.

• Own tasks end-to-end, including testing, troubleshooting, and correcting implementation problems.

• Conduct technical training, write whitepapers, and share knowledge across teams.

• Ensure high-quality software development through complete documentation and traceability.

Required Skills

• 8+ years of software development experience in Big Data technologies including Spark, Hive, and Hadoop.

• Strong experience building and tuning Spark pipelines using Scala or Python.

• Proficiency in Java, Python, or Scala.

• Experience writing complex Hive queries to derive business-critical insights.

• Deep understanding of Hadoop Distribution core concepts and best practices.

• Experience with NoSQL technologies such as MongoDB and DynamoDB.

• AWS Cloud experience.

• Any Graduate degree.

Preferred Skills

• Exposure to AWS Lambda, EMR, and Kinesis.