RTS - Real Time Streaming - Data Engineer

You will design and develop large-scale real-time streaming architectures and distributed systems.

Responsibilities

• Design and implement event-driven architectures using streaming data sets at scale.

• Develop and maintain automated build and deployment pipelines using CI/CD principles.

• Troubleshoot and resolve issues within distributed services ecosystems and production environments.

• Ensure data security by implementing encryption, anonymization, and strict logging policies for sensitive data.

• Research and benchmark technologies to ensure high-quality technical and application architecture.

Required Skills

• 5+ years of development and design experience in Java, Scala, or Python.

• Hands-on experience with Flink, Beam, or Spark Streaming (real-time data, not batch).

• Deep knowledge of Kafka and Kafka Streams.

• Proficiency with containerization and orchestration using Docker and OpenShift or Kubernetes.

• Experience with GitOps and automated deployment tools like Jenkins, ArgoCD, Kaniko, or Shipwright.

• Practical experience with Azure or OCI public cloud environments.

• Strong understanding of distributed systems, network fundamentals, and host-level routing.

• Competency in Linux OS configuration and shell scripting.

• Experience with automated unit and integration testing.

• Working knowledge of Agile methodology.

Preferred Skills

• Experience with Azure automation toolsets.