RTS - Real Time Streaming - Data Engineer

ValueLabs
AE
On-site

Job Description

You will design and develop large-scale real-time streaming architectures and distributed systems.

Responsibilities

  • Design and implement event-driven architectures using streaming data sets at scale.
  • Develop and maintain automated build and deployment pipelines using CI/CD principles.
  • Troubleshoot and resolve issues within distributed services ecosystems and production environments.
  • Ensure data security by implementing encryption, anonymization, and strict logging policies for sensitive data.
  • Research and benchmark technologies to ensure high-quality technical and application architecture.

Required Skills

  • 5+ years of development and design experience in Java, Scala, or Python.
  • Hands-on experience with Flink, Beam, or Spark Streaming (real-time data, not batch).
  • Deep knowledge of Kafka and Kafka Streams.
  • Proficiency with containerization and orchestration using Docker and OpenShift or Kubernetes.
  • Experience with GitOps and automated deployment tools like Jenkins, ArgoCD, Kaniko, or Shipwright.
  • Practical experience with Azure or OCI public cloud environments.
  • Strong understanding of distributed systems, network fundamentals, and host-level routing.
  • Competency in Linux OS configuration and shell scripting.
  • Experience with automated unit and integration testing.
  • Working knowledge of Agile methodology.

Preferred Skills

  • Experience with Azure automation toolsets.

Skills & Requirements

Technical Skills

JavaScalaPythonFlinkBeamSpark streamingKafkaKafka streamsDockerOpenshiftKubernetesGitopsJenkinsArgocdKanikoShipwrightAzureOciLinux os configurationShell scriptingAutomated unit and integration testingAgile methodology

Employment Type

FULL TIME

Level

senior

Posted

5/4/2026

Apply Now

You will be redirected to ValueLabs's application portal.

Sign in and we'll score your resume against this role.

Find Similar Jobs

Browse roles in the same category, level, and remote setup.