Software Engineer II

Sumo Logic
Noida +1 more
On-siteCareer-pivot friendly

Who this role is best for

Geared toward candidates comfortable with building automation for Kafka clusters and working in a collaborative, infrastructure-focused environment, with a preference for cloud platforms like AWS and experience in Java/Scala/Golang.

Best fit for

  • Candidates with experience in Kafka operations and infrastructure automation, and a background in cloud platforms like AWS.
    — “cloud platforms like AWS/Azure/GCP (AWS preferred)”
  • Engineers who are proactive in influencing architectural decisions and improving observability practices across teams.
    — “Ability to influence: Understand people's values and motivations and influence them towards making good architectural choices.”

Things to consider

  • On-call responsibilities are expected, with a transition to a global PaaS on-call rotation.
    — “participate in the on-call rotation (with an eventual move into the PaaS global on-call rotation)”
  • The role requires hands-on experience with Kafka's internal operations, not just surface-level knowledge.
    — “Good understanding of Kafka internals and operations: partition reassignment and rebalancing, leader election and in-sync replicas, retention and compaction, and broker and consumer performance tuning.”

How to stand out

  • Emphasize experience in building and maintaining self-service infrastructure tools.
    — “Develop and own the self-service interfaces teams use to consume Kafka (Terraform modules, CLI tools, APIs, dashboards), with predictable, versioned behavior”
  • Highlight contributions to automation that enable teams to manage Kafka clusters independently.
    — “Build and maintain automation and tooling for the Kafka cluster lifecycle: provisioning, upgrades, scaling, failover and migration”
  • Showcase skills in infrastructure-as-code, particularly with Terraform, and cloud platform experience.
    — “Experience with Infrastructure-as-Code (IaC) tools, specifically Terraform.”
  • Demonstrate knowledge of Kafka security mechanisms like TLS, authentication, and authorization.
    — “Knowledgeable in the security aspects of Kafka (TLS, authentication and authorization).”
  • Include experience with monitoring tools like Prometheus and Grafana, especially for consumer-lag tracking.
    — “Familiarity with monitoring tools like Prometheus, Grafana, or similar, including consumer-lag monitoring.”
Pace · SteadyCollaboration · HighAutonomy · MediumDecision Impact · Individual

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Kafka cluster lifecycle
  • self-service interfaces
  • observability
Typical background
software engineeringcloud infrastructure

Skills & requirements

Required

Java/scala/golangApache KafkaCloud PlatformsInfrastructure-as-codeMonitoring Tools

Preferred

Cruise ControlSchema Registry

Stack & domain

JavaScalaGoApache KafkaTerraformPythonBashLinuxPrometheusGrafanaCI/CDVersion ControlSecurityCollaborationInfluenceFlexibilityBias Towards ActionCloud-nativeInfrastructureObservability

About the role

Original posting from Sumo Logic via Greenhouse

Software Engineer - II, Kafka Infrastructure

Summary of role

Kafka is the backbone of how data moves through Sumo Logic, and every team that builds on it needs clusters that are predictable, reliable and easy to manage. As a Software Engineer within the Kafka Infrastructure team, you will build and maintain the tools and frameworks that manage the full lifecycle of Kafka clusters at Sumo Logic. The team acts as the platform and center of excellence for Kafka, with the long-term goal of unifying Kafka operations under a single, consistent usage pattern. You will contribute to the automation that lets teams spin up, tear down, migrate and manage Kafka clusters and topics themselves, as part of Sumo Logic's internal Platform-as-a-Service.

Responsibilities

Build and maintain automation and tooling for the Kafka cluster lifecycle: provisioning, upgrades, scaling, failover and migration

Develop and own the self-service interfaces teams use to consume Kafka (Terraform modules, CLI tools, APIs, dashboards), with predictable, versioned behavior

Maintain and evolve the team's core components, including cluster balancing, consumer-lag monitoring, schema management, cluster-to-cluster data migration, Kafka-to-S3 backup and hardened machine images

Improve observability and operational practices for Kafka across the organization, and drive standardization of tooling

Provide second-level support for Kafka clusters, and participate in the on-call rotation (with an eventual move into the PaaS global on-call rotation)

Educate and collaborate with application teams through onboarding sessions, documentation and migration guides, and consult on partitioning, consumer-group and schema best practices

Evaluate and test new Kafka technologies and designs, and make recommendations

Write detailed design documents and documentation on system design and implementation

Required Qualifications and Skills

Bachelor's or Master's degree in Computer Science or another scientific or technical discipline.

Ability to influence: Understand people's values and motivations and influence them towards making good architectural choices.

Collaborative working style: You can work with other engineers to come up with good decisions.

Bias towards action: You need to make things happen. It is essential you don't become an inhibitor of progress, but an enabler.

Flexibility: You are willing to learn and change. Admit past approaches might not be the right ones now.

Technical skills: 

2+ years of experience in software development in Java/Scala/Golang or similar.

1+ years of hands-on experience with Apache Kafka, including brokers, topics, partitions, replication and consumer groups.

Good understanding of Kafka internals and operations: partition reassignment and rebalancing, leader election and in-sync replicas, retention and compaction, and broker and consumer performance tuning.

Experience with cloud platforms like AWS/Azure/GCP (AWS preferred).

Skilled in Infrastructure-as-Code (IaC) tools, specifically Terraform.

Proficient in scripting languages such as Python/Bash.

Comfortable with Linux administration and troubleshooting distributed systems in production.

Familiarity with monitoring tools like Prometheus, Grafana, or similar, including consumer-lag monitoring.

Working knowledge of CI/CD and version control workflows.

Knowledgeable in the security aspects of Kafka (TLS, authentication and authorization).

Nice to have:

Experience with Cruise Control, Schema Registry, Kafka Connect or MirrorMaker.

Experience building hardened machine images (for example with Packer).

Experience with Kubernetes and GitOps.

Experience building CLI tools or internal developer platforms.

About Us

Sumo Logic, Inc. empowers the people who power modern, digital business.  Through its SaaS analytics platform, Sumo Logic enables customers to deliver reliable and secure cloud-native applications. The Sumo Logic Continuous Intelligence Platform™ helps practitioners and developers ensure application reliability, secure and protect against modern security threats, and gain insights into their cloud infrastructures. Customers around the world rely on Sumo Logic to get powerful real-time analytics and insights across observability and security solutions for their cloud-native applications. For more information, visit www.sumologic.com.

Source: Sumo Logic careers (Greenhouse)

Similar roles

More roles at Sumo Logic