Senior AI Engineer

Zafran Security
Tel Aviv, Israel
On-site

Who this role is best for

A natural match if you have experience building multi-tenant AI infrastructure in cybersecurity.

Best fit for

  • Candidates with strong backend infrastructure experience in AI/LLM systems and a deep understanding of agentic workflows
    — “Deep hands-on experience with agentic systems: tool use, structured outputs, prompt and context management, retrieval, and long-running or streaming flows.”
  • Individuals who have led evaluation frameworks for AI systems at scale and are familiar with observability tools
    — “Experience designing and running LLM evaluations at scale.”
  • Professionals with a track record of delivering secure, reliable, and cost-efficient AI platforms in production environments
    — “Proven experience building and operating production-grade AI / LLM infrastructure — real users, real traffic, real incidents.”

Things to consider

  • Candidates must be prepared to own the platform as a product and treat other engineers as customers
    — “Ownership mindset — you treat the platform as a product and other engineers as your customers.”

How to stand out

  • Highlight your experience with Kubernetes and observability tools like tracing and metrics in your resume
    — “Production experience on AWS and Kubernetes, including observability (tracing, metrics, logs).”
  • Emphasize your ability to design and run AI evaluation frameworks that catch regressions early
    — “Build the evaluation framework every team uses to measure quality, correctness, latency, and cost — and catch regressions in CI before customers do.”
  • Showcase your work on secure AI systems with examples of prompt injection defenses or data access controls
    — “Strict tenant isolation, defenses against prompt injection, and guarded data access across a multi-tenant security platform.”
  • Demonstrate your hands-on experience with Python and your ability to build shared developer infrastructure
    — “Strong Python skills. Experience building internal developer infrastructure used by multiple engineering teams.”
  • Position yourself as someone who sets AI engineering standards and raises the bar across teams
    — “Stay hands-on with architecture, implementation, and production issues, and help raise the AI engineering bar across R&D.”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Successfully launched AI infrastructure
  • Improved AI feature reliability and security
  • Reduced costs and latency in AI operations
Typical background
PhD in Computer Science or related fieldExperience in AI and machine learning

Skills & requirements

Required

AI InfrastructureLLM InfrastructureSystem DesignPythonKubernetesAWSAgentic SystemsLLM EvaluationsObservabilityAI SecurityMulti-tenant Security PlatformTool LayerR&D Enablement

Preferred

Agile Methodologies

Stack & domain

PythonLLM InfrastructureKubernetesAWSGoElasticsearchClickhousePostgreSQLCybersecurity

About the role

Original posting from Zafran Security via Ashby

Zafran is building the next generation of vulnerability and risk management. We bring together complex security data and turn it into clear investigation, prioritization, and action.

We're creating a new AI team to build the shared infrastructure, tools, and standards that enable teams across R&D to develop reliable AI-powered capabilities. The team will also own and deliver core AI experiences used across Zafran's platform and organization.

About Zafran:

Our Mission: To stop the exploitation of vulnerabilities, everywhere.

What makes us different: Zafran de-risks 90% of critical vulnerabilities overnight across your hybrid environment, leveraging Agentic Capabilities and your existing security tools to rapidly mitigate and remediate the 10% most likely to be exploited.

Who’s behind us: Zafran is backed by Menlo Ventures, Sequoia Capital, Cyberstarts, and a deep belief that cybersecurity should move as fast as attackers do. We’re one of the fastest-growing companies in the industry, scaling to meet demand from the world’s most advanced, security-obsessed organizations.

We’re serious about our mission- so expect work that matters, teammates who challenge and inspire you, and plenty of fun along the way!

We're looking for a Senior AI Engineer to be one of the team's first engineers and to own Zafran's AI infrastructure end to end — the shared platform every R&D team uses to build, test, ship, and monitor AI features. That platform powers our in-product AI assistant, our background agents, and every AI capability still to come. You'll set the standard for how AI runs in production at Zafran: when a team ships an AI feature, it should be reliable, secure, observable, and cost-efficient by default — because your platform made it that way.

What you will do:

  • Own the AI platform. Design, build, and run the shared agent runtime: model access, tool use, memory and sessions, streaming, and human approval for sensitive actions.
  • Production-grade. Scaling, fallback between model providers, rate limits, timeouts, and safe rollouts on Kubernetes.
  • Own evaluation. Build the evaluation framework every team uses to measure quality, correctness, latency, and cost — and catch regressions in CI before customers do.
  • Own observability and cost. Tracing for every agent run and tool call, token spend per tenant and per feature, and alerts when quality or cost drifts.
  • Own AI security. Strict tenant isolation, defenses against prompt injection, and guarded data access across a multi-tenant security platform.
  • Build the tool layer. MCP tools and data connectors that let agents query our security data safely and reliably.
  • Enable R&D. Shared libraries, templates, and docs so other teams can build, test, deploy, and monitor AI features independently.
  • Stay hands-on with architecture, implementation, and production issues, and help raise the AI engineering bar across R&D.

Requirements:

  • 5+ years of backend or infrastructure engineering, with strong system design skills.
  • Proven experience building and operating production-grade AI / LLM infrastructure — real users, real traffic, real incidents. Not prototypes.
  • Deep hands-on experience with agentic systems: tool use, structured outputs, prompt and context management, retrieval, and long-running or streaming flows.
  • Experience designing and running LLM evaluations at scale.
  • Strong Python skills.
  • Production experience on AWS and Kubernetes, including observability (tracing, metrics, logs).
  • Ownership mindset — you treat the platform as a product and other engineers as your customers.

Experience with the following is a plus:

  • Experience with Amazon Bedrock, Strands Agents, LiteLLM, MCP, or OpenTelemetry (our current stack).
  • Experience building internal developer infrastructure used by multiple engineering teams.
  • Experience with model evaluation, safety controls, governance, or LLM security (guardrails, prompt injection).
  • Experience operating multi-tenant SaaS systems.
  • Background in cybersecurity or security-data products.
  • Familiarity with Go, ElasticSearch, ClickHouse, or Postgres.

Why this role matters:

AI is a shared capability across Zafran's products and engineering organization. As the owner of the AI infrastructure, you'll build the foundation that lets every R&D team ship AI features faster and more safely — and shape Zafran's AI architecture from the ground up.

Source: Zafran Security careers (Ashby)

Similar roles