Staff Software Engineer

Zeta Global
San Francisco, CA
Hybrid

Who this role is best for

Aimed at experienced software engineers with AI expertise who can lead platform design and development. Must have strong background in generative AI, large language models, and cloud infrastructure, with flexibility for in-office work in NYC.

Best fit for

  • Experienced software engineers with AI expertise who can lead platform design and development
    — “Staff Software Engineer in NYC to drive the design and development of the next generation of agentic, reliable, and scalable GenAI platforms”
  • Candidates with experience in building secure, scalable platform services and tooling for LLM-powered applications
    — “Lead the design and development of secure, scalable platform services and tooling for LLM-powered applications, agentic workflows, and experimentation”
  • Individuals with strong knowledge in retrieval and knowledge systems for enterprise use cases
    — “Design and implement retrieval and knowledge systems (e.g., RAG pipelines, embeddings, vector stores) to support enterprise use cases”
  • Candidates who can architect multi-tenant systems with isolation and cost attribution capabilities
    — “Architect multi-tenant capabilities including isolation, configuration, quota management, and cost attribution”

Things to consider

  • Requires in-office presence for at least 2 days per week in New York City
    — “Option to telecommute 3 days per week”
  • Candidates must be prepared to work with a variety of model providers and frameworks
    — “Integrate and evaluate multiple model providers and frameworks, defining abstraction and selection strategies”

How to stand out

  • Highlight experience in building enterprise-grade AI systems and observability tools for LLM applications
    — “Build observability and debugging capabilities for LLM applications, including tracing, cost monitoring, latency analysis, and failure detection”
  • Emphasize skills in agent orchestration, state management, and workflow control
    — “Design and implement agent orchestration frameworks, including tool integration, state management, and workflow control”
  • Showcase ability to define evaluation frameworks and continuous improvement strategies for AI systems
    — “Establish evaluation frameworks, benchmarks, and feedback loops to measure and continuously improve quality, correctness, and safety of GenAI systems”
  • Demonstrate experience with cloud infrastructure and model optimization techniques
    — “Optimize cost and performance of GenAI workloads through model routing, caching, prompt optimization, and efficient infrastructure design”
  • Demonstrate experience with developer tooling and API design for AI platforms
    — “Build developer-facing APIs, SDKs, and tooling to enable rapid experimentation and productionization of GenAI use cases”
Pace · Fast PacedCollaboration · MediumAutonomy · HighDecision Impact · Individual

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • secure, scalable platform services
  • LLM-powered applications
  • reliable GenAI systems
Typical background
software engineeringAI and cloud infrastructure

Skills & requirements

Required

LLM DevelopmentRetrieval And Knowledge SystemsEvaluation FrameworksObservabilitySecurity Controls

Preferred

Multi-tenant CapabilitiesAgent Orchestration Frameworks

Stack & domain

C#JavaJavaScriptGoPythonAILarge Language ModelsLlm-powered ApplicationsAgentic WorkflowsRetrieval And Knowledge SystemsEvaluation FrameworksObservabilityDebuggingMulti-tenant CapabilitiesSecurity ControlsAgent OrchestrationDeveloper ApisSdksEnd-to-end Lifecycle ManagementModel ProvidersCloud InfrastructureMCPLanggraphOpenaiBedrockLeadershipTeamworkProblem-solvingStrategic ThinkingCommunicationCollaborationSoftware Engineering

About the role

Original posting from Zeta Global via Greenhouse

WHO WE ARE  

Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI.

Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world.  To learn more, go to www.zetaglobal.com.

THE ROLE

Zeta Global Corp. seeks a Staff Software Engineer in San Francisco to drive the design and development of the next generation of agentic, reliable, and scalable GenAI platforms supporting state-of-the-art large language models, evaluation systems, and secure developer tooling. Shape technical direction, ensuring architectural excellence to infuse AI into real-world production solution.

Lead the design and development of secure, scalable platform services and tooling for LLM-powered applications, agentic workflows, and experimentation.

Design and implement retrieval and knowledge systems (e.g., RAG pipelines, embeddings, vector stores) to support enterprise use cases.

Establish evaluation frameworks, benchmarks, and feedback loops to measure and continuously improve quality, correctness, and safety of GenAI systems.

Build observability and debugging capabilities for LLM applications, including tracing, cost monitoring, latency analysis, and failure detection. Optimize cost and performance of GenAI workloads through model routing, caching, prompt optimization, and efficient infrastructure design.

Architect multi-tenant capabilities including isolation, configuration, quota management, and cost attribution.

Implement GenAI-specific security controls, including prompt injection mitigation, data protection, and access governance.

Design and implement agent orchestration frameworks, including tool integration, state management, and workflow control.

Build developer-facing APIs, SDKs, and tooling to enable rapid experimentation and productionization of GenAI use cases.

Drive end-to-end lifecycle management from experimentation to production, including versioning, deployment strategies, and rollback mechanisms.

Integrate and evaluate multiple model providers and frameworks, defining abstraction and selection strategies.

Develop Software using C#, Java, JavaScript, Go, or Python.

Apply experience with generative AI, large language models (LLMs), and cloud infrastructure.

Work with GenAI platform technologies (MCP, LangGraph, OpenAI, Bedrock). 

Option to telecommute 3 days per week. 

Bachelor’s degree in Computer Science, Computer or Software Engineering or Information Systems plus 5 years of experience in the job offered or in a related occupation.

Salary: $240,000/yr.

Send resume to: S Arvelo, Zeta Global Corp., 3 Park Avenue, 33rd Floor, New York, NY 10016.

BENEFITS & PERKS 

Unlimited PTO 

Excellent medical, dental, and vision coverage 

Employee Equity and Stock Purchase Plan 

Employee Discounts, Virtual Wellness Classes, and Pet Insurance 

And more!!  

PEOPLE & CULTURE AT ZETA 

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.  

We’re committed to building a workplace culture of trust and belonging, so everyone feels invited to bring their whole selves to work. We provide a forum for employees to celebrate, support and advocate for one another. Learn more about our commitment to diversity, equity and inclusion here: https://zetaglobal.com/blog/a-look-into-zetas-ergs/ 

ZETA IN THE NEWS! 

https://zetaglobal.com/press/?cat=press-releases 

Source: Zeta Global careers (Greenhouse)

Similar roles