Senior Software Engineer - Cortex AI - FDE

Snowflake
CA-Menlo Park
On-site

Who this role is best for

A natural match if you have experience building distributed AI systems and working in a customer-facing technical role.

Best fit for

  • Candidates with 7+ years of distributed systems experience and a background in AI/ML infrastructure
    — “7+ years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
  • Individuals who have navigated customer-facing technical challenges and translated them into clear narratives
    — “Experience in a customer-facing technical role — you have explained a hard failure to a frustrated external audience and been believed
  • Professionals with a strong grasp of cloud-native systems and database internals
    — “Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).

Things to consider

  • This role requires handling sensitive enterprise data at scale in a multi-tenant environment
    — “Designing multi-tenant systems that handle sensitive enterprise data at scale.
  • Candidates must be comfortable with open-ended, externally-driven problems
    — “Comfort with ambiguity on open-ended, externally-driven problems.

How to stand out

  • Highlight your experience with vector indices and scalable search indexing in your resume
    — “Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing
  • Demonstrate your ability to debug across multiple layers in unfamiliar code during interviews
    — “Cross-layer debugging — tracing a request across services and root-causing in unfamiliar code from logs and telemetry
  • Showcase your work on eval frameworks and systematic quality improvement for LLM systems
    — “Eval frameworks for LLM/agent systems — defining quality metrics and using evals to improve quality systematically over time.
  • Emphasize your work on optimizing model routing and prompt caching for performance and cost
    — “Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization
  • Demonstrate your ability to judge platform gaps from customer problems
    — “Product instinct — you can judge whether one customer's problem is bespoke or a platform gap worth fixing for everyone.
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · TeamLevel · Senior

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • architecting agentic runtimes
  • scaling context engineering infra
  • building the evals engine
  • productionizing AI workflows
  • optimizing performance and cost
Typical background
7+ years of experience building distributed systemsdeep proficiency in Go or Javastrong understanding of database internals

Skills & requirements

Required

Distributed SystemsHigh-throughput ApisBackend InfrastructureAI OrchestrationPerformance OptimizationCross-layer Debugging

Preferred

GoJavaPythonDatabase InternalsCloud-native ArchitectureVector IndicesAgent PlatformsData Pipelines

Stack & domain

GoJavaPythonDistributed SystemsHigh-throughput ApisBackend InfrastructureAI OrchestrationVector Database IntegrationKubernetesFoundationdbPrompt CachingToken OptimizationInnate CuriosityLow-egoExperimental MindsetProduct InstinctCross-layer DebuggingAIEnterprise DataAgentic AILLM CapabilitiesMicroservicesObservability

About the role

Original posting from Snowflake via Ashby

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.

The Cortex Apps team is building the future of AI for enterprise data. This role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence, Cortex Agents and Search making agentic AI fast, reliable, scalable and secure at the enterprise level.

You won’t just be using AI tools; you will be building the high-performance systems that orchestrate them. You’ll own and influence the architecture for agent execution environments, high-throughput context retrieval, or the ecosystem that allows our customers to iterate and launch agents in production.

WHAT YOU WILL DO IN THIS ROLE:

  • Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
  • Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing, query processing, and result ranking, semantic caching, and automated metadata extraction.
  • Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments.
  • Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
  • Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization to ensure Snowflake’s AI features are the most efficient in the industry.

REQUIREMENTS:

  • Education: Bachelor’s degree in Computer Science or a related technical field.
  • Experience: 7+ years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
  • Technical Stack: Deep proficiency in Go or Java (for systems) and Python (for AI orchestration).
  • Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).
  • Domain Expertise: Familiarity with the "plumbing" of AI: vector indices, agent platforms, and building scalable data pipelines.
  • Experience in a customer-facing technical role — you have explained a hard failure to a frustrated external audience and been believed, you can produce both the internal analysis and the customer-safe version.
  • Product instinct — you can judge whether one customer's problem is bespoke or a platform gap worth fixing for everyone. This is the core judgment call.
  • Cross-layer debugging — tracing a request across services and root-causing in unfamiliar code from logs and telemetry, not guesswork.
  • Eval frameworks for LLM/agent systems — defining quality metrics and using evals to improve quality systematically over time.
  • Comfort with ambiguity on open-ended, externally-driven problems.

(BONUS) EXPERIENCE WITH:

  • Query optimization and SQL engine internals.
  • Designing multi-tenant systems that handle sensitive enterprise data at scale.
  • Developing search infrastructure for large-scale applications.
  • Direct experience with any of the subsystems outlined above.

Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.

How do you want to make your impact?

For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com http://careers.snowflake.com

Source: Snowflake careers (Ashby)

Similar roles