Senior AI Engineer, Generative AI Services ML, AI 🏆

Capital One
New York, US

Job Description

Senior AI Engineer, Generative AI Services 💰 Salary: $229,900 - 286,200 per year

At Capital One we are looking for a ML, AI engineer!

🛠️ Our tech stack:

AI, AWS, Azure, C#, Cloud, Golang, Hardware, Support, Java, LLM, Machine Learning, PyTorch, Python, Scala, Machine-Learning

📝 Rquirements:

  • Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields, with at least 6 years of experience in developing AI and ML algorithms, or a Masters degree in the same fields with at least 4 years of experience
  • At least 6 years of programming experience in Python, Go, Scala, or Java
  • 7 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud (preferred)
  • Experience in designing, developing, integrating, delivering, and supporting complex AI systems (preferred)
  • Proven ability to lead and mentor engineering teams and influence cross-functional stakeholders (preferred)
  • Experience in developing AI and ML algorithms, including LLM Inference, Similarity Search, Guardrails, Memory, using languages such as Python, C++, C#, Java, or Golang (preferred)
  • Expertise in optimizing training and inference software to enhance hardware utilization, latency, throughput, and cost (preferred)
  • Strong communication and presentation skills, capable of articulating complex AI concepts clearly to peers (preferred)

👩‍💻👨‍💻 Your responsibilities are:

  • Collaborate with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-driven products that transform our associates work and customer interactions
  • Design, develop, test, deploy, and maintain AI software components, including foundation model training, large language model inference, similarity search, guardrails, model assessment, experimentation, governance, and observability
  • Utilize a diverse range of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch
  • Innovate and implement cutting-edge LLM optimization strategies to enhance performance metrics such as scalability, cost, latency, and throughput for large-scale production AI systems
  • Contribute to the overarching technical vision and long-term roadmap for foundational AI systems at Capital One

View this job and over 500 other transparent jobs with salaries (💰💰💰) & tech stacks (🛠️) on DevITJobs

Category: ML, AI Developer / Engineer

Location address: Park Avenue 299, New-York-City, United States

Salary: $229,900 - 286,200 per year

Benefits & perks that we offer:

Capital One - More about us and the role:

At Capital One, we are pioneering responsible and dependable AI systems, aimed at transforming banking for the better. We are recognized as leaders in implementing machine learning to create personalized customer experiences. Our commitment to technological innovation and top-tier talent, coupled with our extensive experience in machine learning, positions us at the forefront of enterprise AI applications. Join the Intelligent Foundations and Experiences (IFX) team, where we bring our AI vision to life through collaboration with partners across the organization. We create proprietary solutions that provide substantial value to millions of customers, advancing the capabilities of AI in a responsible, scalable manner. This role offers competitive compensation and benefits, and provides an exciting opportunity to make a meaningful impact on how we serve our customers.

Are you looking for ML, AI jobs in New-York-City?

Skills & Requirements

Technical Skills

AIAWSAzureC#CloudGolangJavaLLMMachine LearningPyTorchPythonScalaAI SystemsAI SolutionsAI SoftwareAI ComponentsFoundation Model TrainingLarge Language Model InferenceSimilarity SearchGuardrailsModel AssessmentExperimentationGovernanceObservabilityOpen SourceSaaSAI TechnologiesAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchLLM OptimizationScalabilityCostLatencyThroughputProduction AI SystemsTechnical VisionLong-term RoadmapFoundational AI SystemsAI SystemsAI SolutionsAI SoftwareAI ComponentsFoundation Model TrainingLarge Language Model InferenceSimilarity SearchGuardrailsModel AssessmentExperimentationGovernanceObservabilityOpen SourceSaaSAI TechnologiesAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchLLM OptimizationScalabilityCostLatencyThroughputProduction AI SystemsTechnical VisionLong-term RoadmapFoundational AI SystemsCollaborationLeadershipMentorshipInfluenceCommunicationPresentationAIMLCloudMachine LearningAI SystemsAI SolutionsAI SoftwareAI ComponentsFoundation Model TrainingLarge Language Model InferenceSimilarity SearchGuardrailsModel AssessmentExperimentationGovernanceObservabilityOpen SourceSaaSAI TechnologiesAWS UltraclustersHuggingfaceVectorDBsNemo GuardrailsPyTorchLLM OptimizationScalabilityCostLatencyThroughputProduction AI SystemsTechnical VisionLong-term RoadmapFoundational AI Systems

Salary

$229,900 - $286,200

year

Level

mid

Posted

4/7/2026

Apply Now

You will be redirected to Capital One's application portal.