Principal AI Engineer

Cognizant
San Francisco, US
Hybrid

Job Description

Job Summary- Principal AI Engineer

The Principal AI Engineer role involves designing and implementing scalable solutions using Kafka Python Databricks SQL and PySpark. With a hybrid work model and day shift the candidate will contribute to innovative projects ensuring optimal performance and alignment with business goals.

Responsibilities

  • Design and implement robust and scalable architectures leveraging Kafka Python Databricks SQL and PySpark to meet business requirements.
  • Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
  • MCP client-server tooling (AWS CLI + MCP protocol)
  • Develop and optimize data pipelines and workflows using PySpark and Databricks SQL for efficient data processing.
  • Provide technical expertise in Kafka to ensure seamless integration and real-time data streaming capabilities.
  • Oversee the development of Python-based solutions to automate processes and enhance system functionality.
  • Ensure high-quality deliverables by conducting thorough testing and validation of implemented solutions.
  • Monitor and troubleshoot system performance issues ensuring minimal downtime and optimal efficiency.
  • Stay updated with the latest technologies and trends in data engineering and architecture to drive innovation.
  • Document architectural designs workflows and processes for future reference and knowledge sharing.
  • Mentor and guide junior team members fostering a culture of continuous learning and improvement.
  • Collaborate with stakeholders to align technical solutions with business objectives and strategic goals.
  • Provide insights and recommendations to improve system scalability reliability and security.
  • Ensure compliance with organizational standards and best practices in architecture and development.

Qualifications

  • Possess extensive experience in designing and implementing solutions using Kafka Python Databricks SQL and PySpark.
  • Demonstrate strong problem-solving skills and the ability to optimize data workflows for large-scale systems.
  • Exhibit proficiency in real-time data streaming and integration using Kafka.
  • Showcase expertise in Python programming for automation and system enhancement.
  • Have a deep understanding of Databricks SQL for efficient data querying and processing.
  • Display strong communication skills to collaborate effectively with cross-functional teams.
  • Bring a proactive approach to staying updated with emerging technologies and industry trends.
  • Hold a proven track record of delivering high-quality solutions within deadlines.
  • Demonstrate the ability to document and share knowledge effectively with team members.
  • Exhibit a commitment to continuous learning and mentoring others in the team.
  • Possess a strong focus on aligning technical solutions with business goals and objectives.
  • Showcase experience in hybrid work environments and adaptability to dynamic project requirements.

Salary and Other Compensation:

The annual salary for this position is between $150-170K depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

· Medical/Dental/Vision/Life Insurance

· Paid holidays plus Paid Time Off

· 401(k) plan and contributions

· Long-term/Short-term Disability

· Paid Parental Leave

· Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Skills & Requirements

Technical Skills

KafkaPythonDatabricks sqlPysparkAws cliMcp protocolProblem-solvingCommunicationData engineeringArchitecture

Salary

$150,000 - $170,000

year

Employment Type

FULL TIME

Level

principal

Posted

4/22/2026

Apply Now

You will be redirected to Cognizant's application portal.