Senior Gen AI Engineer

Galent
New York, US
On-site

Job Description

Position: Senior Gen AI Engineer

Location: NJ / NYC (onsite)

As a Generative AI Engineer, you will design, develop, and deploy AI-powered solutions using large language models (LLMs), vector databases, and cloud-based infrastructure. You’ll be responsible for building and fine-tuning generative AI models, developing retrieval-augmented generation (RAG) systems, and integrating GenAI capabilities into scalable applications.

Key Responsibilities:

● Develop, fine-tune, and deploy LLM-based applications using frameworks like LangChain, Semantic Kernel, or LlamaIndex.

● Design and implement RAG pipelines using vector databases (Azure Cognitive Search, Pinecone, FAISS, Weaviate).

● Build chatbots, copilots, and content generation tools using OpenAI, Azure OpenAI, or Hugging Face models.

● Containerize and deploy GenAI services using Docker, FastAPI, and Azure Functions.

● Collaborate with cross-functional teams to identify and operationalize GenAI use cases.

● Implement monitoring, evaluation, and prompt optimization workflows.

● Manage prompt engineering, model selection, and performance tracking in production.

Preferred Qualifications:

● Bachelor’s or Master’s degree in Computer Science, Data Science, AI/ML, or a related field.

● Experience in developing PoCs or production-grade AI applications.

Your expertise in transforming LLMs, RAG, and Agentic AI systems into secure and scalable platforms is highly relevant to this role. I also noticed that you follow our client’s page, which indicates your interest in their work.

Skills & Requirements

Technical Skills

LangChainSemantic KernelLlamaIndexAzure Cognitive SearchPineconeFAISSWeaviateOpenAIAzure OpenAIHugging FaceDockerFastAPIAzure FunctionsAIMLLLMsRAGAgentic AI

Level

mid

Posted

4/8/2026

Continue to LinkedIn

You will be redirected to the job posting on LinkedIn.