AI Engineer

Insight Global
Creedmoor, US

Job Description

Job Description

Insight Global is seeking an AI Engineer for a top internal technology organization focused on applied AI and automation. This candidate will play a hands-on builder role, rapidly prototyping and productionizing AI-powered applications that integrate directly into internal platforms. The role centers on prompt and agent design, evaluation, and quality-turning early AI concepts into reliable, user-facing features. Working closely with AI leadership, platform engineers, and data teams, this engineer will help scale a growing AI product ecosystem while shaping how AI is safely and effectively deployed across the organization

Day-to-Day:

Build AI-powered features and PoCs in Python using LLMs, RAG pipelines, and agentic workflows

Design, iterate, and version production prompts and system instructions

Develop and maintain evaluation harnesses to measure accuracy, grounding, and task success

Take AI PoCs to production by adding tests, logging, guardrails, and error handling

Partner with platform and data engineers on integrations, APIs, and deployment

Improve reusable AI building blocks (prompt templates, RAG scaffolding, eval utilities)

Monitor AI feature quality, debug regressions, and triage evaluation drops

Document prompts, evaluations, and AI feature behavior for auditability and knowledge sharing

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

3-5 years of professional software engineering experience with a recent focus on applied AI / LLM-based systems

Strong Python skills, including FastAPI, async patterns, and Pydantic v2

Hands-on experience shipping LLM-powered features (RAG, agents, tool/function calling, structured outputs)

Experience with prompt engineering and building evaluation harnesses (offline and online)

Experience working with at least one major model provider (OpenAI, Anthropic, Azure OpenAI, or similar)

Ability to read/write SQL and work with relational databases (Postgres or similar)

Familiarity with Azure services for deployment, storage, or model hosting

Strong written and verbal communication skills

Bias toward shipping quickly and iterating with real users - Experience with agentic frameworks or orchestration tools (LangGraph, Semantic Kernel, Autogen, Power Automate)

Experience integrating AI solutions within the Microsoft ecosystem (M365, SharePoint, Power Platform)

Experience with vector databases, embeddings, and retrieval optimization

Exposure to MLOps and observability tools (MLflow, Weights & Biases, eval dashboards)

Open-source contributions or public technical writing in applied AI

Skills & Requirements

Technical Skills

PythonFastapiAsync patternsPydantic v2Llm-based systemsPrompt engineeringEvaluation harnessesSqlPostgresAzure servicesVector databasesEmbeddingsRetrieval optimizationMlopsObservability toolsCommunicationAiAutomationLlmsRag pipelinesAgentic workflowsPrompt templatesRag scaffoldingEval utilitiesAgentic frameworksOrchestration toolsM365SharepointPower platformMlopsObservability tools

Level

Mid-Level

Posted

5/2/2026

Apply Now

You will be redirected to Insight Global's application portal.

Sign in and we'll score your resume against this role.