Data Scientist - Polygraph Required

BTI360 Website
Tysons Corner, VA
On-site

Who this role is best for

Geared toward candidates comfortable with leading end-to-end ML projects and fine-tuning LLMs, with a focus on national security domain and on-site collaboration in Virginia.

Best fit for

  • Candidates with experience fine-tuning LLMs and leading technical initiatives in national security contexts
    — “Collaborate across teams to align on strategy, provide data science expertise, and contribute to proposals and strategic initiatives.”
  • Individuals who can translate business needs into technical solutions and communicate findings effectively
    — “Translate business requirements into quantitative problems and communicate technical findings to both technical and non-technical stakeholders through reports, presentations, and direct customer engagement.”
  • Data scientists with a strong background in NLP and model evaluation, who thrive in mission-critical environments
    — “Deep expertise in NLP and modern ML techniques including embeddings, clustering, classification, and working with LLMs.”

Things to consider

  • Residency requirement within a two-hour drive of Herndon, VA, limits remote flexibility
    — “Candidates must maintain a primary residence within a two-hour drive of Herndon, VA to support onsite collaboration as needed.”
  • Position entails working with national security customers, which may involve sensitive or classified information
    — “primarily serving national security customers in the Washington, DC metropolitan area.”

How to stand out

  • Highlight experience with model evaluation frameworks and clustering/classification systems in your resume
    — “Design and conduct rigorous model evaluations using industry-standard methodologies, including developing custom evaluation frameworks for clustering, classification, embeddings, and entity resolution systems.”
  • Emphasize your ability to present findings to leadership and customers in your interview responses
    — “Excellent communication skills with experience translating technical metrics into business value and presenting findings to leadership and customers.”
  • Demonstrate your ability to optimize systems and improve key metrics through specific examples
    — “Optimize existing systems by identifying data quality issues, implementing performance improvements, and developing novel approaches that deliver measurable improvements in key metrics.”
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · Company

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • leading end-to-end machine learning projects
  • designing and conducting model evaluations
Typical background
data science or machine learning experience

Skills & requirements

Required

NLPMachine LearningModel EvaluationData-driven Decision Making

Preferred

LLM

Stack & domain

Machine LearningNLPEmbeddingsClusteringClassificationEntity ResolutionLlmsFine-tuned ModelsSmall Language ModelsModel EvaluationData Quality IssuesPerformance ImprovementsNovel ApproachesStatistical MethodsValidationData-driven DecisionsReportsWhitepapersSolution AlternativesImpactCostTechnical FeasibilityAlignment With Strategic GoalsModel DevelopmentEvaluationMentorshipTechnical GuidanceProject DirectionBest PracticesCommunicationTeamworkProblem-solvingAdaptabilityIndependenceCollaborationActive Ts/sci With PolygraphData ScienceSoftware Engineering

About the role

Original posting from BTI360 Website via Greenhouse

About the Team

Here at BTI360, we’ve built a culture that’s passionate about developing software engineers. Software doesn't build itself. People do.  In fact, teams of people do.  That's why our primary focus is on developing better craftsmen, better teammates, and better technical leaders.  By putting people first, we're not just giving our teammates more opportunities to grow, we're also raising the bar of the software we ship. BTI360 previously has been voted 10 years in a row as a TOP Place to Work by the Washington Business Journal. 

BTI360 is looking to add a Data Scientist to our team.You’ll thrive here if you are naturally curious, driven to ask the right questions, and energized by turning complexity into clarity. Our data scientists don’t just build models, they influence decisions, shape strategy, and help our customers navigate high‑impact mission challenges.

What you will do in this role:

As a Data Scientist at BTI360, you will:

Lead end-to-end machine learning projects from problem definition to production, leveraging pre-trained models and LLMs for rapid prototyping, then using data-driven evaluation to determine when to invest in custom solutions such as fine-tuned models or purpose-built small language models.

Design and conduct rigorous model evaluations using industry-standard methodologies, including developing custom evaluation frameworks for clustering, classification, embeddings, and entity resolution systems.

Translate business requirements into quantitative problems and communicate technical findings to both technical and non-technical stakeholders through reports, presentations, and direct customer engagement.

Drive technical decision-making for model selection, including evaluating embeddings models, LLMs, and other ML systems against business requirements and performance benchmarks.

Optimize existing systems by identifying data quality issues, implementing performance improvements, and developing novel approaches that deliver measurable improvements in key metrics.

Stay current with ML advances and introduce new techniques and frameworks to the team, including participating in or presenting at industry conferences

Apply statistical methods to validate findings and support data‑driven decisions.

Develop reports and whitepapers that evaluate solution alternatives based on impact, cost, technical feasibility, and alignment with strategic goals.

Senior candidates will also need to: Collaborate across teams to align on strategy, provide data science expertise, and contribute to proposals and strategic initiatives. 

Senior candidates will also need to: Mentor junior data scientists by providing technical guidance, defining project direction, and sharing best practices in model development and evaluation. 

You may thrive in this role if you have the following skills:

Active TS/SCI with Polygraph 

3+ years of experience in data science or machine learning roles with demonstrated impact on production systems.

Deep expertise in NLP and modern ML techniques including embeddings, clustering, classification, and working with LLMs.

NLP experience including feature engineering and modeling for text data.

Knowledge of ML evaluation metrics appropriate for various use cases.

Proven track record of model evaluation using appropriate metrics and methodologies for different problem types (precision/recall, silhouette scores, benchmarks, etc.).

Strong scripting skills with experience in AI/ML frameworks (scikit-learn, PyTorch/TensorFlow, transformers) and data manipulation libraries, including proficiency with Jupyter notebooks for exploratory analysis and experimentation.

Basic software engineering practices such as git, CI/CD, code reviews, documentation, and ability to access and leverage remote APIs.

Familiarity with cloud platforms (AWS, Azure, GCP).

Excellent communication skills with experience translating technical metrics into business value and presenting findings to leadership and customers.

Ability to work independently

Candidates must maintain a primary residence within a two‑hour drive of Herndon, VA to support onsite collaboration as needed.

You may excel in this role if you have the following skills:

Strong Python programming skills

Experience integrating ML models into production systems.

Experience customizing or fine‑tuning LLMs (LoRA, distillation, etc.).

Experience with large or multimodal datasets.

Proficiency in SQL and Elasticsearch/Elastic Stack for building evaluation datasets and querying production data systems.

Experience leading technical initiatives

The base salary pay range for this role is $114,000 - $221,900. This range reflects base compensation only and does not include benefits, bonuses, or additional pay incentives associated with the opportunity.

BTI360 benefits for full-time teammates

Fully paid healthcare premiums

Competitive salaries and performance bonuses

Career development and in-house training 

Tuition Reimbursement 

Up to 5 weeks PTO plus 2 weeks of federal holidays 

401K dollar for dollar matching up to 6% annually - vested immediately on day 1  

Giving Back: Serving communities locally and across the globe

Social Events (happy hours, golf tournament, BTI360 Family Festival and more)

Commitment to Fairness and Inclusion

At BTI360, we believe that unlocking the potential of others is not just a mission—it's the heart of our culture. We are committed to fostering an inclusive environment where every individual can grow each day, lead with humility, and do the right thing. Our core values guide us in developing software that makes a difference, primarily serving national security customers in the Washington, DC metropolitan area.

We are an Equal Opportunity Employer. We do not discriminate against any employee or applicant based on race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other legally protected characteristics. We celebrate fairness and are dedicated to creating an environment of mutual respect and inclusion where everyone can bring their true selves to work.

Join us in a workplace where your contributions are valued, your growth is encouraged, and your potential is unlocked. Together, we develop great software fast and deliver exceptional solutions for our customers.

Source: BTI360 Website careers (Greenhouse)

Similar roles