Senior Data Engineer

Absentia Labs
San Francisco +5 more
Hybrid

Who this role is best for

Aimed at experienced data engineers who thrive in research-driven, high-autonomy environments and have a strong grasp of biomedical data architecture.

Best fit for

  • Candidates with a background in scientific data modeling and schema evolution in complex domains
    — “schema design, normalization, and semantics are first-order engineering problems”
  • Engineers who have led production-grade data pipelines in cloud environments
    — “proven experience designing and operating large-scale, production-grade data pipelines”
  • Individuals with a strong interest in AI-driven biomedical discovery and scientific data integration
    — “transforming fragmented scientific data into reliable, machine-learning-ready knowledge”

Things to consider

  • The role demands ownership of ambiguous problems and long-term architectural decisions
    — “owning poorly defined problems and converging on robust solutions through thoughtful design and iteration”
  • The position requires a balance of theoretical and practical skills in data modeling and ML infrastructure
    — “data engineering for AI is as much about representation and correctness as it is about scale”

How to stand out

  • Emphasize your experience with schema-driven data modeling and data validation practices
    — “Define and evolve schema-driven data models that reconcile noisy, semi-structured, and heterogeneous sources”
  • Highlight your ability to translate research needs into durable data abstractions
    — “Partner closely with ML engineers, scientists, and product leads to translate research needs into durable data abstractions”
  • Showcase your cloud-native infrastructure experience with specific platforms like AWS, GCP, or Azure
    — “Deep experience with cloud platforms (AWS, GCP, or Azure), including storage, compute, and security primitives”
Pace · SteadyCollaboration · HighAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • designing and evolving data models
  • building cloud-native data infrastructure
Typical background
5+ years of experience in data engineering or related fields

Skills & requirements

Required

Data ModelingCloud-native Data InfrastructureData PipelinesSchema DesignData Quality

Preferred

Biomedical DataAi-driven Settings

Stack & domain

Data EngineeringPlatform EngineeringML InfrastructurePythonCloud PlatformsData LakesData WarehousesObject StorageStreaming SystemsSchema-driven Data ModelsData QualityValidationProvenanceLineageVersioningBiomedical DataAIMachine LearningLarge-scale Biomedical DatasetsChemicalBiologicalToxicologyOmicsAssayClinicalExperimental DataCloud-native Data InfrastructureBatch And Streaming AccessML TrainingEvaluationInferenceData AbstractionsPerformanceCostFlexibilityCorrectnessProduction SystemsSchema DesignNormalizationSemanticsProblem-solvingCommunicationTechnical LeadershipDesign ReviewsArchitectural GuidanceMentorshipSystemic RisksData IntegrityScalabilityOperational Complexity

About the role

Original posting from Absentia Labs via Ashby

ABOUT ABSENTIA LABS

Absentia Labs is building the data and intelligence infrastructure that powers the next generation of biomedical discovery. We work at the intersection of biology, chemistry, machine learning, and large-scale systems, transforming fragmented scientific data into reliable, machine-learning-ready knowledge.

Biomedical data is dispersed, semi-structured, and inherently noisy, yet deeply interconnected across experiments, assays, compounds, and biological systems. Extracting value from this complexity requires deliberate schema design, principled abstractions, and rigorous post-processing pipelines that can support both scientific reasoning and large-scale AI.

We believe breakthroughs start with strong data foundations. This role sits at the architectural core of our platform, shaping how scientific data is modeled, validated, versioned, and served across the organization.

THE ROLE

As a Senior Data Engineer, you will own the design and evolution of Absentia Labs’ biomedical data platform. You will operate with a high degree of autonomy, making long-horizon architectural decisions while remaining hands-on in implementation.

This role is ideal for an engineer who enjoys working in high-ambiguity, research-driven environments, and who understands that data engineering for AI is as much about representation and correctness as it is about scale.

WHAT YOU’LL DO

  • Architect and lead the design of end-to-end data systems for large-scale biomedical datasets (chemical, biological, toxicology, omics, assay, clinical, and experimental data).
  • Define and evolve schema-driven data models that reconcile noisy, semi-structured, and heterogeneous sources into coherent, interoperable representations.
  • Establish best practices for data quality, validation, provenance, lineage, and versioning suitable for scientific and ML workflows.
  • Build and maintain cloud-native data infrastructure (data lakes, warehouses, object storage, streaming systems) with an emphasis on scalability and reliability.
  • Design pipelines that support both batch and streaming access for ML training, evaluation, and inference.
  • Partner closely with ML engineers, scientists, and product leads to translate research needs into durable data abstractions.
  • Make principled trade-offs around performance, cost, flexibility, and correctness in production systems.
  • Provide technical leadership through design reviews, architectural guidance, and mentorship of other engineers.
  • Identify and proactively address systemic risks in data integrity, scalability, and operational complexity.

WHO YOU ARE

You are a data engineer who thinks in systems and interfaces, not just pipelines. You are comfortable owning poorly defined problems and converging on robust solutions through thoughtful design and iteration.

You understand that biomedical data is rarely “clean,” and that schema design, normalization, and semantics are first-order engineering problems—especially in AI-driven settings.

YOU LIKELY HAVE

  • 5+ years of experience in data engineering, platform engineering, or ML infrastructure roles, with clear ownership of production systems.
  • Proven experience designing and operating large-scale, production-grade data pipelines.
  • Strong proficiency in Python and data-centric software engineering practices.
  • Deep experience with cloud platforms (AWS, GCP, or Azure), including storage, compute, and security primitives.
  • Familiarity with distributed data processing and orchestration systems (e.g., Spark, Beam, Ray, Airflow, Dagster).
  • Experience supporting ML/AI workloads, including dataset generation, feature pipelines, and reproducible training workflows.
  • Strong architectural judgment and the ability to communicate technical decisions clearly across disciplines.

BONUS IF YOU HAVE

  • Competitive compensation, including meaningful equity participation, allows you to share directly in the long-term success and growth of the company.
  • Prior work with biomedical or life-science data (e.g., omics, assays, molecular representations, clinical or toxicology data).
  • Experience with streaming platforms (Kafka, Pub/Sub, Kinesis).
  • Exposure to ontology-aware data modeling or schema evolution in scientific domains.
  • Infrastructure-as-code and systems experience (Terraform, Docker, Kubernetes).
  • Experience in early-stage startups or research-heavy environments.
  • Open-source contributions or technical publications.

WHAT WE OFFER

  • A chance to architect the data backbone of an AI-driven biomedical platform.
  • Direct impact on how scientific data is translated into machine intelligence.
  • High autonomy, high trust, and ownership over critical systems.
  • Flexible remote or hybrid work arrangements.
  • A deeply technical, low-ego culture focused on learning and rigor.

HOW TO APPLY

Please submit your resume and a short note on why this role resonates with you. Links to GitHub, technical writing, or relevant projects are encouraged.

Source: Absentia Labs careers (Ashby)

Similar roles

More roles at Absentia Labs