Software Engineer in Test

Roadie

REMOTE

RemoteCareer-pivot friendly

Who this role is best for

Strong fit for mid-level QA automation engineers who build test infrastructure and collaborate closely with data science teams.

Best fit for

Mid-level QA automation engineers with a background in data science testing and Python development
— “3+ years experience in a developer, SDET or QA automation role”
Candidates who have experience with Pytest and end-to-end system testing in logistics or delivery platforms
— “Partner with software engineers and fellow test engineers to conduct end-to-end system testing”
Individuals with a track record of maintaining stable, scalable test suites in cloud environments
— “Build robust test infrastructure that powers automated regression testing for data science microservices”

Things to consider

Must be authorized to work in the U.S., as visa sponsorship is not available
— “This role is not eligible for Visa sponsorship”
Remote work is a requirement, as the role is described as remote-first
— “Remote-first environment”

How to stand out

Highlight experience with Pytest and CI/CD tools like GitHub Actions in your resume and interview answers
— “Experience with testing frameworks - Pytest preferred”
Emphasize your ability to troubleshoot automation issues in multiple environments
— “Troubleshoot and resolve automation issues across multiple environments”
Showcase your SQL skills and ability to validate data products and models
— “Be able to write and analyze SQL queries”
Demonstrate your understanding of the full application development lifecycle and how you apply it to testing
— “Understanding of the full application development lifecycle”
Include examples of how you've contributed to scalable and maintainable code in testing contexts
— “Demonstrated background of writing clean, stable, maintainable code”

Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · TeamLevel · Senior

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

build robust test infrastructure
troubleshoot and resolve automation issues
improve the performance, reliability, and stability of automated test suites
develop and execute comprehensive test strategies
identify, isolate, and document product defects

Typical background

3+ years experience in a developer, SDET or QA automation role3+ years coding experience in Python

Skills & requirements

Required

Test InfrastructureAutomated Regression TestingTroubleshoot Automation IssuesImprove Test Suite PerformanceDevelop Test StrategiesExecute High-impact Test CasesReview Product RequirementsConduct End-to-end System TestingIdentify Product DefectsVerify FixesWrite Clean CodeTesting MethodologiesAutomated Testing ApproachesTroubleshootingCommunication

Preferred

Performance TestingData Science ConceptsTesting ML ModelsKafkaGroundcoverSentryMlflowFull Application Development Lifecycle

Stack & domain

PythonRubyBashJavaScriptAPI TestingDB TestingPytestGrafanaNewrelicCircleciGitHubJiraPostmanAWSSQLKafkaGroundcoverSentryMlflowTroubleshootingCommunicationTeamworkAdaptabilityProblem-solvingData ScienceAutomationTestingQuality Assurance

About the role

Original posting from Roadie via Greenhouse

Roadie, a UPS company, is a leading logistics and delivery platform that helps businesses tackle the complexities of modern retail with unmatched delivery coverage, flexibility and visibility. Reaching 97% of U.S. households across more than 30,000 zip codes — from urban hubs to rural communities — Roadie provides seamless, scalable solutions that meet a variety of delivery needs.
With a network of more than 310,000 independent drivers nationwide, Roadie offers flexible delivery solutions that make complex logistics challenges easy, including solutions for local same-day delivery, delivery of big and bulky items, ship-from-store and DC-to-door. For more information, visit www.roadie.com.
Roadie is seeking a Software Engineer in Test to join our talented team of developers. In this role, you’ll advance our data science testing and automation capabilities, tackle complex challenges across the software delivery pipeline, and help ensure our data products, models, and insights are accurate, reliable, and ready to scale.
What You’ll Do
Build robust test infrastructure that powers automated regression testing for data science microservices
Troubleshoot and resolve automation issues across multiple environments
Improve the performance, reliability, and stability of automated test suites
Develop and execute comprehensive test strategies and high-impact test cases
Review product requirements to ensure alignment with established design and quality guidelines
Partner with software engineers and fellow test engineers to conduct end-to-end system testing and post-deployment validation
Identify, isolate, and clearly document product defects, then verify fixes through resolution
Champion quality at every stage of the software development lifecycle
What You Bring
3+ years experience in a developer, SDET or QA automation role
3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash or Javascript, a plus!
Experience with testing APIs and DBs
Experience in testing frameworks - Pytest preferred
Experience with monitoring tools like grafana, NewRelic or similar
Experience in CI/CD tools such as CircleCI, github action or similar
Be able to write and analyze SQL queries
Experience with cloud solutions such as AWS
Experience with tools such as github, JIRA, postman
Demonstrated background of writing clean, stable, maintainable code
Strong understanding of testing methodologies and automated testing approaches
Excellent troubleshooting and communication skills
Thrives in fast-paced environment, with ability to operate within short release-cycles
Bonus
Familiarity with performance testing and related tools
Familiarity with Data Science concepts
Experience with testing ML models
Experience with Kafka, groundcover, Sentry, MLFlow
Understanding of the full application development lifecycle
Why Roadie?
Competitive total rewards package
100% company-paid health insurance for yourself
401(k) with company match
Tuition & student loan repayment assistance- yes, we’ll contribute directly to your student loans!
Remote-first environment
Unlimited PTO
Inclusive family leave policy that supports all new parents
Paid Wellness Days in addition to Company holidays
Monthly WFH stipend
Paid sabbatical leave- tenured Roadies are given extra time to unplug, rest, and explore
The technology you need to get the job done
This role is not eligible for Visa sponsorship. Applicants must be authorized to work for any employer in the U.S.

Source: Roadie careers (Greenhouse)