We are looking for a Bilingual QA Engineer for a 6 months contract with high possibility of extension. Role is hybrid with 2 days a week on site in Downtown Toronto.
Key Responsibilities
Functional & System Testing
- Design, develop, and execute test cases for data-driven and AI-enabled applications
- Validate system outputs for accuracy, consistency, and expected behavior
- Perform regression testing following system updates, data changes, or enhancements
- Identify, document, and track defects through resolution
AI / Intelligent Feature Testing
- Evaluate outputs from AI-powered features (e.g., chat, recommendations, or automation tools)
- Assess responses for relevance, correctness, tone, and alignment with business requirements
- Identify issues such as inconsistent responses, edge cases, or unexpected behavior
Test Automation & Tools
- Develop and maintain automated test scripts using Python
- Contribute to test frameworks and improve automation coverage
- Support integration of testing into CI/CD pipelines
- Track and report quality metrics and testing progress
Collaboration & Documentation
- Work closely with developers, data teams, and product stakeholders
- Create clear test plans, test cases, and defect reports
- Contribute to QA standards and continuous improvement initiatives
Must-Have Qualifications
- Bilingual in French and English (written and spoken)
- Strong experience in QA/testing (test cases, test plans, defect management)
- Experience testing applications with AI-driven or data-driven features
- Hands-on experience with Python for test automation
- Experience with regression testing
- Familiarity with CI/CD pipelines and testing workflows
Nice-to-Have
- Experience in banking or financial services
- Exposure to AI/ML concepts (e.g., NLP, generative AI, or recommendation systems)
- Understanding of common AI output issues (e.g., inconsistency, bias, or inaccuracies)
- Experience with test automation frameworks and evaluation tools
- Familiarity with data pipelines or model lifecycle processes
Note: We use AI tools to: obtain basic information, detect plagiarism, false employment history or references, categorize your skills, and do an initial match with job posting.