Requisition ID: 255189
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.
Purpose
Contributes to the overall success of the IB Technology & Transformation team in Canada (supporting Caribbean region) ensuring specific individual goals, plans, initiatives are executed / delivered in support of the team’s business strategies and objectives.
Ensures all activities conducted are in compliance with governing regulations, internal policies and procedures. This role will support on-going EDL (Enterprise Data Lake) ingestions, as well as strategic objectives of Cloud data consumption enablement and migration of on-premises Data Lake to Cloud technology.
Accountability
- Champions a client centric culture to deepen client relationships and leverage broader Bank relationships, systems and knowledge.
- Functions as a member of an agile team and help drive consistent development practices, tools usage, common components, and patterns.
- Collaborates with cross functional stakeholders to build scalable data ingestion pipelines and improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making.
- Performs hands-on design and development with SQL/BigQuery/PySpark/Pandas, Parquet/ORC/Avro file formats processing, using appropriate data ingestion patterns, data modelling techniques and Airflow scheduling / orchestration.
- Develop data ingestion processes using DataStage, and extract requests from EDL (Data Lake) platform or other data source based on user requests.
- Creating design documentation, writing code, performing testing, debugging and troubleshooting technical issues to support EDL ingestions for CCA region.
- Spends significant amount of time building ETL processes, writing code and testing.
- Works with the team to optimize code execution.
- Skilled with dimensional modeling, medallion Cloud architectures and DevOps processes
- Direct the identification and recommendation of appropriate solutions, and guide junior team members.
- Understand how the Bank’s risk appetite and risk culture should be considered in day-to-day activities and decisions.
- Actively pursues effective and efficient operations of his/her respective areas in accordance with Scotiabank’s Values, its Code of Conduct and the Global Sales Principles, while ensuring the adequacy, adherence to and effectiveness of day-to-day business controls to meet obligations with respect to operational, compliance, AML/ATF/sanctions and conduct risk.
- Champions a high-performance environment and contributes to an inclusive work environment.
- Strong verbal and written communication skills, capable of conveying ideas clearly, concisely, and appropriately to different audiences.
What do you bring to the table
Must have -
- Experience of working in technology projects / supporting systems like DataStage /ETL process, Hadoop System/Apache HIVE HQL, SQL etc. Experience working with PCI data, bitbucket, JIRA and confluence (Agile methodologies), Cloud technologies (GCP or Azure Databricks).
- Regulatory bodies and special requirements - Comply with Scotiabank’s IT Risk data standards.
- The incumbent is responsible for supporting the following:
- Perform and develop data ingestion and extract request from EDL/Data Lake/Data Stage platform or other data source based on user request.
- Support EDL data migration to Cloud technology.
- Supporting ad hoc data requirements for regulatory reporting and strategy development for Senior management.
- Interpret data, analyze results using statistical techniques and provide ongoing support.
- Identify, analyze and interpret trends or patterns in complex data sets
- Provide off hour support for the EDL data related tasks if required.
- Good knowledge of Incident, Change management process and Service Requests, etc.
- 3-6+ years’ experience working as a Data Engineer
- Bachelor’s degree in computer science or engineering, or related field or relevant experience.
- Strong proficiency in Cloud computing, Data Quality and Governance.
- Strong proficiency in GCP (BigQuery/Dataproc/Composer), SQL, Python and Spark, Azure Databricks is an asset.
- Data modelling, medallion Cloud architecture, Datalake/Data warehousing experience
- Proficiency with Cloud Storage, BigQuery, Dataproc, Airflow/Composer
- Experience with Hadoop and DataStage ETL.
- Experience working in an Agile team environment.
What's in it for you?
- Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
- Acce