Sr Data Engineer

Capco
Pune, India
Career-pivot friendly

Who this role is best for

Best suited to data engineers with experience in cloud platforms and ETL pipeline development working in the financial services industry.

Best fit for

  • Candidates with hands-on experience in Spark and cloud-based data architectures
    — “Spark fundamentals: Partitioning, caching, distributed processing, performance enhancement, Exception handling”
  • Professionals who have developed and supported enterprise-level data pipelines
    — “Enterprise production pipeline development/support”
  • Individuals who can work on transformation projects in banking and finance
    — “You will work on engaging projects with the largest international and local banks”

Things to consider

  • The role likely involves long-term client engagement and project delivery
    — “We deliver disruptive work that is changing energy and financial services”
  • Geographic flexibility may be required, given global client presence
    — “With our presence across 32 cities across globe”

How to stand out

  • Highlight experience with distributed processing and performance optimization in Spark
    — “Spark fundamentals: Partitioning, caching, distributed processing, performance enhancement”
  • Emphasize your CI/CD and IaC experience with Terraform for infrastructure automation
    — “Terraform/IaC, Enterprise production pipeline development/support”
Pace · SteadyCollaboration · MediumAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • developed and maintained robust data pipelines
  • supported enterprise production pipeline development
Typical background
experience in data engineeringproficiency in Python and PySpark

Skills & requirements

Required

PythonPysparkSpark SQLDatabricksAzureCI/CDREST APIETL PipelinesDelta LakesLakehouse ArchitectureSpark FundamentalsBatch ProcessingADLSTerraformEnterprise Production Pipeline Development

Stack & domain

PythonPysparkSpark SQLDatabricksAzureCI/CDREST APIETL PipelinesDelta LakesLakehouse ArchitectureSpark FundamentalsPartitioningCachingDistributed ProcessingPerformance EnhancementException HandlingBatch ProcessingADLSTerraformIacEnterprise Production Pipeline Development/support

About the role

Original posting from Capco via Greenhouse

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

MAKE AN IMPACT

Role: Data Engineer 

Python, PySpark, Spark SQL, Databricks, Azure, CI/CD, Rest API, ETL Pipelines, Delta Lakes & Lakehouse Archiecture,

Spark fundamentals: Partitioning, caching, distributed processing, performance enhancement, Exception handling

Batch Processing, ADLS,

Terraform/IaC, Enterprise production pipeline development/support

Source: Capco careers (Greenhouse)

Similar roles

More roles at Capco